I might be misunderstanding what you mean by 4200 randomly drawn observations. For 43 sites the possible pairwise combinations are 903 link. Aren’t you overdrawing?
Also have a look at Distance matrix regression. I believe your issue is discussed and solved there.