I used to haul some pretty heavy trailers with an old (97) F350 Diesel. No problems at all.
HOAs on the other hand…
I used to visit some friends of mine who lived in a subdivision with an HOA. Nearly every time I drove my truck through there and parked at their house they would get nasty-grams from the HOA president about the big noisy diesel truck visiting them. (Never at odd hours always during daylight) One neighbor on the corner would throw fits because the sound of my truck accelerating from the stop sign was so loud it would ruin her entire day. After said friends traded in their own gas truck for a diesel it really hit the fan…to the point they sold their house and bought a farm. All over a truck!
Moral of the story if your HOA is particularly cranky even though you think you are following the rules they still may go bat guano crazy on you because of your noisy diesel truck.