I have two trees in my yard of the same cultivar. The oldest one, 5 years old now, is planted 7 feet from the south facing wall of my garage, and is already beginning to leaf out here in Arizona. I keep it pruned back so there are three or four feet between it and the wall. The other one, grown from a cutting off the first one, is four years old, planted out on the perimeter of our yard, and has a couple of buds but seems to be about three weeks behind the other.
So there would seem be some benefit from planting even 7 feet away from your south facing wall.