My current issue is that I literally have a 1/6 acre lot, on a steep slope, and almost every last square foot is dedicated to edible landscaping, gardening tiers, fruit trees, etc. The only part of the yard that isn't is a small 24' x 16' section, but again - it's on a slope - and my wife won't let me do anything there, because she wants me to build a jungle gym or something play-oriented for the baby.
For the lay of my land, I only have a 8' strip on the south side of my house that's "mine", and 6' strip on the north side, which is landscaped like woodland area and hasn't a square foot to spare.
I can't build in front of my house where I actually have some yard space, due to local code.