Josh,
If you choose a south facing location against a brick (or any) wall, I think Pom trees should do well in your area. I had three Wonderful pom trees purchased thru two nurseries about 10 years ago, planted them into clay soil with not much potting soil then (I did not know much then). All three died in one time or another due to relocation stresses, diseases etc...But they came back up, via the roots. Two were grafted, and one was air layered when bought. So I have one Wonderful, and two unknowns from the root stocks now, and all grow very well after settling done in my Zone 8 climate. The majority of the growth is in spring time, though, with some growth but not much in the summer time, especially if they are loaded. The attached pic is Wonderful pom, with small softer seeds and deep red pulp. The other two have larger hard seeds, one is pink and the other has white/tan pulp. Both are sweet without hint of acidity, unlike Wonderful. I'd like to mention that during relocation of the pom trees, I had to dig them out with a spade, which resulted in severe damages of the roots. But they survived. I'd think that the pom trees is quite easy to grow, and grow vigorously when established.