Gina, the last part of your question was "what do you do with trees that havent' grown much at all - leave them alone? "
Make sure the plant is not root bound and the soil not compact but well draining. Generally it has been suggested by many in this forum to give a good dose of fertilizer in early spring and then late spring, keep the soil moist and keep it in good sunny spot i.e. pamper it well. This should make it go unless there is something inherently wrong such ass the plant root system either not taking in the nutrient and moisture or there is problem in the plant nutrient hydraulic uptake system.
We have noticed that when one roots a few cuttings some will grow faster than the other. A few time when a rooted plant will have horizontal growth and would not grow upward or growth stalled, I will cut a healthy branch to root or air-layer it and the new plant will grow much faster than the mother plant.