Hi Blackfoot,
Tiny leaf is a sign of lack of gazoline in the mix - well, fertilizer I mean .
I would add some blue bullets fertilizer 10/10/10 and/or some dried manure - I found the sticks of dried manure in some nurseries and trees seem to like it as when watered the sticks of manure will break down and get inside the mix and near the roots of the trees.
Could be that your mix is not holding enough water too. I would check an hour after watering the pots if there is still some moisture at the top of the pot.
Are you top or bottom watering ?
Could be a problem with low temps ... Are you monitoring the temps, especially when inside ?
Could be insects since your pots are outside sometimes. Check the base of the trunks and the leaves. If you find some tiny spiders ... crush them ...
Try to check the dirt in the bottom of the pots for some insects overwintering there.
Good luck !