Hi,
When they are young like that, you can leave all the stems as they don't shade each other.
Except for propagation, I wouldn't cut anything on that tree. Or perhaps, if you already have a precise idea of the shape you want, then yes, stick to your plan.
With no particular plan, I would let them all grow for this year.
Winter may take its toll, and you'll be using what is left to you for next year.
If you want the caliper of some stems to thicken more (more cold hardy then), then yes, remove asap all the buds and stems that you don't want, as those are then just a waste of time and energy.
I would then use pinching on the stems that you leave to grow, as those higher ones, they start to be too high for a good winter protection.
The tree is yours, and so is the decision ... of course :) .