Hi Shawn,
The choice is up to you.
For me, I would fertilize more, and let them all grow. In July, I would try to remove the bigger ones with some roots if they are taking too much space.
If there is enough space for all I would let them be, especially if the tree was in ground...
Now in pot, if you're targeting fruit production and you don't want extra trees ... Then remove them ASAP to let all the sap go to the main trunk.