I would remove the fruit. If it is just setting, it is not going to ripen in time. Put the energy into vegetative growth. If you want a tree, keep only one stem/branch. If you want a bush form, branching low is good. More compact plants are more easy to manage for winter protection or storage, and the fruit is easier to get to.