It may pain you to remove what may easily be the majority of the fruit on the tree, but the payoff is worth it, for you and your deciduous fruit trees.