Leaves do give and take i.e. consume some nutrients and moisture but provides back through photosynthesis.
Depending on your plant size, if the leaves are shaded then removing them may not be detrimental to the plant growth.
Some people remove some leaves during the ripening period too provide more sun shining on the fruits.