My Kathleen's Black fig tree is in its second year. This is the first year that it is producing figs. Three days ago, I noticed that some of my breba figs are turning yellow (picture below). I felt it and it is still hard like a normal unripe fig. Anyone know what might be wrong? Should I remove the yellow figs or leave it? 

 

I removed some like this from my fig trees... I thought they were going to die.. I am following this to know.

In a few days you will be able to just tap it with you finger and it will fall right off. When they turn yellow the majority of the time they are being aborted. I have a had one or two times where they greened up and stayed but usually it's curtains for the yellow ones.

I guess I will remove them then so the tree can focus its energy on growth and the rest of the healthy figs.
Does anyone know what the cause may be?