Tyler:If you grow in pots,That is the reason,they missed something:mineral ,nutrients,Pot too hot,etc.
If you grow in ground,then it only drops because of ,too cold climatic conditions,in the affected year.
Celeste drops here every year but it is because it is not fully self fertile but Mount Etna type fig,should not drop.