Hi Anziana. Others with more experience may have other suggestions, but seeing none so far, here are a few considerations.
Figs often have 2 crops, the earlier "breba" crop and then the later main crop. Most of our brebas fall off, but if that is the case with your fig, you should be seeing a second main crop now. The breba figlets come much earlier.
Also, given the rapid growth, it could be that your plant is focusing on vegetation and dropping the fruit. The fig is likely getting too big too quick. And nobody needs a 20+ foot fig. I would suggest pinching of the growing tips to encourage more bushy growth and greater energy into fruit.
And when all else fails, there's always next year. Most problem in plants and animals are self-limiting and correcting. And for those that aren't, there's always replanting. Gardening isn't like parachuting. If something goes wrong you get to try again.
Best wishes.
John
North Georgia Piedmont
Zone 7b