If it will make you feel any better, my containerized trees start to look ratty, and spent, by late August, and look terrible, yellow-spotted and rusty, by mid-Sept. I don't panic because dormancy soon follows in October, and all the leaves fall off.
The first time this happened, back in 2007, I thought I killed my trees. I never grew fig trees before, and couldn't understand why things went so wrong so fast. The fig-forum members set me straight.
Your trees will be fine. Relax. : ))))))
Frank