Not too late if you are in a true Zone 8. I may fertilize (lightly) in very early September, as I want trunk growth in my figs and olives, if some top kill happens, it's no big deal.
If you fertilize container plants, that means you may need to up-pot before storing them...sometimes it's OK not to fertilize. Remember to have fun.