Your temps seem very cool for this time of year and your zone, I'm sure things will warm up enough for your figs. Looking at your tree I don't think you have enough top growth to support any figs. Hard as it may be I think you should remove this fig and not let any others form this season. Your tree needs to beef up some more to support fig development. if you let figs grow on it without enough leaves to support it you can weaken your tree, maybe even lose it. Pulling the fig off will cause the tree to redirect energy to leaf and stem growth. You might also think about pinching just the growing tip to stimulate more branches