Good luck with your new fig tree.
IIRC, the fruit may get more flavorful as the tree matures over a couple of years. Is that right? If so, you shouldn't judge the quality of the tree until it's gone through a few seasons.
I think it's always worthwhile to give a plant a chance. Aside from some garden space, what do you have to lose?
Good luck!
Jess