Here they are, the leaves had to fall off than all of a sudden when all hope was lost it GREW LEAVES.YA RIGHT ON!!

You need to use potting mix.

The soil or mud you are using is not going to help you in the long run, not in pots at least.

so what do I do now? What kind do you use? I curently own a bag of perlite and a big bag of compost could I use that?

I would use the perlite and compost. Mix some extra fine pine bark if you can. I would do it now.

In my opinion, the plant is doomed if left in pot with mud. ( Just my opinion )

ok I will do but how musch perlite and compost do you think I should use?

I think I would leave them alone, at this point, if they are starting to show new growth. I agree that a different mix would be good, but I wouldn't want to stress them to much when they are just recovering from the last stress.

If I did repot them, I would soak them well a day or 2 ahead of time, carefully wash off the soil, repot them, and them put them in the shade, with increased humidity, until they once again recover.

To Jon's point.... if these trees can grow in sidewalk cracks, as long as you're seeing new growth, leave them be, and amend the mix as you up-pot.  The fact you're seeing new growth speaks volumes.

I also agree with Rafed... a good potting mix is ideal, I would heed his words for next go-round. 

If it were mine i would let it be this season and wait till it goes dormant then transplant into more suitable potting mix.I did grow in lousy clay-dirt from my yard in container years ago and plants grew and fruited but when it came time to rootprune several years later it was like cutting through cement to accomplish what i wanted.
Never doing that again.  ; )

You're gonna hit a wall eventually, I had a stump in regular ole' soil and it grew some growth then all of a sudden it started to die, I figured it was dead already and I repotted with MG and perlite and the stump recovered and it has more growth than ever.
I would take all the advice these guys gave you and repot them, its going to be worst down the line if they go downhill and waiting to see if they recover again.

Do you plan to keep them in pots or eventually plant them in the ground? If your goal is to get them into the ground I wouldn't worry about the soil, because that's what they'll be living in. But I'd plant them fairly soon. If the goal is to keep them in pots, I can't add anything to what's already been said.

yes i do plan on planting them in the ground, but should i do this now. it would be nice if i could, do you think they are ready?

I'll give my two cents here; others may have different suggestions. Normally, if the figs were planted in a lighter soil mix, you'd probably want to wait until they were better established before putting them in the ground. The risk of doing it at this stage is that you might damage those new roots, and either kill the plants or cause a set-back. However, I've had very good success protecting the roots while transplanting small figs by: