I disagree. People bailing out would be the best chance you would have of receiving your trees.
The money you paid is already gone but he still needs to pay for shipping. New orders on the site might help pay for some but if he actually has the trees to ship and people request refunds that they aren't receiving anyway, he can sell their trees for at least double the initial charge and some considerably more on ebay even with his damaged reputation.
I don't think most people have as much issue with the constant delay which is ridiculously long at this point but the fact that he seems to have disappeared and tress may never ship and now he isn't giving refunds either. Supposedly, he was laid up with a broken pinky toe (that still makes me giggle a little) so he had plenty of time to post a 5 min status. The fact that he has gone MIA in my mind suggests that he doesn't plan to ship trees, had another catastrophe like loosing trees in the tunnels during these cold periods or because he couldn't water them with his broken pinky toe (5555), or just plain doesn't give a crap anymore.
A simply "Hey, I haven't forgotten you guys. Here is where I'm at." does wonders. Cheerleaders would be cheering, dissenters would call BS, and others will be like let's see where this goes.