I am sure you checked the ground, but young Che very often drop immature fruit. Mine is just breaking bud now, and will not have ripe fruit until close to frost. I can't imagine what would eat them at such an early stage, how long ago did it flower? The flower itself looks like a starting fruit, just like a mulberry, but they can fall apart fade and you will not see much of anything. Is it possible you just had the flower that faded? If they looked like the pic that is still a flower and could easily just fall apart.