There can be quite a variation in taste between varieties. I'm only familiar with the Proven Winner Color Choice varieties. They don't require cross polination, but it's said that if they are, then the berries are larger.
Eisbar and Kalinka have unpleasant aftertastes
Sugar Mountain Blue and Balalaika are pretty tasty.
I agree, Blueberries taste better, but honeyberries are more Hardy, fruit earlier, and are more tolerant to more diverse soil conditions.
Cheers