I'm new to beekeeping, but John's post was what I was thinking.
The beekeepers bible has an extensive list of mono crop plants honey bees forage and it list the color, taste and viscosity of honey from those plants. Under orange ( also lemon, limes and grapefruits, ect.) it says "delicious honey, pale and dense with distinct fruit taste and echoes of blossom".
The only other thing I can think of is moisture issues, maybe. Or the type of wood the hive was built out of.