Yes, most oak species don't make crops of acorns every year (or at least don't make large crops every year). The reason you gave is generally accepted, but sometimes debated. There are many species of oak here that have so much tannin in them I think it's quite impractical to leach them. So start with an oak that is generally low tannin, and that helps.
Acorns do not have gluten, no, but they have a gluten like property to them that allows the acorn flour to stick together quite nicely. However, this property only remains after they have been cold leached (as opposed to hot). I also think hot leaching, although faster, reduces flavor as well.
About acorn flavor, it's flour. No one thinks that flour mixed with
water taste good, but billions of people love bread. Acorns
should be thought of the same way. I think the flour is much richer and full bodied than even whole wheat flour, and I very much enjoy it.