My Goumi flowers, but isn't producing any fruit

My Goumi (Elaeagnus multiflora) has been growing for over 5 years, has bloomed profusely the last 2 years for sure, but I don't even see fruit forming, let alone get any ripe fruit.

Any idea what its problem might be? It lives in between two rhubarb plants which are steadily getting happier. PFAF claims it's hermaphrodite, which is what I would have thought also.

Ideas anyone?

Hello Jay.  I had one Goumi to start for several years and it did bloom fruitlessly.  After I added several more the first fruited and now I have two varieties.  I’ve noticed even hermaphroditic plants of same variety usually require pairs. Excellent bushes, full sun drought tolerant though water helps fruit early in June through July here in Puget Sound.   Scion roots well with hormone in many PNW soils and are 5$/per Burnt Ridge Nursery in Onalaska, Wa.  A bit of spring MgSO4 Epsom salt works wonders with a compost as water solvable chemicals leach totally out here West of the Cascades.  Lastly, this was where the snake tree tradition started on our farm as the birds love Goumi berries and may also be taking the few berries before ripe.  I have seen this, a real rarity as it’s just a pit to start with yet contains many truly magical bioflavonoids.  2-3 rubber snakes in the branches kept the birds from eating most of them before harvest otherwise, none.  Goumi berry, lingonberry, wild black berry jam is my favorite fruit preserve, absolute delicacy.  The bushes make excellent hedge row V shaped and thorns a cornerstone species of my food forest design.
Good  luck and Cheers.