Fruits look like honeyberries. If you look on some sites that
sell honeyberries (One Green World Fruit
Trees), you would at least be able to visually compare your pictures to what they are showing as representative examples. All kinds of critters, yourself included, shoudl be able to eat them. It would be interesting to see if yours are the sweeter type or the more sour type. If I remember correctly, you need a couple of different cultivars for them to pollinate properly and produce fruit. If you have some extra berries that you would be willing to part with, I would be interested in getting some from you.
Also, they say that the honeyberry is generally the first thing to fruit in the spring, even before strawberries. I have not had any to eat, but some people have said that they are a little reminisent of blueberries, but not quite as good. Good for the first fruit of the season, though.