when i was a kid, it seemed like every old auntie we went to visit had a kumquat inside the house. This was in a climate similar to yours- NY/NJ area. They were not bonsai, they were just small bushes kept in pots maybe the size of one of those home depot buckets, maybe a bit larger? small enough to move outside in the summer, large enough that it required help.
the kumquats all gave huge amounts of fruit and i always used to delight in stealing some (the adults knew, of
course, and were thrilled to watch me eat the fruit, which for a kid was inevitably disappointing. Now that I'm older i love to eat them, but back then it was not the taste treat I expected....).
I have grown both kumquats and lemons in pots now, they do seem to be quite hardy until they get some sort of disease (greening, white fly) or I get a new puppy who decides to eat them.
In my experience, bonsai fruit take ages and ages, and really just give a showcase fruit or two, not enough to consider actually enough to eat.
This is my current kumquat, recovering from my shepherd pup attacking it about a year ago. Ooops. I
should really just start again but it is so tenacious I feel like it's a shame not to let it come back. The dog ate it down to that stub in the middle.