Gingko Trees

Does anyone have experience growing gingko trees and using the nuts? I'm in the Pacific Northwest. I have very limited exposure to gingko trees. In college there was a gingko whose fruit rotted and made a nasty smell. But I'm told that doesn't happen if you harvest it on time. I know you generally need at least a male and female. If I were to plant them I'd probably plant several.

Any idea about average years to production? I'm willing to plant it regardless to benefit future generations, I'm just curious

Female Ginko trees don't produce fruits until they are 20 years old, just like most pecan trees.

since the main use of the fruits (nuts) is medicinal, you might want to plant 2-3 females to every male, if you are wanting enough for sale or to grow more trees.
The fruits need to be picked just as they start turning color or very soon after that stage.

Could they be used as a staple, or are they too toxic?