I also had the dream of having an orchard more than 40 years ago when I saw one, and said, "Wow". They get great fruit all year for free!
Now I have had one for about 20 years.
S Bengi has a good point-grow them in the sun, not too close to another tree. Are you checking soil and drainage?
Fruit are generally considered easier to grow in the summer-dry West than in the summer rain and humidity East. Vegetables would be easier, I think.
I would start with fruit that would be easier for you back there. I think American persimmons and pawpaws are both
native. Do you like them? THey
should be easy to grow there. What about beach plums?
What about American red mulberry? Illinois Everbearing might be a good variety.
In Maryland, you might even be able to grow Asian persimmons, probably the most popular fruit in the world.
Stone fruit are said to be quite difficult back East.
Montmorency pie cherries are about the easiest and most productive stone fruit, and squirrels and birds don't eat all of them.
Sweet cherries are great to grow-if you want to
feed birds on a 50 foot tree.
Pears often get diseases in that climate.
What about melons?
John S
PDX OR