Gypsum is a type of calcium sulfate. It is well known for loosening clay soils. It also adds calcium to the soil without much impact on soil pH (unlike lime). And almost all soils need a calcium
boost considering it is needed in larger amounts than any other mineral and can be relatively easily leached from the root zone. I used a big bag of greensand when I planted out my orchard there but don't know if it played a big role in their success (it is a good source of potassium, iron and trace minerals). I'm not sure how those soils rate for potassium status, but compost is an excellent source of potassium and I think there are cheaper sources of trace minerals (azomite, basalt rock dust, kelp meal). If you wanna get really serious about your soil, read Steve Solomon's
The Intelligent Gardener and get a $25 soil test done and amend with what is truly needed.
I always gardened in anthropogenic native soils. That is the native soil amended with various degrees of decomposed locally found organic matter (basically compost and "native mulch" or ramial woodchips) with some gypsum and kelp meal or azomite. I cannot understate the importance of sun for annual vegetables, even in the long, sultry conditions of Houston. I leafy greens are best adapted to up to 50-70% shade, but in my experience, annual vegetables and most fruit trees thrive much better 8+ hrs/day of full sun. We had a pomegranates and figs in our yard growing up and they produced spectacularly until they both got overshadowed by chinese tallow trees after which they begrudgingly produced a few ripe fruit a year. Its almost impossible to beat fresh ripe figs. Pomegranates I just cut in half and squeezed-juiced right into my mouth, one after the other.
I didn't grow Pawpaws when I lived there but they should do okay in 50+% shade (particularly afternoon shade). They do take several years to start producing. One thing to keep in mind is your chilling hrs. This greatly impacts what varieties of most fruits will do well in your location - generally the further N and W from the coast, the more chilling hours. More chilling hours give you quite a bit more latitude in selecting varieties. Most Pawpaws for example are northern selections and may not produce well so you may need to look from selections from TX, LA and FL of which there are a few. Elderberries can take a fair amount of shade too. Citrus can handle maybe up to 50% shade and still produce okay, but more productive with more sun. Keep in mind the shade from larger trees may help get your fruit trees established but production will be seriously hampered without opening it up to some more sun.
As for blackberries, Navajo and Arapahoe are good selections but need around 400 chill hrs I think. You can probably find some recommendations with chilling hour requirements on A&Ms websites or via google search. Also worth considering are asian pears (particularly fireblight-resistant vars), low-chill peaches (who can resist a ripe peach), also if you have a protected micro-climate (sunny south side of the house) you can grow dwarf bananas or papayas (amazingly delicious when homegrown) and things like ginger and tumeric beneath them. Southern highbush or Rabbiteye blueberries (with some modest amending of soil), muscadine grapes, feijoas (pineapple guava), asian plums, loquats and of
course pecans (Moreland and Pawnee in particular) all do quite well. You have a wide plant palate to choose from and all those perennials, once established, should get by on little to no irrigation if you've improved and mulched your soils and provided at least minor water-harvesting earthworks (even just mulch-filled basins around the dripline). And you can easily harvest enough irrigation water for your annual gardens from roof runoff.
That was long. Hope I'm not overloading you. Your area has its challenges, but the long, year-round growing season and large perennial plant palette including lots of subtropicals and lower-chill temperate fruits really makes it rewarding. Build on your successes and in a couple years maybe you can convince the hubby to let you take down a shade tree to build on your garden if that makes sense. Get connected with Urban Harvest folks and you'll meet lots of passionate gardeners with experience and cuttings to help you along. Speaking of which, I have a small orchard at my parents place in Dickinson and would happily share cuttings of 3 varieties of fig, 'Pakistan' mulberry, 2 varieties of pomegranate, some citrus, and scionwood of a few other things. BTW, you should take a grafting class - it is much fun and opens a world of fruity possibilities on the cheap.
Cheers!