A soil test would show what is missing from the soil.
You have expansive clay, which has its own special problems
From
can-fruit-trees-grow-in-clay-soil/
Fruit trees can grow in clay soil as long as it drains well. However, it’s generally best to avoid planting in clay soil due to its poor drainage and alkalinity. Instead, plant fruit trees on 1 to 2-foot mounds of garden soil on top of the ground and add 1-foot of mulch. Expand the mound as the tree grows.
From
Planning to work with clay
Soil scientists agree that clay soils were deposited by water flowing over rock, causing physical weathering.
Clay minerals are actually tiny rocks and crystals that pack together tightly for a nutrient-rich, yet dense soil that doesn't shed water quickly.
The problem with tightly-packed clay soil particles is that most plant roots do best in rich, well-drained, loamy soils that have plenty of air pockets, or macropores.
Their tiny feeder roots need to be able to access oxygen, water and micronutrients through these larger-sized pores.
Many plants will actually drown if planted in heavy clay soil, because it tends to stay waterlogged for a long period of time.