Neither are much good.
You need to have a graduation of particle sizes starting with big at the bottom and grading upwards.
The one on the right has some graduation but not a lot.
Clay cracks in part because its expansive sometimes.
Do the snake test by rolling a small amount in the palm of you hand and see if when dried it breaks just on the shelf.
If you rub some between you fingers you want a bit of slime left and feel a bit of fine sand or gravel.
It is rare that soils need to be mixed to create something to build a wall. Usually if you dig around you will find a naturally occurring mix somewhere.
Here are some ideas to help
soil tests
Soil types and testing