I'm thinking either earth bag or straw bale would be good candidates for your conditions. Straw bale may need to be up off the ground a bit on rubble or a foundation to keep it from wicking. Either needs to be protected from the elements and the livestock with
cob or plaster or something. And that surface coating needs to be protected from rain by good overhangs and splash back protection. I'm guessing earth bag is more work and weight to move around.