I'm not sure cob would stand up in the rain on its own, and I think plant
roots might find their way into it. I also think worms might burrow through it. Perhaps if you whitewashed it on all sides, those problems would be less pronounced (whitewash reacts with clay to form Roman cement).
Holding the rocks together with lime mortar might be more appropriate.
There might also be a species of ground-cover plant that will do well in the spaces between stones, but not so well in soil. Some varieties of medic might be worth looking into, perhaps.
"the qualities of these bacteria, like the heat of the sun, electricity, or the qualities of metals, are part of the storehouse of knowledge of all men. They are manifestations of the laws of nature, free to all men and reserved exclusively to none." SCOTUS, Funk Bros. Seed Co. v. Kale Inoculant Co.