Having lots of mass on the inside and insulation on the outside seems damn smart.
But ...
(and, yes, I know that the word "but" negates everything you just said - but it works here!

)
Concrete? Gak! Even a utility shed out of concrete seems lame. And while concrete is pretty cheap, apparently it's eco footprint is pretty damn nasty. And not exactly working with the environment.
And now for the straw bales bashing segment of this post ....
Straw bale is an excellent insulator .... when it is freaky thick. And not packed too tight. And when it is not packed too tight, the fire issues crop up. And around here, there are issues with humidity and your straw bale home turning into a home of disintegrating
compost.
Okay ... all that whining out of the way ...
If you are gonna travel this path, I wonder if you might be able to do something very layered. Maybe ferro cement with a layer of straw and then a layer of plastic and then a thick layer of soil. If the straw decomposes or gets squished so flat that it does nothing for insulation - oh well. You tried.
But even still .... that is starting to sound a lot like an
Oehler structure. And wouldn't an Oehler be easier, cheaper and look way better on the inside?