Pretty good guess, Paul. As was stated in the thread of this question, dirt has an R-value of approx. 0.25/inch, so it's not the best of insulators. Keep in mind tho that the R value can be expressed as the coefficient of heat transfer or conductivity - U value (or British Thermal Unit - what we call BTU's). This an inverse proportion of R value; that is U=1/R. So one inch of dirt with an R value of 0.25 has a U value of 4.
As was also stated later in the same thread, This ability to absorb energy and slowly re-radiate it is best utilized in an earthen wall of at least 12 inches thick. This by itself works fine in temperate climates, but where in the world do temperate climates occur? Of course there are some places like that, but most of North America is not exactly temperate. Most places have huge temperature swings seasonally. Even where I live summers are generally over 100 degrees F, while winter temps drop below zero. Certainly burying or berming the structure can create a more temperate climate as the earth's temp is relatively stable below a certain depth - once again depending where you live.
There are no hard and fast rules about how a massive building built with dirt will perform. Just like permaculture, the first rule with building design is
observation over a period of time.
But I know, you're all in a hurry and need answers now. If you can't wait to watch and learn, you may want to explore ways to add a degree of insulation to your dirtbag structure and there are as many ways as there are opinions. I've done dirt mixes with 50% pumice stones added to it that gave a degree of insulation, but it decreased it's R value. Remember the inverse proportion? It works both ways.
If you want to have the best of both, R and U values, you can wrap your EB building with an insulative layer of your choice. We explore some options in Earthbag Building, but there are many more that could be (and probably have been) tried. Our only limitation is our imaginations.
This was a long-winded answer to a very short, succinct question. I'll try to be less wordy in the future, but no promises.