Our permies expert was Mike Oehler's his underground greenhouse book is worth a look.
https://permies.com/wiki/23444/Earth-Sheltered-Solar-Greenhouse-Book
Mike is where Paul got the 3 layers of poly earth roof used in the wofati. From what Ive found on line dry dirt insulates very well. Using 3 layers of normal construction poly that all slopes away from the building gives a large chance of dry dirt around the building. Paul has brain-stormed natral waterproofing. The most likly is a 6" layer of clay. It would need to be a multi level reduntant system. Somthing like 2" of clay plaster directly on the wall and roof, 12" of sand/dirt on the roof plus walls bermed to 45° and then 6" of clay, plus 18" soil. I dont think anyone has confirmed it works. Plastic works and is much easier to spread.
Researching portland cement the problem is it wicks water. Your walls would be wet and that lowers the insulation effect. But it is strong even wet so it is the safe answer. Another safe answer is an 18" thick wall above ground with large roof overhangs. In zone 4 i don't think it will work, in your zone 7 it should be fine.
I have a been planing an underground greenhouse and ramed earth sounds like the wall I will use. Stablized with type-K quick lime and protected by a 3 layer plastic earth roof Mike Oehler style. Everyone says dont bury a ramed earth wall but if Mike can bury pine logs and not rot for 50 years, i dont see why i cant have dry walls with stablized ramed earth. Plan is two 12'x12' rooms to suport the back wall in the center with an interior wall, flying butress.
I'm @ 43° North and planning on building something like this next summer. Without glass in the roof it will not have full sun in summer, but I'm gardening outside then.