Archeological investigations have discovered that some people did double wattle and daub with a layer of insulating grass in between. They built an exterior and interior wattle wall, stuffed grass down in between the wattle walls, and then daubed both sides. You could use any insulating material.
https://exarc.net/issue-2016-3/ea/energy-saving-house-3400-years-ago