The first step to being really dry is to get your self up on a mound, especially if you can get nice porous soil under you, lots of gravel and sand. If you want to build with
local materials I cannot help you, but if you are willing to haul in some fairly inexpensive materials I would look into Ecodomes from the Monolithic Dome institute, they are looking into was in inexpensively insulate them. If you build out of mud (or
cob would be a better choice, clay sand and
straw) then you need to have a good waterproof roof on the structure to make sure no
water gets in to wash away your walls.
Goodluck.