Best Georgia Counties for natural building

Hey y'all! I'm in NW Georgia & I am looking to buy land to farm native plants (edible, non edible) and build a home from natural materials (cob, clay, rammed earth, etc).
For anyone who has traversed the world of natural building in this strict ass, beautiful state of Georgia, what counties did you build in? Or find it easiest to build in? Any tips for zoning, permits, etc?
Or did you go the "ask for forgiveness instead of permission" route?

Thanks! Looking to stay in North Georgia too. I like the hills.

A man after my own heart.  
I am near Ila, NE GA, ag / residential land. We bought the land covered with invasive floral growing right up to the front door, the house itself was free. Wanted a 1920ish house to restore, as it gave a footprint  that was accepted by the county, and have rebuilt using many natural materials.  

For example, some exterior walls were replaced, using rammed earth. From the dirt road view it looks unchanged.  Greywater for trees and flowers, composting toilet, then made a few double glazed windows for the new sun room.  No hired help, just slow paced projects.  
With drones doing the dirty work, municipalities are more observant now. I did most of this 20 years back, so please take my account with a pound of salt.  

Sorry , I can't name any specific county.  But think about my effort, if you don't change the size of the ruin, the authorities might leave you alone.  
All the best sir, let us know where the ouji board leads you.
Rico