Best Georgia Counties for natural building

Hey y'all! I'm in NW Georgia & I am looking to buy land to farm native plants (edible, non edible) and build a home from natural materials (cob, clay, rammed earth, etc).
For anyone who has traversed the world of natural building in this strict ass, beautiful state of Georgia, what counties did you build in? Or find it easiest to build in? Any tips for zoning, permits, etc?
Or did you go the "ask for forgiveness instead of permission" route?

Thanks! Looking to stay in North Georgia too. I like the hills.

A man after my own heart.  
I am near Ila, NE GA, ag / residential land. We bought the land covered with invasive floral growing right up to the front door, the house itself was free. Wanted a 1920ish house to restore, as it gave a footprint  that was accepted by the county, and have rebuilt using many natural materials.  

For example, some exterior walls were replaced, using rammed earth. From the dirt road view it looks unchanged.  Greywater for trees and flowers, composting toilet, then made a few double glazed windows for the new sun room.  No hired help, just slow paced projects.  
With drones doing the dirty work, municipalities are more observant now. I did most of this 20 years back, so please take my account with a pound of salt.  

Sorry , I can't name any specific county.  But think about my effort, if you don't change the size of the ruin, the authorities might leave you alone.  
All the best sir, let us know where the ouji board leads you.
Rico

Adrien, I forgot to mention the tunnel vision I have seen in North GA concerning septic tanks for rural counties. The county health inspectors seem relentless and employ the 'broken record' techniques.
For new construction of a home even on land zoned agricultural,  some counties require the septic system be fully installed and inspected before the first nail is driven.  
When I showed an inspector and his boss plans from Kimi in NM ( where they were approved for vermiculture waste treatment) and tried to plead my case, they laughed so hard that the building shook.  I was thinking of the adage 'the beatings will continue until morale improves'

Again, it seemed best in my situation to buy an existing house with acreage first.  The septic works fine and is grandfathered in, does not require inspections.
While restoring the house, use all the natural building you can devise without the spotlight, in my opinion.

Hi Rico,

Much depends on the details of the codes …if any. But I agree, I have taken the definition of remodeling to an extreme and stayed within the legal boundaries. In doing so I avoided many legal headaches that would have come with a new build.