It seems like there's a lot of negativity in a good number of replies, and that's too bad.
You can live the way you want to live. Just try to keep an open mind to options that may be easy to pass over or dismiss at first. Leave them on the table, and chew on them a while, even if they taste bad to you right now.
Any solution will take some amount of time. Building a life takes some labor and time, just like building a house. But you can build it the way you want. My advice is to carefully weigh and consider those things which you are willing to do in order to get to the place where you want to be. Are you willing to move to a place where land is cheaper? Are you willing to take on a partner in a permaculture venture with whom to share financial responsibilities? Are you willing to keep doing what you're doing to buy land?
You have as many options as you're willing to entertain. Only forget about the ones that you simply can't accept and try not to be skeptical about the unknown.
