If I could roll the clock back a few years and again be 33, I'd definitely do a few things differently including getting away from a job I hated.
You say you found land but does that mean you've purchased said land? If so I'd look at building a tiny cabin, purchasing a second hand storage shed or anything that can provide basic comfort and
shelter for a few years while you prepare to built your dream home.
If you don't have land yet, do what you can now to increase your skills and make those skills marketable. While it sounds relatively easy to
sell homemade products for income, when you realize the minimum number of products that you'd need to sell to make a
mortgage payment, it can be a bit overwhelming. Also keep in mind that there will be months where sales drop (typically January - March here).
As horrible as it sounds, you may need to keep the day job a bit longer. We have friends who both quit their jobs because they felt they could support themselves with their candle and
soap business. Long story short, they nearly lost everything, realized that soap wasn't a hot seller and each had to take on additional jobs in the end. They also had a tremendous amount of expenses every month-rent, child support, car payments, food, utilities, etc... if you currently have debt, pay it down as much as possible.
Also when you have your own business, obtaining a loan is much harder when you're barely surviving on that income, which can be erratic at times. Please don't ask me how I know this.
I'm not sure of your location but is there a wild plant society in your area? That might provide you with resources to start giving talks, hosting and/or participating in workshops that will increase/build your knowledge and let people know who you are and your end goal. Locally we have a small herb and wild plant business in which the current owner was an apprentice to the original owner and was able to obtain the business after the founder passed away. She's spent many years giving talks, marketing her products and recently purchased the home next door as her business has outgrown her house. She applies for and has received several grants too.
So while I advise not suddenly taking a big jump, I also don't want you to abandon your dreams. Instead build up your savings, increase your knowledge and marketability and start
scrounging up any building supplies you may need if you have a place to store them. A few free 2×4s or blocks may not seem like much, but that's something less you'll have to buy in the end.
Good luck to you!