Is there a road in to it? You need to price that in. You can find out from the electric company how much it will cost to run electricity out there. Ditto a septic tank - find the company that will install it and get an estimate. If there's a well or other water available, have it tested. You would be amazed - we installed $5,000 worth of water filtration to remove all sorts of unlikely things, including radiation! (Granite in Vermont often has little bits of radium in it - who knew?)
Is it close enough to where you work for you to continue your day job? You described it as "the middle of nowhere;" you'll need income to pay for it all (shelter, seeds, equipment, tree seedlings, and all the rest). Will you build your own shelter? Off-grid? Solar? Talk to the zoning administrator in the town to find out what sort of shelter will be required. Check zoning laws for whether livestock is allowed.
Is there any forest on the land? Harvesting wood can be helpful for building and heating. You mention avocados and lemons, so perhaps it's warm year-round. Find out the history of the land - make sure it wasn't someone's hazardous waste dump or something.
Start reading about farming! Try Joel Salatin - his books are well respected and give you an idea about what needs to be done, and what is possible.
Best of luck! When you need more specific advice, include your geographic area (USDA zone in the US, or state, no need to be super-specific).