Andrew, I hope you can find some way to make that dream come true. I don't have any leads for you in terms of a lender for your need, but there may be some contacts and links through these websites that may be of use. Hope you can find a path to success on your land.
http://blogs.usda.gov/tag/veterans/
https://newfarmers.usda.gov/veterans
Edited to add: Andrew, I would encourage you if you are inclined and if the opportunity presents itself to go visit that land but really try to see if you can arrange that visit with the owner as opposed to just the real estate agent. I've heard more and more of a surprising number of land/property sales where the owner, upon meeting a prospective buyer, substantially reduced the price of the property in order to "match" their property with a good future owner. It may even turn out that by meeting with the owner, they would agree to divide the property, creating a sub-parcel that may be acceptable to you and at a more affordable price. Worth looking into.....