Whatever you did before, don't do it that way again.
Potatoes are a crop that can grow in poor soil, but you
should expect poor results. I'm a couple hours north of you in Lake
City. The soil here is sand.
Compost goes in by the
yard only to be consumed within months due to the heat and humidity. All those nutrients wash through the sand leaving me to recondition the soil with every crop.
This spring and summer I was in NY, put in 600 plants, 12 cultivars, lost all of them over about 10 days to Late Blight. The plants were laid waste-black on the ground. What tubers I managed to harvest after 6 weeks, about 200# from 4 cultivars planted early turned into mushy goo in a couple of weeks. Talk about disappointment!
Down here I've put potatoes in, gotten some good results sometimes, gotten nothing sometimes. The best results have always come form more attention. Work the soil as deep as you can, adding copious amounts of compost. Keep hilling and mulching the plants. Soil, leaves, compost, grass clippings, whatever is available. I've had the hills 2 feet high with the spud started 6" below grade. Keep the moisture up.
Drip lines work well if you can keep moving the drip tips as you build the hill. NEVER lime your potato. They'll do better in acidic soil. If you have limed an area in the last couple of years, plant your potato elsewhere.
Try different techniques until you find one that works for you. Plant them above ground in tires. Try some planted in nothing but compost. Try different cultivars, there is plenty of variety to choose from. Ask the old timey locals what they do.
Fence off the area for a couple of months before planting, put some
chickens in there, might help with the ant problem. Spread some grits or instant mashed potato around to knock out the ants. Try growing the things in containers. Plant your spuds over several weeks rather than all at once. Try sweet potato. If floating row covers help your neighbors, use them. If you use fertilizer, change the way you use it.
If you use the same methods as the last couple of years, you should expect the same results.