It is perfectly possible to grow without external inputs, and it is a creditable thing to try as it avoids stealing fertility from elsewhere, or taking input from possibly more dubious sources. I think you will find that you are unlikely to be able to use the full area for growing crops however. Part of it will be better set aside for growing plants to add fertility either in the form of cover crops (living mulches to protect and feed the soil organisms) or green manures (cut to add biomass to the growing area).
One of the best references I have for this practise is Ian Tollhurst of the UK, who has been growing without animals on a small farm in the UK for a few decades and has developed a system that appears to work well from a biological point of view, although financially less rewarding.
See
This site for some more information. So as well as setting aside 2/7 of the growing area for non food crops - purely to feed the soil. Ian also uses his own hedge trimmings and other woody plants to add to the soil carbon.
Helen Atthowe has a similar set up in Montana using surface mulches, ground cover and hay to continuously feed the soil organisms.