I've been doing a version of this for awhile.
I had a small garden within a small town way up north. Not an ideal situation, lots of shade and it was sloped, the ground filled with basement spoil. Yet I grew a lot of things. A decent percentage of what my family needed.
Now I have almost a full city lot, in a much larger town in a much milder climate. I grow, can grow, lots of things. However, the level of parasitic pests has increased as well. Lots of 'em. My morning and afternoon rituals involve beetle patrols and cat scanning. (Yes, kitty kats, who eat the birds and love a nice prepared bed, or young seedling row to scratch and poop in, sigh.) Spring and fall bring rats. Deer, and raccoons all through the temperate months. All the wilts and blights as well.
Yet I grow a ton, literally and figuratively, of food. Love it.
I grow lots of flowers in with my vegetables, I use lots of containers, floating row covers and have won a kind of peace with the kitties. My morning and afternoon rituals of debugging gives me a kinship with the micro environment, the birds know me and flutter about with no worries around me. I am after all, the cat chaser.
My advice is to start small, and grow into what you feel you can do. Use the environment for what it is. If shady, shade grown cucumbers are nice, and when overripe, almost like melons, sweet. If sunny, giant sweet onions, and huge brandywines will abound.
Leaves are free, compost is free, building soil is the most valuable of hobbies.