I've been container gardening at my current location for the past six years and each year I seem to add 'just one more' tree. Whenever possible I buy dwarf varieties - or semi-dwarf if that's all that's available. In addition to citrus (lime, mineola, etc) and fig, over the past few years I've added Fuji apple, asian pear as well as cherry (multi-varieties grafted onto a single tree), almond (dwarf 'Garden Prince'), plum, pomegranate and avocado (semi dwarf 'Holiday'). I pot in very large triple fired terra cotta pots or wine barrel halves and have had fairly good luck with all these trees, though several of the newer ones (cherry, pomegranate, avocado) potted up two years ago have grown well but not producing much yet or not at all (avocado). I don't mind using plastic or resin pots for ornamentals; but for food plants, I prefer wine barrels or terra cotta.
Love my fig tree because it's such a reliable producer, pest free (except for birds and squirrels). Surprised how quickly my two year old pomegranate tree has grown. It's a good 8 feet tall now and has started fruiting.
In our dry southwest climate (thus the large wine barrel pots for most of my trees), plants grow quickly; even the avocado tree does well most of the year, but doesn't appreciate those few winter days in the 30s (lost my first 3 year old avocado tree this way). I (aim to) use Dr. Earth's organic fertilizer monthly during the growing season and fish emulsion weekly. If your climate is wetter and cooler, you may want to use smaller pots for fear of drowning small trees planted in large barrels.