My feeling is it depends what you want the labels for. If it's to buy in more nursery stock of a good variety or propagate plants to
sell, then some form of written labelling is needed, whether labelled on a map, or labelled on or near the plant itself.
If though it's to make sure you propagate the best tasting fruit, the biggest bearer, the one that survived the pests or the frosts or the heat best, purely for your own garden use or to give plants to friends, then maybe the variety name doesn't matter so much. I'd just tie a red string on the fig tree that gave the best tasting fruit, so I know which one to take cuttings from in spring. Plus, sometimes the best plants are the ones that just appear in the garden, self-seeded from who knows where.