I am using onions, shallots, garlic, and sweet potato vine to make borders in some places. I also use non edible support species like bulb flowers, Liriope grasses, and a few different species of spiderwort.
I have seen lavender used as a great border too. I bet chives would look neat as well, especially when flowering.
Try 100 things. 2 will work out, but you will never know in advance which 2. This tiny ad might be one: