>would I have to remove the existing "greenery" before planting the cover?
Not necessarily. Different methods, or even a succession of cover crops, can do different things at different seasons.
How does this sound:
Initial cover seeds are sown, and as they are just sprouting, the yard is scalped. An initial, tall crop is cut and left as mulch. A
canopy re-forms from a second growth of the cover crop, working with the mulch to shade any pre-existing vegetation almost completely. It might need cutting at that same height if it blooms again.
As that stage of cover crop loses vigor, and the original residue begins to rot away, nurse plants are established which will offer dappled shade, helping to give the desired turf grass an edge over any weeds that persist, but with the intent of allowing enough space that grass can become established. The yard is cut down to a few inches (and removed) when nurse plants are a couple inches tall, but growing fast.
Turf grass is seeded at the normal time of year, but maybe a little less densely than usual. Other sowing dates are timed around this event. Maybe the nurse crop goes in along with the grass seed, maybe slightly before or after, depending on how the two will interact. The nurse crop, or some species from it, might be allowed to re-grow once or twice, with a transition to frequent 4" mowing as the turf gains on the nurse plants. As mowing becomes frequent enough, the cuttings will be short enough that they can be left in place again.
Any plant that has survived all this, would likely also have thrived after tilling & compost application. If you notice any particularly stubborn species during this process, I imagine that hand methods will do more to stop it than if full sun, frequent
irrigation & surface-applied fertilizer were available.
Details of climate & soil would help you to choose plant(s) for a scheme like this, and you might have to compromise a lot from the ideal I've described, but if the short-term appearance of the yard isn't important, I think it's a goal worth shooting for.