What my sister-in-law did when she added gravel to her driveway was to put in something like a
raised bed that would contain the gravel and not let it spill into the
yard. This could be done with round poles as I see in your picture, behind the thistle.
Maybe you only need to put gravel in the annoying areas.
Unless you have a rainy summer, it sounds like you will not need to do anything until sometime before the rainy season.