Since I've never considered toxic stuff to be an option it would never be an 'either/or' situation for me...and by having it off the table altogether we don't have to think of it as a 'last resort'
I think I would start with identifying that sprout and then probably cut low to the ground and only dig it out where I intended to plant the fruit trees.
So much would depend on what it is.
That looks like a lovely spot along a railroad...is it still used? could it be that they use some kind of chemicals on the railroad right of way? Is that a walking path next to it?
Is it possible that last owner planted those deliberately for some reason as someone else mentioned above? to prevent chemical drift?
The saplings look large now, but once cut maybe the newly sprouted ones would be maintainable with a good scythe blade and over time that should kill most stemy sprouts.
It looks like it might be too rough to mow with a push mower but if it was smooth enough that would work too...we've kept things at bay by just cutting to the ground and keeping the area mowed.