No, no, DO pull them! Pull them and eat them. There is almost no risk that they will get eradicated from your garden, if you have good fertility. If you let them grow on to full size, suddenly you'll find that they are crowding out and shading your vegetables, and by then they get a tap
root that would disturb the veggies if you could pull it, which might not be possible anyway. So do pull them, and do eat them, and don't worry, there will be more next year.