Looks like Canadian thistle to me. It's very aggressive. I pull on site. The bottom of the stem is often soft enough for me to touch without becoming holey.
Oh, and how to get rid of them is wear them out by pulling as soon as you see them. People often neglect these because they are tough, but then it just gets worse. I don't do poisons.
Work smarter, not harder.
You're not going crazy. You're going sane in a crazy world. Find comfort in this tiny ad:
Switching from electric heat to a rocket mass heater reduces your carbon footprint as much as parking 7 cars