In
a previous thread ceramic tile was suggested as a permanent barrier. It has a lot of appealing properties: it's inert, not going to corrode, (hopefully) not going to leach anything bad into the soil, nice and strong, and can be collected free from surplus material. I made a raspberry bed using 12" tall tiles (pics in the other
thread) and it has been working great. It sounds like you're looking for something slightly taller. Bigger tiles might be a little harder to source, but they exist. A lot of modern bathrooms and commercial facilities are going with large (18"x36" or something like that?) tiles, so if you could source some discards from a
project like that, you might be in business.
I mentioned in the other thread that something I had been using as a temporary solution was corrugated plastic like what's used in political
yard signs. Plenty of that around to be discarded after an election. I've had a piece in the ground for something like 4 years and it is holding up just fine. A little bit of degradation along the top where it's exposed to the sun, but the stuff under the soil surface seems totally intact.