I think it's a great idea, for a few reasons.
You mentioned erosion, but I'd put that a couple places down on the list.
You'll want mulch eventually, so this is a great opportunity to grow mulch material on-site. I think the rye itself will grow OK with little or no mulch at the beginning. I understand hedge trimming equipment, if you have any, can be a convenient way to cut moderate-sized patches of cover crop, and that one can often get two or three cuttings over the
course of a cold season.
A second reason would be to begin nurturing a community of soil microbes that are associated with healthy
roots. Rye is good at this, and its roots also benefit the soil in a more mechanical way.
More subtly, perhaps less important than erosion, most people can learn a lot about a particular garden bed by observing how things grow in that exact place. Cover crops will get you an early start on understanding these new beds.
You might consider adding some fava beans and/or vetch to the mix, to start building up nitrogen in the soil.
I'm excited for you!
Stones can be useful for season extension;
Sepp Holzer uses them to grow citrus in the Alps. I don't think they'd be very useful buried within the berm, but they're a common feature on the surface.
"the qualities of these bacteria, like the heat of the sun, electricity, or the qualities of metals, are part of the storehouse of knowledge of all men. They are manifestations of the laws of nature, free to all men and reserved exclusively to none." SCOTUS, Funk Bros. Seed Co. v. Kale Inoculant Co.