Small rocks would probably work in the swale. I know part of the reason gravel and compressed granite paths are so popular is that they allow water to infiltrate. One of the reasons the chips works so well is that the space between chips can fill with water nearly as fast as empty air. If you fill in the air space with solid objects, there isn't anywhere for the water to flow.
When I say tree trimmers, usually I see people hiring work done in their yards. It's one of the advantages of being in a
city environment. If you're not near any cities, I think most power companies are on a three year trimming schedule.
I wouldn't give up on using the rocks for small retaining walls, look up gabion cages. The smaller your walls the easier it would be to jerry rig a cheap version. I think it could be as simple as laying a roll of
chicken wire where you want a wall and stacking rocks on top. Roll the wire up around the rocks and stake it in place. Around here I think the legal limit is three feet before we need a permit for a wall.
On the other hand, maybe you can plant the lower side of the hill with perennials to secure the soil. Use that area for insectaries, nitrogen fixers, herbs,
perennial vegetables, small fruit shrubs, vines that are trained from the other side. I'm a big fan of always growing flowers so there always something around to feed the
local pollinators, and many perennial flowers are essential to this. If you're only disturbing the soil on the uphill side, then it would have to wash up and over the berm before it could wash down the hill.