I think shale would be okay.
It would be contained within a dug trench, and really it is just a static load that you are putting on top of it. Once the shale shifted and settled in, it would be able to support the static weight of a home I would think. Really the "rubble" is to ensure
water is drained away, and that frost does not play havoc under the structure.
I would think the hardest part would digging a trench down to depth if you have so much of it nearby. That kind of says bedrock is pretty close to the surface of the ground, but sometimes you can shatter the shale
enough a you are digging to make the trench.
I only semi-have shale here. We have what is called shalely-ledge.