what is the
water flow like when it rains?
When it is wet and cold the pigs will want some place to stay warm and dry.
When it is hot they will want a cool place out of the sun.
A friend of mine used sand over gravel for good drainage and to provide a place where big hogs can get comfortable.
That is also one reason they like mud, they can cool down but they can also move the wet earth around to make themselves more comfortable.
Every mudhole becomes a custom pig bed. With moist sand they can do the same thing with less mess. Sand over your gravel might provide a well drained environment for hogs to bed in.