Clay soil is second only to organic matter in the amount of nutrients it holds. It is really good, just a pain to work as it must only be worked, or traveled on when it is at the correct moisture level.
On your exposed site, I would not use raised beds as mentioned before they will dry out so much faster. I would mulch the beds areas with compost and go for it. I would remove the biggest stones out of the way first.