Clay is rich in minerals and a good start for a garden. You can get it dark black in one or two years indicating a high humus content with good water holding capacity. Clay with low humus content is water repelling when dried out. Not the ideal choice for a raised bed which needs lots of watering even with a good soil mixture anyway.
Work in
compost, use compost teas and dilluted urine to water the bed. That will speed up the decomposition and the formation of stable humus-clay-complexes. Seed cover crops that doesn't compete with your water thirsty annuals, eg. clover, beans, peas, malva, vicia, phacelia.