How do you keep Yellow Jackets from using holes?

I have a split apart block for my bees. There seems to be at least one yellow jacket that has adopted this as its place of resting at night. Is there any way to stop this? I also wonder if they prey on the mason bees?

Yellow jackets are paper wasps . At this time of the year the queen is busy building a colony which by end of summer may number in the thousands . Spaces between rocks , logs , walls , rolled up carpets {trust me on this one} are used for building sites . They become more agressive as their population increases . When it comes to close neighbors they don't play well with others .