Hello R Scott,
Well I'd rather move compost from a bin than remove soil - it seems easier to me and surely less disturbing to soil and plant life... the garden is full of plants : melissa, rhubarb, raspberry, redcurrant, roses, ferns and as the season advances, I will surely discover new plants.
We also plan to dig into the garden to put a water tank but that is another project...