I have very limited experience growing on concrete but I do have a small section of garden atop a 10' x 10' concrete pad. Soil depth varies from 6" to 8". The location gets morning sun with dappled shade the rest of the day. This little area requires a lot more attention than my other garden areas because drainage is compromised, soil is not deep, and it dries out quicker when it's windy. But I have been successful using the spot to produce sweet potato cuttings, taro starts, germinate seeds for transplanting elsewhere (beans, tomatoes, broccoli & cabbage, kale). The lack of
enough sun makes crop growing a challenge although New Zealand spinach likes the location.
I haven't noticed the plants being adversely affected by the concrete directly, other than moisture issues. If it were in full sun, then I'd be concerned about the soil getting too warm.
Perhaps your ground cover did poorly near the concrete wall because the soil became too warm, too alkaline, or too dry due to the proximity of the exposed concrete. Just a thought.