Fruit trees and plants that produce fruit(tomatoes, peppers, etc.) can be grown in lead contaminated soil. There is a membrane that prevents lead from getting in to the fruit. One caveat, the tree/plant itself should be considered toxic waste. Lead will also "sink down" in the soil over time(a very long time). It really depends what chemical(s) you're dealing with and what plants you want to grow.
As far as colored cardboard/paper goes, earth worms don't seem to be bothered by it(or can reproduce fast enough where I don't see an appreciable drop in population). I'd have to dig up parts of my garden in about a year to see if there is any microbial activity on the colored paper versus regular cardboard though. I recently reorientated my veg beds to take advantage of a contours, and all I found underneath were some plastic envelope windows and some tape that I failed to remove from a cardboard box that I used. This was only 8 months after I had put it all in at about 2" thick(which is why I moved up to 3" thick). I would assume from the observation that colored printed newspaper and glossy junk mail/catalogs/etc are indeed edible by microorganisms and that they keep a sufficient population to continue breaking it all down(just not plastic, but we already knew that). Since matter is neither created, nor destroyed(only changed), we can infer that any chemicals had to go somewhere unless they were changed by being consumed which is probably(not definitely) the case.
But I guess the big question is, was my food toxic? That I can't tell you unfortunately. Even in 20 years time, it might not have been toxic food that caused my death or whatnot. But I think the bigger question would be is it better to throw all of this stuff in a toxic dump or to release it in smaller amounts back in to the environment. I prefer the latter for absolutely no scientific reasoning other than lower p.p.b. are usually less deadly than higher concentrations.
As Mr. Watson said, "I think a lot of the time, people underestimate Mother Nature and/or overestimate the power of chemicals to move through soil."
Here's an
article about vermiremediation of contaminated soil to lend credence to that quote.