We had a big black walnut tree that was close
enough to a pond that nuts and leaves ended up in the pond. Everything seemed to grow just fine.
There have been reports of fish kills in streams and ponds in England when large numbers of horse chestnut shed nuts and leaves into the water. Saponins are the culprit. Naturally occurring
soap, just as is found in soap nuts, soap berries and clematis.