Unfortunately, it could be a problem. Arsenic accumulates in soil, and the total concentration determines the risk.
Some plants do not take up much arsenic, while others take up a great deal.
Here are a couple of sources that look credible to me:
https://ask2.extension.org/kb/faq.php?id=450894
https://plantprobs.net/plant/nutrientImbalances/arsenic.html
I can't see an easy solution. I know there are inexpensive flow-through filters being developed in areas of the Indian subcontinent where natural arsenic levels in well water are dangerously high.
If this was my
land, I would have a soil test done and capture as much rainwater as possible.