There are lots of variables, so it's hard to say for sure. In general vegetables grow great under trees, barring excessive shade, etc. I've seen examples where vegetables grow better under trees than out in the open, but this is in established no-till systems. Sounds like you've added lots of organic matter, so there shouldn't be a problem with the soil holding onto moisture. The only question then it's if you get enough rainfall to support the number of plants you're growing. When in doubt, planting things further apart reduces water stress.
Steve Solomon's Gardening When It Counts has some great information on growing vegetables without irrigation.