I've not had much trouble with deer browse. They will nip at the buds until they realize they aren't a prefered browse so damage can occur.
I've had a lot of trouble with buck rubs. They seem to prefer heartnut
trees over other trees I have for rubbing. They have torn up ever some larger trees I have.
I'm not sure that in a zone 4 you'll have much luck with them producing nuts.
If they do produce nuts they may not be similar in taste/shape or crackabily as the nut they came from.
They don't send down a deep tap
root but the
roots spread out in a star shape fairly close to the surface.
Good luck with your plantings