Hi Amy, here is my anecdotal
experience with apricot trees. My parents live in the high desert too, but I think they are in Zone 5 or 6. They have a free standing apricot tree somewhat close to their house (within 20 feet) in the south facing part of their property, but it almost never fruits because of early frosts.
Their neighbors a few blocks away on the same street also have a free standing apricot, planted a little closer to the house (more like 12 feet maybe), but on the north side of the house. It almost always fruits despite the early frosts.
It's my understanding that it's the extreme temperature change when the sun hits the frosted blossom that kills off the flower; when the flower can gradually warm up/defrost it's more likely to survive and produce fruit. So my parents' tree frosts, gets the rising sun, loses the flowers. The neighbors' tree frosts, warms up gradually in the shade, keeps the flowers.
I can't speak for your particular climate; and mine doesn't have a hot
enough summer for apricots so I have no direct experience, though I do have an almond against a south west facing wall that has been unexpectedly successful (it is a semi-dwarf Dutch cultivar, about 2-3 feet from a cinder block garage wall). It typically flowers in February, though depending on how cold of a winter, has delayed till March before. However, late hard frosts are generally not an issue in my area.