We are a bunch of recyclers and cheapskates, I mean thrifty clever folks, around here, but there are some good points raised here. It might be helpful to sit down and list all the things, good and bad, that would be involved and costs. Family is a big player, how that impacts child care, for example. School too, whether schools are present or you homeschool, that still really effects things in terms of the person homeschooling, who would not be available for other tasks).
Also important is to consider that many things are up in the air in terms of benefit programs. When/if the pandemic passes it's hard to tell what things will look like, but I bet it's safe to say that it won't be the same as before.
(that said, you may be spending most of your income where you are right now on things that would be eliminated if you moved. which is why it's good to put it all on paper and look at it.)