I wonder if it isn't best starting with things that you know that you or your family or your livestock or wildlife will be able to take advantage of as food and/or
shelter, fuel, etc..and then go from there.
i know that you are trying to get your farm established..and you are doing best right now by getting your shelter settled around..
I would take each member of your family and make a list of what their preferences are for food and for crafts..etc..and also a list if items that you think you might be willing to grow for sale or livestock or whatever..
then of your lists..find out what things grow well in your area and aren't super cheap to buy in the store..or are much tastier grown at home..like say tomatoes here taste a lot better than store bought.