Welcome to Permies, D!
Even though we are in a warmer climate, the heating load in the winter can be two or three times the cooling requirement in the summer. I have a house that was built with absolutely no
solar design, active or passive, and I don't use a whole lot of
energy for space heating and cooling, so even some modest passive elements are going to help you out.
If you have lots of shade
trees on the WNW of the house, that will keep down the A/C load in the summer, and south facing windows will help a lot in the winter. Don't forget the porch in front of the south facing windows, that is the one bit of design that I have that actually is passive solar (although I'm sure it's coincidence, not intentional).
One thing that I would suggest is to work some evaporative cooling into your design. Although we can't have "swamp coolers" like they do out in the much drier west, remember that each gallon of
water evaporating off your roof is 8000 BTUs less of demand on your A/C system. I go out two or three times a day during the hottest part of the summer to spray the roof. If I get motivated
enough, I might automate this, like having sprinklers on the crest of the roof, and every two hours they are on a timer and spray a couple of gallons.
As for heating in the winter, what you can't get from solar gain through south facing windows, I'm sure you could make up with a small
rocket mass heater.