Rosemary, hyssop, and to some extent sage are evergreen and I can pick them (sparingly) through winter. The others come back every spring. I'm actually on my fourth rosemary in twelve years, but it's survived for a couple of winters now, unlike its predecessors. I think maybe I had planted them in spots which were too soggy. Did I mention it rains a lot here?