For butterflies the other thing to pay attention to is what do the caterpillars eat. If that plant isn't around, then there won't be any of the adults no matter what flowers you have, or only a few that wander in from a distance. Many species eat pretty common things, but there are some that are very specific, such as the pipevine swallowtail on pipevine (Aristolochia), monarchs on milkweed, and zebra swallowtails on pawpaw. Planting these is crucial to supporting populations of butterflies sustainably, particularly in areas where wildlands are uncommon or being degraded. And yes, leave the stuff there through winter and into spring, since many beneficial insects and pollinators overwinter in it, sometimes burrowing into hollow stems to hibernate in shelter. If you need to "clean up" then moving the whole stalks somewhere out of sight and piling them loosely is a good compromise. By the following late spring most things will be hatched out and the stuff can then be broken up for mulch or compost as you like.