Are you sure they're not native? I was under the impression that they were in all of SE Australia except for Tasmania. It's pretty common on this side of the ditch and we've got a few on our land.
My
experience with kanuka is that it's an opportunist and coloniser. Like its more famous cousin manuka, it takes over dry and scrubby locations and holds erodible soils together. As soon as something taller and more durable gets established and overtops it, it's pretty much gone. But we don't have fire as a part of our landscape except in rare circumstances here, so kanuka fills a niche and then gracefully gets out of the way.
If you really want/need it gone, I'd say cut it for fuelwood (it's one of the best out there) or
biochar. Remember that much of the bush in your region is built to burn periodically and as a
permie you find ways to manage around the characteristics of the place. Why use poison if a chainsaw will give you the same product?