It's interesting how the same plant can be well behaved in one place and be a nuisance in another. Goji berry bushes are welcomed in my garden, pollinators and birds like them. I even plant cuttings to form an edible hedge but it takes lots of amendments to creat the soil type they like. If they get too big and messy, I just cut them down to the ground in winter. Long arching branches can be trellised or pruned to reduce layering.
Osage oranges are sporadic where I am and they are tall trees with thick trunks, sometimes even as a specimen tree in the yard. I tried to grow a hedge along my property line with hundreds of seeds with zero germination.
Invasives such as Japanese honeysuckle, burning bush and multiflora rose are my worst enemies.