You might consider neutering your goat. I have goats and it's near impossible to keep them from breeding. They somehow ALWAYS get together - they ram through gates and fences. They pee on their face and legs. He will get bigger and stronger and smellier and when he's in rut in the fall......he will be very loud screaming "rut, rut, rut...." until the females are pregnant. Horns have nothing to do with the smell. I like horns, as they give you something to grab onto. Are the kids male or female? Neuter them young. They can get their mom pregnant at a very young age. Let me know if you need to know how to neuter. We use a "emasculator tool". It is quick and the most humane way and they get to keep their "trophy sack".
My best advice - borrow a billy when you need servicing!!!