I have designed concrete mixes in the past as a Civil Engineer.
There are a few points that need clarification.
'Cement quarry rocks' are really aggregate, [ stones], crushed usually from basalt outcrops, that become the aggregate or stones in a concrete mix.
Similar aggregate is used as the base for roads, in different sizes big ones at the bottom and smaller at the top, it is used as filling under concrete slabs
and anywhere are hard wearing non soluble material is required.
In fact in Australia, the dust from crushing plants is sold as Rock Dust and has many minerals which are claimed to be very good for the soil.
Cement is an additive to concrete, not the name of the final product.
Concrete is made from a mixture of Aggregate, sand and cement.
By varying the size and type of those items different strengths can be achieved. Generally the high strength concretes have more cement.
Cements themselves can vary and again have different results for different outcomes.
Admixtures are additional items put in the mix to slow down curing, speed up curing depending on the weather, some make it waterproof,
others, with different aggregate sizes make it flow better when being put inside hollow blocks.
Here Fly Ash has been banned, it creates problems for concretors, people wholly the concrete, and has caused issues with the concrete not gaining its full strength.
Concrete dust is as bad for humans as any other dust and care needs to be taken when grinding or cutting it.
Used properly it is a product that has enabled the type of structures people expect to have in communities today.
The use of lime with it changes its characteristics and many people like the benefit of it. For instance Limecrete is fantastic for exterior patio floors,
because it does not reflect heat the same way a concrete slabs does in hot climates.
I hope this helps with your understanding of the variations and the uses of concrete.
to label it as bad is something many would dispute.