My recommendation is to keep cooking with it, but focus on your cleanup. I have a suspicion that you might be getting carbon flakes, not seasoning flakes.
Do you use a metal spatula at all? I found that has helped my cast iron egg pan become the best it has ever been.
I also have recently received a chainmail scrubber for my cast iron and it works amazingly on my pans, especially when things get accidently burnt.
Focus less on the visual appearance of your cast iron being photogenically black and even and look towards if your food is sticking. My egg pan doesn't look 'sexy' but it works incredibly. A true heirloom from my grandmother.
