Well, I would take their advice to mean no more phosphate additives. Not chemical, not organic, like bonemeal.
Given what else you’ve given it, you could no doubt at least skip a year, right?
If you are worried about soil structure you could mulch it good. Still P in there, but slow.
P is practically everywhere in North American soils. The best you can do is not go out of your way to add more.