There's a lot of lone-wolf doomers out there, but for an outstanding introduction to basic principles, I can't recommend Fieldcraft Survival enough. Mike Glover's concept about The Pillars of Preparedness is just awesome to break things down.
So, if you look at the three pillars and the foundation, it seems to me that most survivalists start with the idea of being well prepared in an EDC sense, and then build up towards mobility (especially the "bug-out" subset) or homesteading (especially the "bug-in" subset), depending on where they live. Most city dwellers end up realising that homesteading is the superior option, and then working towards that. And then they hopefully realise that they really need a community to have a chance of pulling it off.
Now, I don't have much experience with permaculture or the community just yet, but it seems to me that the ultimate goals of both groups are the same, it's just that the permies will start from the other end. Community support for ideas/workshops/experience, then hopefully your own homestead, then being able to go and help out others (mobility), and then ... maybe EDC?
I've yet to see any prominent permie talk about EDC, but likewise in the prepper sphere, not many people talk about communites and how to build them, which seems to confirm my theory about both eating the same pie from different ends.
What's the differentiating factor? Probably something in the mindset. In general, it seems to me that most preppers want the government out of their lives to be able to own anything they like (firearms, radios, etc), and most permies want the government out of their lives to build anything they like (wofatis, rocket mass heaters, etc). So, the differences just come down to a nuance in interest and motivation.
In any case, if you want to check out Mike's work he has videos out on
mindset and
EDC, the rest presumably coming out at a later date.