I think we are mixing similar stuff together.
From what I understand, the OP was talking about "local farmer" NPC. Which is in fact not a follower. This homesteader/farmer like NPC does not follow you, but stays on your "Faction Base" (not a tent!). It does not have anything to do with your character or PartyPoints.
It can be hired for 5000caps, but only by a faction leader. You can hire one for every FactionBase you have.