1 CH- You can travel carrying 2 players, mercs, cows, dogs or followers.
2 CH- The same (not sure)
3 CH- The same (not sure)
4 CH- You +3 players, mercs...
5 CH- You + 4 ....
You can have as many followers as your Party Points allows you, no matter the CH you have (Ch increase your party points so it also lets you get more followers, but the important things are the Party Points). BUT you can only travel on World Map according to your charisma.
You can have 5 charisma and 5 followers. But you can only travel with 4 of them at once. The other one must stay in base or tent.