How will they be confused by typing /p join <IGN> (of leader) ? It's a simple thing to know and remember, ain't that hard to type either.
If the party is already complete for the desired amount, and then someone else joined, you could just nicely ask them to leave nor /p kick.
Connection with...