This should speed up the unsorted userlist quite a bit indeed.
(ToDo: Why is sort so damn slow?  Can I blame the branch callback?)