Is it possible to control the way we search users?

It doesn’t use a filter but it can all be created and styled with Cwicly.

Please see this thread for details:

From reading your post again, I can see you are already using a filter with front-end rendering so this method would require a change of approach, so may not be the perfect fit in this case.