Xianxia as a genre is not a fault, but also not perfect, just like any other genre.
Immortality - Long life span. So, what? Secondary can be a genius or an old man that lived for a long time. There is no needed to let the protagonist be the only one who can be unique. Or, just use the theme to play with the age-old question of "Is immortality worth it?".
Fast growth - This one I agree, fast growth is hard to make, but it is not impossible to have a consistent cast. Why can't the secondary be as extraordinary as the MC?
Multiple worlds - This one is the same as fast growth. Plus revisiting the old ones, and bonus with the ponder about immortality. ( When all your loved ones died off. )
Survival of the Fittest - Why can't the secondary be good, just not as good as the MC? It's not like everyone would die if they are a little weaker than others.
And finally, authors are free to change the secondary cast, as many times as he wanted. Good stories didn't need an unchanged secondary cast.