I didnt think he minded the others.
He still seems a bit bitter over X6, what with going as far as saying he feels he "owes fans an apology" for it. But-
He just felt that he wanted to let the rest of the team have a say, and well, he sort o wandered off.
Capcom contact from way back when said that work on X6 started so soon as X5's was wrapping up, so from that I pretty much think that he is also to blame from that. Sounds like (just my hunch) he wasn't closely involved enough to know what was going on since his reactions to X6 seemed to be surprised or what have you.
X6 was the X5 team, (I think?)
Kinda like the Soul Eraser team, since it had the inclusion of Koji Nakajima as producer (Cyber Mission / X5 was only Tatsuya Minami, SE/X6 had Nakajima join in as a producer as well, who stayed up to CM).
So it was good readin' too, but after that, it feels somewhat bland. X7 was borderline X4 all over again, but with a new good guy character. X8 has great story, but something about it feels off when I compare it with the others. perhaps its the lack of focus on X and Zero? And the fact that Wily connection built up so heavily since X2 was dropped after X6?
I honestly wouldnt mind a new X sidegame.
From X7 onwards it's vague enough that if they feel like wrapping up the Wily plot with a sidegame it'd fit, and if they just find some excuse to why Wily bid his own time for
oh so [tornado fang]ing long it would also fit. I'd like to know why they dropped it in the first place, but ah well. I guess that with enough fan pestering at least Inafune was made aware of it (cue Capcom Unity FAQ and Zero's TvC ending).
As for story, the only one I could be arsed to be actively involved with and that felt good to me during the "X7" era was Command Mission. Rest was meh.