While Inuyasha does have his own pack, he is not the only one making decisions. Kagome calls many of the shots, and Miroku and Sango tend to put in their say. It only seems like one decision because they usually agree: get shards good, Naraku bad.
How does Inuyasha feel about being part of the consensus? The outcast is now the pillar.