Symbiotic interactions are thought to play a key role in ecosystems. Empirical evidence for the impact of symbiotic bacteria on plant communities is, however, extremely scarce because of experimental constraints. Here, in three complementary experiments, we show that nitrogen-fixing rhizobia bacteria act as a determinant of plant community structure and diversity. Grassland microcosms inoculated with a mixture of rhizobia had a higher above-ground plant productivity (+35%), contained more nitrogen (+85%) and had significant higher community evenness (+34%) than control microcosms without rhizobia. Moreover, three of the four studied legume species required rhizobia to successfully coexist with other plant species. In contrast, the growth and survival of three grass and five forb species were not affected by the presence or absence of rhizobia. Finally, our results also showed that the legume species largely relied on symbiotically fixed nitrogen, both in the field and in the microcosms. This indicates that results in the microcosms are indicative for processes occurring in the field. It is concluded that symbiotic interactions between plants and prokaryotes can contribute to plant productivity, plant community structure and acquisition of limiting resources in legume-rich grassland communities.