The global soil carbon pool is approximately three times larger than the contemporary atmospheric pool, therefore even minor changes to its integrity may have major implications for atmospheric CO2 concentrations. While theory predicts that the chemical composition of organic matter should constitute a master control on the temperature response of its decomposition, this relationship has not yet been fully demonstrated. We used laboratory incubations of forest soil organic matter (SOM) and fresh litter material together with NMR spectroscopy to make this connection between organic chemical composition and temperature sensitivity of decomposition. Temperature response of decomposition in both fresh litter and SOM was directly related to the chemical composition of the constituent organic matter, explaining 90% and 70% of the variance in Q10 in litter and SOM, respectively. The Q10 of litter decreased with increasing proportions of aromatic and O-aromatic compounds, and increased with increased contents of alkyl- and O-alkyl carbons. In contrast, in SOM, decomposition was affected only by carbonyl compounds. To reveal why a certain group of organic chemical compounds affected the temperature sensitivity of organic matter decomposition in litter and SOM, a more detailed characterization of the 13C aromatic region using Heteronuclear Single Quantum Coherence (HSQC) was conducted. The results revealed considerable differences in the aromatic region between litter and SOM. This suggests that the correlation between chemical composition of organic matter and the temperature response of decomposition differed between litter and SOM. The temperature response of soil decomposition processes can thus be described by the chemical composition of its constituent organic matter, this paves the way for improved ecosystem modeling of biosphere feedbacks under a changing climate.