PDZ domain is one of the abundant modular domains that recognize short peptide sequences to mediate protein–protein interactions. To decipher the binding specificity of PDZ domain, we analyzed the interactions between 11 mouse PDZ domains and 217 peptides using a method called MIECSVM, which energetically characterizes the domain-peptide interaction using molecular interaction energy components (MIECs) and predicts binding specificity using support vector machine (SVM). Cross-validation and leave-one-domain-out test showed that the MIEC-SVM using all 44 PDZ-peptide residue pairs at the interaction interface outperformed the sequence-based methods in the literature. A further feature (residue pair) selection procedure illustrated that 16 residue pairs were uninformative to the binding specificity, even though they contributed significantly (∼50%) to the binding energy. If only using the 28 informative residue pairs, the performance of the MIEC-SVM on predicting the PDZ binding specificity was significantly improved. This analysis suggests that the informative and uninformative residue interactions between the PDZ domain and the peptide may represent those contributing to binding specificity and affinity, respectively. We performed additional structural and energetic analyses to shed light on understanding how the PDZ-peptide recognition is established. The success of the MIEC-SVM method on PDZ domains in this study and SH3 domains in our previous studies illustrates its generality on characterizing protein- peptide interactions and understanding protein recognition from a structural and energetic viewpoint.