The structure of skill at decoding nonverbal cues was examined for 150 high school students and 95 college students. An overall principal components analysis yielded four factors differing in the complexity of the message (pure versus mixed) and in the relative importance of the video versus the audio modality. Factor 1 (pure video) was defined by accuracy at face and body cues of ordinary (2 second) and very brief exposure length. Factor 2 (mixed video) was defined by accuracy at face and body cues with a “noisy” background. Factor 3 (mixed audio) was defined by accuracy at decoding discrepant cues and “noisy” audio cues. Factor 4 (pure audio) was defined by accuracy at pure tone of voice cues. The overall evidence suggested that despite a nontrivial degree of relationship among all measures of skill at decoding nonverbal cues (Armor's Theta = .62), it would increase our theoretical and empirical precision to conceptualize nonverbal decoding ability as made up of several relatively unrelated subskills.