The majority of neuroimaging studies focus on brain activity during performance of cognitive tasks; however, some studies focus on brain areas that activate in the absence of a task. Despite the surge of research comparing these contrasted areas of brain function, their interrelation is not well understood. We systematically manipulated cognitive load in a working memory task to examine concurrently the relation between activity elicited by the task versus activity during control conditions. We presented adults with six levels of task demand, and compared those with three conditions without a task. Using whole-brain analysis, we found positive linear relations between cortical activity and task difficulty in areas including middle frontal gyrus and dorsal cingulate; negative linear relations were found in medial frontal gyrus and posterior cingulate. These findings demonstrated balancing of activation patterns between two mental processes, which were both modulated by task difficulty. Frontal areas followed a graded pattern more closely than other regions. These data also showed that working memory has limited capacity in adults: an upper bound of seven items and a lower bound of four items. Overall, working memory and default-mode processes, when studied concurrently, reveal mutually competing activation patterns.