The impact of the micropore width, external surface area, and meso-/macropore size on the charging performance of electrochemical double-layer capacitor (EDLC) electrodes is systematically investigated. Nonactivated carbon xerogels are used as model electrodes in aqueous and organic electrolytes. Monolithic porous model carbons with different structural parameters are prepared using a resorcinol-formaldehyde-based sol–gel process and subsequent pyrolysis of the organic precursors. Electrochemical properties are characterized by utilizing them as EDLC half-cells operated in aqueous and organic electrolytes, respectively. Experimental data derived for organic electrolytes reveals that the respective ions cannot enter the micropores within the skeleton of the meso- and macroporous carbons. Therefore the total capacitance is limited by the external surface formed by the interface between the meso-/macropores and the microporous carbon particles forming the xerogel skeleton. In contrast, for aqueous electrolytes the total capacitance solely depends on the total surface area, including interfaces at the micropore scale. For both types of electrolytes the charging rate of the electrodes is systematically enhanced when increasing the diameter of the carbon xerogel particles from 10 to 75 nm and the meso-/macropore size from 10 to 121 nm.