In contrast to Arctic sea ice, average Antarctic sea ice area is not retreating but has slowly increased since satellite measurements began in 1979. While most climate models from the Coupled Model Intercomparison Project Phase 5 (CMIP5) archive simulate a decrease in Antarctic sea ice area over the recent past, whether these models can be dismissed as being wrong depends on more than just the sign of change compared to observations. We show that internal sea ice variability is large in the Antarctic region, and both the observed and modeled trends may represent natural variations along with external forcing. While several models show a negative trend, only a few of them actually show a trend that is significant compared to their internal variability on the time scales of available observational data. Furthermore, the ability of the models to simulate the mean state of sea ice is also important. The representations of Antarctic sea ice in CMIP5 models have not improved compared to CMIP3 and show an unrealistic spread in the mean state that may influence future sea ice behavior. Finally, Antarctic climate and sea ice area will be affected not only by ocean and air temperature changes but also by changes in the winds. The majority of the CMIP5 models simulate a shift that is too weak compared to observations. Thus, this study identifies several foci for consideration in evaluating and improving the modeling of climate and climate change in the Antarctic region.