Operational rainfall forecasts using the analog method have been issued in Ethiopia since 1987. We evaluate the performance of the forecast system for February–May and June–September rainy seasons over the period 1999–2011. Verification is performed using rainfall data obtained from Ethiopian meteorological stations covering eight homogeneous rainfall regions used in the forecasts. The results reveal that forecasts issued by the National Meteorological Agency (NMA) of Ethiopia, for the past 12 years have a weak positive skill for all eight regions compared with climatology. In terms of ranked probability skill scores, the values are all lower than 10% indicating that the forecast skill is modest. The results further suggest that the forecasting system has bias toward forecasting near-normal conditions and has problems in capturing below average events. In contrast, the forecast has some positive skills in ranking the wet years of February–May season, particularly over the regions where there is high seasonal rainfall variability with significantly positive rank correlations for the above average years. For the main season, however, the forecast is not able to rank wet years or dry years. The extreme low and high rainfall events are mostly missed by the forecast scheme. The results indicate rather low forecast skill for extreme rainfall events in both seasons. Generally, the results indicate that NMA's forecasts have low but positive skill as it is common with results from other forecasting systems for the Greater Horn of Africa region. The underforecasting of dry events is the most serious shortcoming of the system.