Abstract: Secondary hyperparathyroidism (SHPT) is one of the serious complications in patients with chronic kidney disease. Parathyroid glands secrete parathyroid hormone (PTH), stimulated partly by hyperphosphatemia and hypocalcemia complicating chronic kidney disease (CKD). Use of a calcium-based phosphate binder might be sufficient to reduce serum PTH levels in mild SHPT, while the recent K/DOQI clinical guidelines recommended vitamin D therapy for dialysis patients with serum level of intact parathyroid hormone of 300 pg/mL or more. We conducted a 6-month prospective controlled trial of 50 patients initiating hemodialysis therapy who were randomized to receive oral calcium carbonate alone or the drug plus oral vitamin D sterol, calcitriol or alfacalcidol. The primary end point was the proportion of randomized patients who had a mean PTH level of 300 pg/mL or less at the end of this study. The secondary end point included the percent change in the values for corrected calcium, phosphorus, the calcium–phosphorus product, and PTH. Eighty percent of patients receiving calcium carbonate without vitamin D sterols (20 of 25) reached the primary end point—a mean PTH level of 300 pg/mL or less after the period—as compared with 84% of those receiving calcium carbonate and vitamin D sterol (21 of 25) (Mantel-Haenszel odds ratio 0.76, 95% confidence interval: 0.18–3.25, P = 0.71). The other effects of the two regimens on the secondary end points were not significantly different after 6 months. In SHPT of dialysis patients initiating hemodialysis, oral calcium carbonate use alone was not inferior to additional vitamin D sterol use with calcium carbonate in reducing serum PTH levels. Our result indicated that, if serum calcium and phosphorus levels are controlled primarily regardless of used agents, it will be followed by reduction of serum PTH level in these patients.