Fax: (214) 648-8786
Review Article
An updated catalog of prostate cancer predictive tools†
Article first published online: 29 SEP 2008
DOI: 10.1002/cncr.23908
Copyright © 2008 American Cancer Society
Additional Information
How to Cite
Shariat, S. F., Karakiewicz, P. I., Roehrborn, C. G. and Kattan, M. W. (2008), An updated catalog of prostate cancer predictive tools. Cancer, 113: 3075–3099. doi: 10.1002/cncr.23908
- †
See editorial on pages 3062–6, this issue.
Publication History
- Issue published online: 17 NOV 2008
- Article first published online: 29 SEP 2008
- Manuscript Revised: 4 JUN 2008
- Manuscript Accepted: 3 JUN 2008
- Manuscript Received: 11 NOV 2007
- Abstract
- Article
- References
- Cited By
Keywords:
- prostate cancer;
- nomogram;
- prediction;
- recurrence
Abstract
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
Accurate estimates of risk are essential for physicians if they are to recommend a specific management to patients with prostate cancer. Accurate risk estimates also are required for clinical trial design to ensure that homogeneous, high-risk patient groups are used to investigate new cancer therapeutics. Using the MEDLINE database, a literature search was performed on prostate cancer predictive tools from January 1966 to July 2007. The authors recorded input variables, the prediction form, the number of patients used to develop prediction tools, the outcome being predicted, prediction tool-specific features, predictive accuracy, and whether validation was performed. Each prediction tool was classified into patient clinical disease state and the outcome being predicted. First, the authors described the criteria for evaluation (predictive accuracy, calibration, generalizability, head-to-head comparison, and level of complexity) and the limitations of current predictive tools. The literature search generated 109 published prediction tools, including only 68 that had undergone validation. An increasing number of predictive tools addressed important endpoints, such as disease recurrence, metastasis, and survival. Despite their limitations and the limitations of data, predictive tools are essential for individualized, evidence-based medical decision making. Moreover, the authors recommend wider adoption of risk-prediction models in the design and implementation of clinical trials. Among prediction tools, nomograms provide superior, individualized, disease-related risk estimations that facilitate management-related decisions. Nevertheless, many more predictive tools, comparisons between them, and improvements to existing tools are needed. Cancer 2008. © 2008 American Cancer Society.
In the US, prostate cancer (PCa) is the most common solid malignancy and the second leading cause of cancer death among men.1 Accurate estimates of the likelihood of cancer diagnosis, stage, clinical significance, treatment success, complications, and long-term morbidity are essential for patient counseling and informed decision making. Toward this objective, properly informing the patient of these likelihoods will improve his satisfaction after treatment. Lack of patient involvement has been identified as a major risk factor for regret of treatment choice,2 particularly when complications arise.3 Therefore, accurate estimates of risk are essential for physicians if they are to recommend a specific management. Accurate risk estimates also are required for clinical trial design to ensure that homogeneous patient groups will be used to investigate new cancer therapeutics.
Traditionally, physician judgment has formed the basis for risk estimation, patient counseling, and decision making. However, clinicians' estimates may be biased because of subjective and objective confounders that exist at all stages of the prediction process.4–7 To obviate this problem and to obtain more accurate predictions, researchers have developed predictive tools (directed at predicting the probability of an outcome without considering the effect of time) and prognostic tools (directed at predicting the probability of an outcome over time) that are based on statistical models.8 Recently, predictive and prognostic nomograms have been introduced to complement the standard modeling techniques with the ability to predict the risk of the outcome of interest for the individual patient, a quality that the standard regression techniques could not offer.9 The ability of the nomograms to predict PCa diagnosis, stage, and prognosis has been confirmed.10, 11 In general, it has been demonstrated that these predictive models perform better than clinical judgment when predicting probabilities of outcome.7, 12, 13 That said, physician input obviously is essential and crucial for the measurement of variables that are used in the prediction process, for the entire decision-making process, and in the interpretation and application of model-derived outcome predictions in clinical practice.
Decision aids include the ‘Kattan-type’ nomograms,10, 11 risk groupings,14–17 artificial neural networks (ANNs),18 probability tables (such as the most widely known and applied ‘Partin staging tables’19, 20), and classification and regression tree (CART) analyses.21, 22 In 2001, we published a catalogue of PCa nomograms.8 Within the last 6 years, the field of predictive modeling has exploded, and several other valuable tools are now available.
In this review, we describe criteria for the evaluation of predictive tools and then catalogue the current nomograms available for PCa according to the natural history of treated PCa. Using MEDLINE, a literature search was performed on PCa predictive and prognostic tools from January 1966 to July 2007. For each of the identified tools, we describe the patient population and the outcomes predicted, and we record the individual characteristics of each tool, such as predictor variables, tool-specific features, predictive accuracy estimates, and whether internal and/or external validation has been performed. This review may serve as an initial step toward a comprehensive reference guide for physicians to locate published nomograms that apply to the clinical decision at hand.
Evaluating Predictive Tools
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
Decision aids consist of the nomograms,10, 11 risk groupings,14–17 ANNs,18 probability tables such as the ‘Partin staging tables,’19, 20 and CART analyses.21, 22 Despite the apparent differences of these prediction tools, their characteristics can be compared using a common approach. The points of comparisons are based on 4 characteristics: predictive accuracy, calibration (correlation between predicted and observed risk throughout the entire range of predictions), generalizability, and level of complexity.
Predictive accuracy
Accuracy quantifies the model's ability to discriminate between patients with and without the outcome of interest. The model's accuracy represents the most important consideration for comparison of different models. Valid determination of a model's accuracy requires application of the model under novel testing conditions different from the development cohort. Accuracy ideally should be ideally in an independent cohort. In the absence of an external cohort, models can be subjected to internal validation. Bootstrapping represents the ideal internal validation format in which the development dataset is used to simulate model testing under novel conditions.23–28 Split-sample and cross-validation (leave-1-out validation) formats represent alternatives.27
Calibration
A model's accuracy (discrimination) indicates the overall ability to predict the outcome of interest. However, overall accuracy does not indicate the ability of the model to predict the outcome of interest in specific patient groups or according to risk level. For example, a model that is 80% accurate may predict virtually perfectly well in high-risk patients but may demonstrate dismal performance in low-risk patients. The relation between predicted risk and observed rate of the outcome of interest should be provided for each new model along with its overall accuracy. Calibration plots provide this type of information and can be obtained for both internal and external data.24, 26–29 Such plots graphically illustrate the relation between predicted and observed rates of the outcome of interest. Ideally, a model with perfect ability to predict the outcome of interest should exhibit a 1:1 relation between predicted and observed rates, which results in a 45-degree slope.
Generalizability
Several considerations may undermine the generalizability of a model under specific conditions or in a specific population. For example, because of differences in the patterns of early detection and in the extent of screening, the characteristics of newly diagnosed PCa may not be the same across populations.30 These population differences may undermine the accuracy of predictive and prognostic models. Moreover, models may perform better in patients who share a specific characteristic (such as race) but may demonstrate significantly worse performance characteristics in other patients. Therefore, it is imperative for the clinician to know whether a specific model indeed is generalizable and applicable to the target population.24, 26–29
Level of complexity
The level of complexity of a predictive or prognostic model represents an important practical consideration. Excessively complex models, those that rely on multiple variables, clearly are impractical in busy clinical practice. Similarly, models that rely on variables that are not available routinely are impractical. These include models that rely on novel biomarkers, which, in turn, require noncommercially available and/or nonstandardized assays. Finally, models that require tedious preliminary calculations, for example, the calculation of prostate-specific antigen (PSA) doubling time (PSADT) without providing an ancillary PSADT calculator, tend to discourage clinicians. Therefore, parsimony represents an important ingredient. Its absence may undermine even the most accurate and best performing model.
Head-to-head comparison
When judging a new tool, its predictive accuracy, validity, and calibration should be examined relative to established models, with the intent of determining whether the new model offers advantages relative to available alternatives.9, 25, 27, 28, 31–34 Head-to-head comparisons represent the most direct and unbiased comparison of objective attributes (accuracy and calibration) of various models. Subsequently, complexity, generalizability, and other considerations can be compared. With this approach, the alternatives are compared directly without having to judge the concordance index in isolation or against a possibly arbitrary threshold.
The main steps required in a head-to-head comparison consist of the application of the original model to a common external dataset that will serve to test all models, which will be compared with one another. The original model is then applied to each individual observation to derive the probability of the outcome of interest. The predictions are then compared against observed rates of the outcome of interest, and accuracy (discrimination) is calculated using the receiver operating characteristics curve or another measure of discrimination, such as the Brier index. These steps are repeated for each of the tested models. A common mistake consists of refitting a new model that relies on the same variables as the original model and calling it the original model.
Nomograms currently represent the most accurate and discriminating tools for predicting outcomes in patients with PCa. Various studies have documented the superior performance of nomograms compared with risk grouping,9, 25, 30–32, 35, 36 look-up tables,9, 25, 32, 37, 38 tree analysis,9, 25, 39 and ANNs.9, 25, 34, 40–42 Therefore, the discussion below is weighted toward nomograms.
Limitations of Predictive and Prognostic Tools
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
In addition to obvious limitations related to accuracy, performance characteristics, generalizability and the level of complexity, the most common potential additional limitations of currently available predictive and prognostic tools may be classified in 1 or several of the following categories.
Study selection criteria
Specific model criteria, such as inclusion and exclusion criteria, do not allow the use of models for patients with different characteristics or who have been exposed to different treatment modalities. Therefore, it is imperative for the clinician to know whether a specific model indeed is generalizable to the target population.24, 26–29
A models' ability to predict may be affected by population characteristics that change over time. In general, more contemporary cancer patients are diagnosed with more favorable stage and grade. In consequence, tools require periodic reappraisals to assess the effect of stage and grade migration. Often, such studies may indicate that predictions devised on historic patients no longer apply to contemporary patients. However, models also may show stable accuracy and performance characteristics. External validation in contemporary cohorts is necessary to ensure temporal validity.
Adjustment for competing risks
Because of the protracted course of PCa, competing causes of mortality are extremely important in this patient population.43 Competing risks modeling can predict cancer control rates after accounting for the effects of competing risks. There is a need for more competing risks-based modeling to better situate the risk of PCa in the framework of other cause mortality.43 Such predictions are important to both clinicians and patients, especially when over treatment or suboptimal treatment considerations are addressed.
With regard to competing risks and the risk of PCa mortality, there is growing evidence indicating that the anticipated survival benefit derived from the diagnosis and treatment for PCa is nonuniform. Because the morbidity and mortality of PCa treatment are nontrivial, clinicians must be able to stratify patients PCa better according to risk, such that those who stand to gain the most from the intervention receive it. To our knowledge, to date, the only modeling tools that allow adjustment for competing risks are the Kattan-type nomogram and the Albertsen tables.43–46 Although the preliminary format of several other competing risk nomograms has been presented, to our knowledge, no such model has been published in the urologic literature to date.
Conditional probabilities
The updated versions of the pre- and postoperative Kattan nomograms for predicting biochemical recurrence after radical prostatectomy (RP) provide the opportunity to adjust for disease-free interval after surgery.47, 48 Unfortunately, few other tools demonstrate this important quality. Absence of adjustment for disease-free interval presents the clinician with an excessively somber estimate of cancer control over time. The latter, as expected, improves with increasing disease-free interval.
Suboptimal predictive accuracy
None of the prediction models developed to date are perfect. This is mainly because sufficiently informative predictors of the outcome of interest are not considered. Moreover, many models fail to include some of the key predictive risk factors that were demonstrated as virtually indispensable by others. Finally, even when all available variables are considered, models generally are not 100% accurate. Limitations in the accuracy of existing tools confirm that there is a need for novel biomarkers and imaging tools that are associated with the biologic behavior of PCa to enhance the predictive accuracy of current tools.33, 49, 50
Catalogue of Available Predictive Tools
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
Predicting prostate cancer on initial biopsy
Table 1 shows nomograms for predicting PCa on initial biopsy. Eastham et al developed the first nomogram for predicting PCa on initial biopsy in men who had a c-index of 0.75.51 Despite good accuracy, this nomogram suffers from limited generalizability. The nomogram was limited to men with suspicious digital rectal examination and serum PSA levels <4.0 ng/mL. In addition, the use of sextant biopsies further limits the applicability of this nomogram.
| Reference | Prediction Form | No. of Patients | Variables | Mean No. of Cores (Range) | Cancer Detection, % | Accuracy, % | Validation |
|---|---|---|---|---|---|---|---|
| |||||||
| Babaian 1998100 | Risk group | 151 | Age, creatinine phosphokinase isoenzyme activity, prostatic acid phosphatase, PSA | 6 | 24 | 74 | Not performed |
| Eastham 199951 | Probability nomogram development | 700 | Age, race, DRE, PSA of 0-4 ng/mL | 6 | 9 | 75 | Internal |
| Virtanen 1999101 | Neural network | 212 | % Free PSA, DRE, heredity | Not available | 25 | 81 | Not performed |
| Finne 2000102 | Neural network | 656 | % Free PSA, PSA, DRE, TRUS | Not available | 23 | Not available | Not performed |
| Horninger 2001103 | Neural network | 3474 | Age, PSA, % free PSA, DRE, TRUS, PSA density, PSA density of transition zone, transition zone volume | Not available | Not available | Not available | Not performed |
| Kalra 2003104 | Neural network | 348 | Age, ethnicity, heredity, IPSS, DRE, PSA, complexed PSA | 6 | Not available | 83 | Not performed |
| Garzotto 2003105 | Probability nomogram development | 1239 | Age, race, family history, referral indications, prior vasectomy, DRE, PSA ≤10 ng/mL, PSA density, TRUS findings | 6.7 (6-13) | 24 | 73 | Not performed |
| Finne 2004106 | Neural network | 1775 | DRE, % free PSA, TRUS, PSA | Not available | 22 | 76 | Not performed |
| Karakiewicz 2005107 | Probability nomogram development | 6469 | Age, DRE, PSA, % free PSA | 6 | 35-42 | 77 | Internal andexternal |
| Porter 2005108 | Neural network | 3814 | Age, PSA, gland volume, PSA density, DRE, TRUS | 6 | 27-42 | 72-75 | Internal and external |
| Suzuki 2006109 | Probability nomogram development | 834 | Age, PSA, % free PSA, prostate volume, DRE | ≥6 | 29 | 82 | Internal |
| Chun 200752 | Probability nomogram validation and development* | 2900 | Age, DRE, PSA, % free PSA, sampling density† | 11 (10-20) | 41 | 77 | Internal andexternal |
Chun et al developed and validated nomograms in a population that was exposed to extended biopsy sampling.52 External validation in 3 cohorts totaling 2900 men demonstrated 73% to 76% accuracy.
Predicting prostate cancer on repeat biopsy
Table 2 shows nomograms for predicting PCa on repeat biopsy. Lopez-Corona et al developed a nomogram that predicts the probability of a positive repeat biopsy.53 The nomogram was developed and internally validated (70% accuracy) in 343 men and externally validated (71% accuracy) in 230 patients.54
| Reference | Prediction Form | Design | No. of Patients | Variables | Median No. of Previous Biopsy Sessions | Mean No. of Cores (Range) | Cancer Detection, % | Accuracy, % | Validation |
|---|---|---|---|---|---|---|---|---|---|
| |||||||||
| O'Dowd 2000110 | Probability nomogram Development | Repeat biopsy | 813 | Age, initial biopsy diagnosis, PSA, % free PSA | Not available | Not available | 29 | 70 | Not performed |
| Lopez-Corona 200353 | Probability nomogram Development | Repeat biopsy | 343 | Age, DRE, no. previous negative biopsies, HGPIN history, ASAP history, PSA, PSA slope, family history, months from initial negative biopsy | 2.9 (2-12) | 9.2 (6-22) | 20 | 70 | Internal |
| Remzi 2003111 | Neural network | Repeat biopsy | 820 | PSA, % free PSA, TRUS, PSA density, PSA density of the transition zone, transition zone volume | Not available | 8 | 10 | 83 | Not performed |
| Yanke 200554 | Probability nomogram validation54 | Repeat biopsy | 230 (356 Biopsies) | Age, DRE, no. previous negative biopsies, HGPIN history, ASAP history, PSA, PSA slope, family history, months from initial negative biopsy, months from previous negative biopsy | 2.6 (2-7) | 17.9 (12-54) | 34 | 71 | Internal |
| Chun 200755 | Probability nomogramDevelopment | Repeat biopsy | 2393 | Age, DRE, PSA, % free PSA, no. previous negative biopsies, sampling density* | 1.5 (1-7) | 11 (10-24) | 30 | 76 | Internal and external |
| Walz 2006112 | Probability nomogram Development | Repeat saturation biopsy | 161 | Age, PSA, % free PSA, prostate and BPH volume, PSA doubling time, PSA density of the transition zone, no. of previous biopsy sessions, no. of cores at saturation biopsy | 2.5 (2-5) | 24.5 (20-32) | 41 | 75 | Internal |
| Snow 199418 | Neural network | Initial and repeat biopsy | 1787 | Age, change on PSA, DRE, PSA, TRUS | Not available | 6 | 34 | 87 | Not performed |
| Carlson 1998113 | Probability table | Initial and repeat biopsy | 3773 | Age, PSA, % free PSA | Not available | 6 | 33 | Not available | Internal |
| Djavan 2002114 | Neural network | Initial and repeat biopsy | 272 | PSA density of the transition zone, % free PSA, PSA density, TRUS (PSA of 2.5-4.0 ng/mL) | Not available | 8 | 24 | 88 | Not performed |
| 974 | PSA density of the transition zone, % free PSA, PSA velocity, transition zone volume, PSA, PSA density (PSA of 4.0-10.0 ng/mL) | Not available | 8 | 35 | 92 | Not performed | |||
| Stephan 2002115 | Neural network | Initial and repeat biopsy | 1188 | Age, DRE, PSA, % free PSA, TRUS | Not available | Not available | 61 | 86 | Not performed |
| Porter 2002116 | Neural network | Initial and repeat | 319 | Age, PSA, gland volume, TRUS, DRE, previous negative biopsy, African-American race | Not available | 9.7 (6-10) | 39 | 76 | Not performed |
| Matsui 2004117 | Neural network | Initial and repeat biopsy | 228 | PSA density, DRE, age, TRUS | Not available | 10-12 | 26 | 73 | Not performed |
| Benecchi 2006118 | Neural network | Initial and repeat biopsy | 1030 | Age, PSA, % free PSA | Not available | 6-12 | 19 | 80 | Not performed |
| Yanke 2006119 | Probability nomogramDevelopment | Initial and repeat biopsy | 8851 | Age, race, PSA, DRE, no. of cores | Not available | 6-13 | 27-38 | 75 | Internal |
Chun et al developed the most contemporary repeat biopsy nomogram (n = 721) based on ≥10 biopsy cores.55 In an external validation cohort (n = 361), the nomogram yielded 74% accuracy.
Staging Nomograms
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
Several multivariate statistical models have been proposed to estimate pathologic stage at RP with the intent of facilitating treatment planning. Of these, the ‘Partin tables’ represent the most widely used tool. These look-up tables predict pathologic stage at RP (Table 3).19 After their introduction in 1993, the Partin tables were validated in 1997 and updated in 2001 and 2007.20, 56–58
| Reference(s) | Prediction Form | Outcome | No. of Patients | Variables | Accuracy. % | Validation |
|---|---|---|---|---|---|---|
| ||||||
| Narayan 1995120 | Probability graph | Pathologic stage | 813 | Biopsy based stage, biopsy Gleason sum, PSA | Not available | Not performed |
| Partin 199719 and 1993121; Makarov 200720 | Probability table | Pathologic stage | 703 and 4133 | Biopsy Gleason sum, clinical stage, PSA | Internal. 72; external,. 84 | External (Kattan 1997122) and updated (Markov 2007,20 Partin 2001,58 Blute 2000123) |
| Epstein 1994124 | Risk group | Clinically indolent cancer defined as pathologically organ confined, tumor volume ≤0.2 cc, Gleason sum <7 | 157 | Biopsy Gleason sum, mm core with cancer, PSA density, no adverse pathologic findings on needle biopsy | Not available | External (Carter & Epstein 1994125) |
| Goto 1996126 | Risk group | Clinically indolent cancer defined as pathologically organ confined, tumor volume ≤0.5 cc, Gleason sum <7 | 569 | PSA density, maximal mm cancer in any core | Not available | Not performed |
| Kattan 200365 | Probability nomogram development | Clinically indolent cancer defined as pathologically organ confined, tumor volume ≤0.5 cc, no Gleason grade 4 or 5 | 409 | PSA, primary and secondary biopsy Gleason sum | 64 | Internal and external (Steyerberg 200729) |
| PSA, primary and secondary biopsy Gleason sum, % positive cores, TRUS volume | 74 | Internal and external (Steyerberg 200729) | ||||
| PSA, clinical stage, primary and secondary biopsy Gleason sum, TRUS volume, mm core with cancer, mm core without cancer | 79 | Internal and external (Steyerberg 200729) | ||||
| Chun 2006127 | Probability nomogram development | Gleason upgrading between biopsy and RP | 2982 | PSA, clinical stage, primary and secondary biopsy Gleason sum | 80 | Internal |
| Chun 2006128 | Probability nomogram development | Significant Gleason upgrading between biopsy and RP | 4789 | PSA, clinical stage, biopsy Gleason sum | 76 | Internal |
| Steuber 2006129 | Probability nomogram development | Tumor location: transition vs peripheral zone | 945 | PSA, biopsy Gleason sum, positive biopsy cores at midprostate only, no. of positive biopsy cores at base, cumulative % biopsy tumor volume | 77% | Internal |
| Peller 1995130 | Probability table | Tumor volume | 102 | Biopsy Gleason sum, no. of positive sextant cores, PSA | Not available | Not performed |
| Ackerman 1993131 | Probability formula | Surgical margin positivity | 107 | No. of positive sextant cores, PSA density | 70 | Not performed |
| Rabbani 1998132 | Probability graph | Surgical margin positivity | 242 | Androgen deprivation, no. of ipsilateral positive cores, PSA | Not available | Not performed |
| Bostwick 1996133 | Probability graph | Capsular penetration | 314 | Biopsy Gleason sum, % cancer in biopsy cores, PSA | 78 | Not performed |
| Gamito 2000134 | Neural network | Capsular penetration | 4133 | Age, race, PSA, PSA velocity, Gleason sum, clinical stage | 30-76 | External |
| Gilliland 1999135 | Probability graph | Extracapsular extension | 3826 | Age, biopsy Gleason sum, PSA | 63 | Not performed |
| Ohori 200459 | Probability nomogram development | Side-specific extracapsular extension | 763 | PSA, clinical stage, side-specific biopsy Gleason sum, side-specific % positive cores, side-specific % of cancer in cores | 81 | External (Steuber 200639) |
| Steuber 200639 | Probability nomogram development | Side-specific extracapsular extension | 1118 | PSA, clinical stage, biopsy Gleason sum, % positive cores, % of cancer in positive cores | 84 | Internal |
| Veltri 2001,136 Haese 2003137 | Ordinal logistic regression and neural network | Organ confined disease | 1287 | Age, PSA, no. of positive cores, highest Gleason score, average % tumor involvement per core, presence of Gleason pattern 4/5, midcore with >5% tumor base and/or midcore with >5% tumor | 93-98.6 | External |
| Badalament 1996138 | Probability formula | Organ confined disease | 192 | Biopsy Gleason sum, involvement of >5% of base with or without apex biopsy, nuclear grade, PSA, total % tumor involvement | 86 | Not performed |
| Bostwick 1996133 | Probability graph | Seminal vesicle invasion | 314 | Biopsy Gleason sum, % cancer in cores, PSA | 76 | Not performed |
| Pisansky 1996139 | Probability graph | Seminal vesicle invasion | 2953 | Biopsy Gleason primary grade, clinical stage, PSA | 80 | Internal |
| Koh 200360 | Probability nomogram Development | Seminal vesicle invasion | 763 | PSA, clinical stage, primary and secondary Gleason sum, and % of cancer at the base | 88 | Internal |
| Baccala 2007140 | Probability nomogram Development | Seminal vesicle invasion | 6740 | Age, PSA, Biopsy Gleason sum, clinical stage | 80 | Internal |
| Gallina 200738 | Probability nomogram development | Seminal vesicle invasion | 896 | PSA, clinical stage, biopsy Gleason sum, % positive biopsy cores | 79 | Internal and external |
| Ackerman 1993131 | Probability formula | LN invasion assessed with limited pelvic lymphadenectomy | 107 | No. of positive sextant cores, PSA | 94 | Not performed |
| Roach 1994141 | Probability graph | LN invasion assessed with limited pelvic lymphadenectomy | 212 | Biopsy Gleason sum, PSA | Not available | Not performed |
| Bluestein 1994142 | Probability graph | LN invasion assessed with limited pelvic lymphadenectomy | 816 | Biopsy Gleason sum, clinical stage, PSA | 82 | Internal |
| Batuello 2001143 | Neural network | LN invasion assessed with limited pelvic lymphadenectomy | 6454 | Biopsy Gleason sum, clinical stage, PSA | 77-81 | Internal and external |
| Cagiannos 200361 | Probability nomogram Development | LN invasion assessed with limited pelvic lymphadenectomy | 5510 | PSA, clinical stage, biopsy Gleason sum/PSA, clinical stage, biopsy Gleason sum, institution | 76/78 | Internal |
| Briganti 2006,37 2006,62 and 2007144 | Probability nomogram development | LN invasion assessed with extended pelvic lymphadenectomy (≥10 LNs) | 78137 | PSA, clinical stage, biopsy Gleason sum, no. of LNs | 79 | Internal |
| 60262 | PSA, clinical stage, biopsy Gleason sum | 76 | Internal | |||
| 278144 | PSA, clinical stage, biopsy Gleason sum, % positive biopsy cores | 83 | Internal | |||
Although the Partin tables represent a milestone in pretreatment PCa staging, they have limitations. For example, the probability of extracapsular extension (ECE) cannot be predicted in a side-specific fashion. To circumvent this limitation, Graefen et al attempted to enhanced the specificity of ECE predictions by devising a regression tree analysis capable of predicting ECE in a side-specific manner.22 Their model allows the identification of candidates for nonnerve-sparing versus unilateral versus bilateral nerve-sparing prostatectomy. External validation of this model yielded 70% accuracy.57
Ohori et al developed a nomogram (n = 763 patients) to predict side-specific ECE (range of c-index, 79%-81%).59 Validation of another side-specific nomogram in 1118 European patients yielded 84% accuracy.39 Compared with the Partin tables, the nomogram approach is more accurate and provides side-specific predictions. Moreover, the nomograms predict ECE independent of seminal vesicle invasion (SVI) and lymph node invasion (LNI).19, 20, 58
Koh et al60 and Gallina et al38 devised nomograms to predict the probability of SVI in 763 patients (range of c-index, 78%-88%). Cagiannos et al (n = 5510 patients) developed an LNI nomogram that yielded 76% accuracy compared with 74% for the Partin tables that were tested in the same cohort.61 Briganti et al developed an LNI nomogram in 602 patients who underwent extended pelvic lymphadenectomy (76% accuracy).62 In addition, the same investigators developed another nomogram (n = 565 patients) that allows the identification of patients who are at a negligible risk of LNI outside of the obturator fossa and in whom an extended pelvic lymphadenectomy can be omitted (80% accuracy).63 The combination of these nomograms allows accurate identification of the need and extent of pelvic lymphadenectomy.
Although predicting adverse pathologic features is important for the management of patients with PCa, a proportion of patients harbors clinically insignificant or indolent PCa that cannot be predicted with these tools.64 To address this void, Kattan et al developed 3 nomograms (range of c-index, 64%-79%) that predict the probability of indolent PCa65 based on the definition of Epstein et al (ie, organ-confined cancer, ≤0.5 mL in volume, and no poorly differentiated elements).66 Steyerberg et al externally validated those nomograms in a screening cohort (range of c-index, 61%-76%).29 These tools allow the prediction of clinically insignificant PCa with reasonable accuracy, which may help in the decision-making process between definitive therapy versus active surveillance.
Predicting Biochemical Recurrence After Radical Prostatectomy
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
Before radical prostatectomy
Kattan et al developed a pretreatment nomogram (n = 983 patients) that predicts 5-year biochemical recurrence for patients who undergo RP (Fig. 1) (Table 4).10 External validation yielded accuracies of ≈75% (range, 65%-83%).67–69

Figure 1. Preoperative nomogram for predicting the 5-year probability of freedom from biochemical disease recurrence after radical prostatectomy. PSA indicates prostate-specific antigen. Reproduced with permission from Kattan MW, Eastham JA, Stapleton AM, Wheeler TM, Scardino PT. A preoperative nomogram for disease recurrence following radical prostatectomy for prostate cancer. J Natl Cancer Inst. 1998;90:766-771. Reprinted with permission of Oxford University Press.
| Reference(s) | Prediction Form | Operative Status | Biochemical Recurrence. y | No. of Patients | Variables | Accuracy, % | Validation |
|---|---|---|---|---|---|---|---|
| |||||||
| Snow 199418 | Neural network | Preoperative | Not available | 240 | Age, PSA, clinical stage, biopsy Gleason grade, potency | 90 | Not performed |
| Kattan 199810 | Probability nomogram development | Preoperative | 5 | 983 | Biopsy primary and secondary Gleason grade, clinical stage, PSA | Internal, 74; external, 65-83 | Internal and external (Graefen 200267, 68 and 2003146; Greene 2004145) |
| D'Amico 199916 | Probability table | Preoperative | 2 | 892 | Biopsy Gleason sum, clinical stage, PSA | Not available | Internal |
| Graefen 1999147 | Probability graph | Preoperative | 3.5 | 315 | Biopsy Gleason sum, no. of positive cores, PSA | Not available | Not performed |
| D'Amico 200017 | Probability graph | Preoperative | 2 | 977 | Biopsy Gleason sum, endorectal coil magnetic resonance imaging T-stage, PSA, % positive biopsy cores | Not available | Internal |
| Tewari 2001148 | Neural network | Preoperative | 3.5 | 1400 | Age, race, PSA, clinical staging, biopsy Gleason sum | 83 | Not performed |
| D'Amico 1998,14 200215 | Probability graph | Preoperative | 4 | 823 | Biopsy Gleason sum, clinical stage, PSA, % positive biopsy cores | 80 | Internal and external (Graefen 2002,67 Mitchell 2005149) |
| Cooperberg 2005150 | Probability graph | Preoperative | 3 and 5 | 1439 | Age, PSA, biopsy Gleason sum, clinical stage, % positive biopsy | Internal, 66; external. 68-81 | Internal and external (Cooperberg 2006,151 May 2007152) |
| Stephenson 200648 | Probability nomogram development | Preoperative | 10 | 1978 and 1545 | PSA, clinical stage, biopsy Gleason sum, year of surgery, no. of positive and negative cores | 76-79% | Internal and external |
| Bauer 1998153 | Probability formula | Postoperative | 5 | 378 | Race, PSA, Gleason sum, organ confined status | Not available | External (Moul 2001154) |
| D'Amico 199814 | Probability graph | Postoperative | 2 | 862 | Pathologic stage, PSA, Gleason sum, surgical margin status | Not available | Not performed |
| Graefen 1999147 | Probability graph | Postoperative | 3.5 | 318 | Pathologic stage, volume Gleason grade 4/5 | Not available | Not performed |
| Potter 1999155 | Neural network | Postoperative | 5 | 214 | Gleason sum, extraprostatic extension, surgical margin status, age, DNA ploidy, and quantitative nuclear grade | 94 | Internal |
| Kattan 199911 | Probability nomogram development | Postoperative | 5 | 996 | PSA, Gleason sum, extracapsular extension, seminal vesicle invasion, LN invasion, surgical margin status | Internal, 89; external, 77-83 | Internal and external (Bianco 2003,69 Graefen 2002,73 Ramsden and Chodak 2004156) |
| Stamey 2000157 | Probability formula | Postoperative | Unknown | 326 | PSA, % Gleason grade 4/5, volume largest cancer, vascular invasion, prostate weight, % intraductal cancer, LN invasion | Not available | Not performed |
| McAleer 2005158 | Probability graph | Postoperative | 7 | 2417 | Gleason grade, stage, margin status, dichotomized PSA (cut point 10 ng/mL). | Not available | Internal |
| Stephenson 200547 | Probability nomogram development | Postoperative | 10 | 1881, 1782, and 1357 | PSA, Gleason sum, extracapsular extension, seminal vesicle invasion, LN invasion, surgical margin status | 78-86 | Internal and external |
However, the 5-year endpoint is insufficient to predict the likelihood of cure after RP, because many patients are at risk of disease recurrence beyond 5 years.70–72 Therefore, Stephenson et al recently updated the preoperative nomogram by predicting the 10-year probability of biochemical recurrence after RP (Fig. 2A) (77% accuracy).48 Their model exhibited good calibration across the spectrum of predictions in internal validation but exhibited some optimism in external validation (Fig. 2B). An added feature of the nomogram is the ability to estimate the probability of recurrence at any point in time from 1 year to10 years after RP after accounting for disease-free interval.

Figure 2. (A) Preoperative nomogram estimating the 1-year to 10-year biochemical recurrence-free probability after radical prostatectomy alone. (B) Calibration plot of the nomogram in external validation. The 45° line represents an ideal model in which estimates of disease recurrence are calibrated perfectly with outcome. Vertical bars are 95% confidence intervals for quintiles in the validation set. PSA indicates prostate-specific antigen. Reproduced with permission from Stephenson AJ, Scarcino PT, Eastham JA, et al. Preoperative nomogram predicting the 10-year probability of prostate cancer recurrence after radical prostatectomy. J Natl Cancer Inst. 2006;98:715-717. Reprinted with permission of Oxford University Press.
After radical prostatectomy
Kattan et al also developed a postoperative nomogram for predicting 5-year biochemical recurrence using data from 996 men who underwent RP for clinically localized PCa by a single surgeon (73% accuracy).11 External validation in an international cohort and in African-American men yielded accuracies of 80% (range, 77%-82%)73 and 83%,69 respectively. Stephenson et al updated the postoperative nomogram by including contemporary patients and extending predictions up to 10 years after radical surgery while accounting for disease-free interval (Fig. 3).47 External validation yielded an accuracy from 78% to 81%.47 Suardi et al developed the furthest reaching nomogram, which provides the probability of biochemical recurrence up to 20 years after RP. Their model's accuracy (77%-83%) was confirmed in 2 external validation cohorts, and the model provides conditional probabilities of biochemical recurrence after adjustment for disease-free interval.74

Figure 3. Postoperative nomogram predicting 10-year biochemical recurrence-free probability after radical prostatectomy (RP). Neg indicates negative; Pos, positive; Inv, invasion; PSA, prostate-specific antigen. Reproduced with permission from Stephenson AJ, Scardino PT, Eastham JA, et al. Postoperative nomogram predicting the 10-year probability of prostate cancer recurrence after radical prostatectomy. J Clin Oncol. 2005;23:7005-7012. Reprinted with permission. ©2008 American Society of Clinical Oncology. All rights reserved.
Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
Virtually all patients are interested in the projected efficacy of different treatment modalities. Therefore, pretreatment estimates of outcomes if patients receive either 3-dimensional, conformal, external-beam radiotherapy or brachytherapy are important in pretreatment counseling (Table 5). The original American Society for Therapeutic Radiology and Oncology definition of 3 consecutive increases in PSA for biochemical recurrence was used as the endpoint in all studies listed in Table 5.75 Kattan et al developed a pretreatment nomogram to predict the 5-year biochemical recurrence-free probability after 3-dimensional, conformal, external-beam radiotherapy (n = 1042 patients) (Fig. 4).76 External validation within a cohort of 912 men yielded an accuracy of 76%.77, 78

Figure 4. Pretreatment nomogram for predicting 5-year biochemical disease recurrence-free probability (Prob.) after 3-dimensional conformal radiotherapy. PSA indicates prostate-specific antigen; Bx, biopsy; Gy, grays. Reproduced with permission from Kattan MW, Zelefsky MJ, Kupelian PA, Scardino PT, Fuks Z, Leibel SA. Pretreatment nomogram for predicting the outcome of 3-dimensional conformal radiotherapy in prostate cancer. J Clin Oncol. 2000;18:3352-3359. Reprinted with permission. ©2008 American Society of Clinical Oncology. All rights reserved.
| Reference(s) | Prediction Form | Treatment | Outcome (Years) | No. of Patients | Variables | Accuracy, % | Validation |
|---|---|---|---|---|---|---|---|
| |||||||
| Duchesne 1996159 | Risk group | External-beam RT | Biochemical recurrence (5) | 85 | PSA, biopsy Gleason sum | Not available | Not performed |
| Pisansky 1997160 | Risk group | External-beam RT | Biochemical recurrence (5) | 500 | Biopsy Gleason sum, clinical stage, PSA | Not available | Internal |
| Zagars 1997161 | Probability graph | External-beam RT | Biochemical recurrence (6) | 938 | PSA, biopsy Gleason sum, clinical stage | Not available | Not performed |
| D'Amico 199916 | Probability table | External-beam RT | Biochemical recurrence (2) | 762 | Biopsy Gleason sum, clinical stage, PSA | Not available | Not performed |
| Shipley 1999162 | Probability table | External-beam RT | Biochemical recurrence (5) | 1607 | Biopsy Gleason sum, clinical stage, PSA | Not available | Not performed |
| Kattan 200076 | Probability nomogramdevelopment | External-beam RT | Biochemical recurrence (5) | 1042 and 1030 | PSA, biopsy Gleason sum, clinical stage, neoadjuvant androgen-deprivation therapy, radiation dose delivered | 73 | Internal |
| D'Amico 2002,77199878 | Probability graph | External-beam RT | Biochemical recurrence (5) | 766 | Biopsy Gleason sum, clinical stage, PSA, treatment modality | Not available | Internal |
| D'Amico 199878 | Probability graph | Brachytherapy | Biochemical recurrence (5) | 218 | Biopsy Gleason sum, clinical stage, PSA, neoadjuvant therapy | Not available | Not performed |
| Ragde 1998163 | Risk group | Brachytherapy | Biochemical recurrence (10) | 98 | Age, biopsy Gleason sum, clinical stage, PSA, 45-Gy external-beam RT | 76 | Internal |
| Kattan 200179 | Probability nomogram development | Brachytherapy | Biochemical recurrence (5) | 920, 1827, and 765 | Biopsy Gleason sum, clinical stage, PSA, coadministration of external-beam RT | 61 | Internal and external |
The same authors developed a model that predicts 5-year biochemical recurrence-free survival after 125I-seeds brachytherapy without adjuvant hormone therapy (n = 920 patients) (Fig. 5).79 Two separate external validations resulted in accuracies of 61% (n = 1827 patients) and 64% (n = 765 patients).

Figure 5. Pretreatment nomogram for predicting 5-year biochemical disease recurrence-free probability (Rec Free Prob.) after permanent prostate brachytherapy without neoadjuvant androgen ablative therapy. PSA indicates prostate-specific antigen; Gl. sum, Gleason sum; XRT, external-beam radiotherapy. Reproduced with permission from Kattan MW, Potters L, Blasko JC, et al. Pretreatment nomogram for predicting freedom from recurrence after permanent prostate brachytherapy in prostate cancer. Urology. 2001;58:393-399. ©2008, with permission from Elsevier and the Société Internationale d' Urologie.
Predicting Metastatic Disease Progression
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
To address metastatic progression after definitive therapy, Kattan et al developed a nomogram that quantifies the probability of metastatic progression within 5 years after external-beam radiotherapy (n = 1677 patients).80 Its external validation demonstrated an accuracy of 81% (n = 1626 patients). The tool can predict the likelihood of metastatic progression immediately after definitive therapy (Table 6).
| Reference(s) | Prediction Form | Patient Population | Outcome (Years) | No. of Patients | Variables | Accuracy, % | Validation |
|---|---|---|---|---|---|---|---|
| |||||||
| Partin 1994164 | Probability graph | RP | Local vs distant recurrence | 1058 | PSA velocity, Gleason sum, pathologic stage | Not available | Not performed |
| Pound 199970 | Probability table | Biochemical recurrence after RP | Metastasis (7 y after biochemical recurrence) | 315 | PSA doubling time, Gleason sum, time to biochemical recurrence | 56 | Not performed |
| D'Amico 2003165 | Probability graph | RP | Prostate cancer-specific mortality (8) | 4946 | Biopsy Gleason sum, clinical stage, PSA | Not available | Internal |
| Dotan 200581 | Probability nomogram development | Biochemical recurrence after RP | Positive bone scan | 239 | Pretreatment PSA, surgical margin status, seminal vesicle invasion, Gleason sum, trigger PSA, extracapsular extension, PSA slope, PSA velocity | 93 | Internal |
| Freedland 200571 | Probability table | Biochemical recurrence after RP | Cancer-specific survival (10 y after biochemical recurrence) | 379 | PSA doubling time, Gleason sum, time from surgery to biochemical recurrence | 59 | Not performed |
| D'Amico 2002166 and 2003167 | Probability graph | External-beam RT | Prostate cancer-specific mortality (10) | 381 | Biopsy Gleason sum, clinical stage, PSA, % positive biopsy | Not available | Internal |
| 94 | Time to PSA failure, posttreatment PSA doubling time, timing of salvage hormone therapy | Not available | Internal | ||||
| D'Amico 2003167 | Probability graph | External-beam RT | Prostate cancer-specific mortality (8) | 2370 | Biopsy Gleason sum, clinical stage, PSA | Not available | Internal |
| Kattan 200380 | Probability nomogram development | External-beam RT | Metastasis (5) | 1677 and 1626 | PSA, clinical stage, biopsy Gleason sum | 81 | Internal and external |
| Slovin 200582 | Probability nomogram development | External-beam RT | Metastasis (1-2) | 148 | Baseline PSA, PSA doubling time, pathologic T classification, Gleason sum | 69 | Not performed |
| Zhou 2005168 | Probability graph | External-beam RT | Prostate cancer-specific mortality (5) | 661 | PSA doubling time, biopsy Gleason sum | Not available | Internal |
| Stephenson 2007169 | Probability nomogram development | Salvage RT for biochemical recurrence after RP | Biochemical recurrence after radiotherapy (7 y after biochemical recurrence) | 1540 | Prostatectomy PSA, Gleason sum, seminal vesicle invasion, extracapsular extension, surgical margin status, LN metastasis, persistently elevated PSA after RP, pre-RT PSA, PSA doubling time, neoadjuvant androgen-deprivation therapy, radiation dose | 69 | Internal |
| Zhou 2005168 | Probability graph | Biochemical recurrence after RP | Prostate cancer-specific mortality (5) | 498 | PSA doubling time | Not available | Internal |
| Slovin 200582 | Probability nomogram development | Biochemical recurrence after RP or RT | Metastasis (1-2) | 148 | Baseline PSA, PSA doubling time, pathologic T classification, Gleason sum | 69 | Not performed |
| Svatek 2006170 | Probability nomogram development | Androgen-independent prostate cancer | Prostate cancer-specific mortality (1-5) | 129 | PSA at initiation of androgen-deprivation therapy, PSA doubling time, nadir PSA on androgen-deprivation therapy, time from androgen-deprivation therapy to androgen-independent prostate cancer | 81 | Internal |
| Smaletz 200284 | Probability nomogram development | Men with progressive metastatic prostate cancer after castration | Overall survival (1-2) | 409 and 433 | Age, Karnofsky performance index, hemoglobin, PSA, LDH, ALP, albumin | 71 | Internal and external |
| Porter 200783 | Probability nomogram development | Men on androgen-deprivation therapy after RP | Prostate cancer-specific mortality (2-5) | 66 | Pathologic T classification, Gleason sum, surgical margin status, age at androgen-deprivation therapy, recurrence type | 66 | Internal |
| Halabi 200385 | Probability nomogram development | Metastatic hormone-refractory prostate cancer | Overall survival (1-2) | 1101 | LDH, PSA, ALP, Gleason sum, ECOG performance status, hemoglobin, presence of visceral disease | 68 | Internal and external |
Dotan et al developed a nomogram for predicting the probability of metastatic progression, which they defined as a positive bone scan, in 239 men with a rising PSA after RP.81 The nomogram relies on detailed serum PSA characteristics, including kinetics, resulting in an accuracy of 93%. This nomogram requires multiple postrecurrence PSA values to allow the estimation and inclusion of PSA kinetics.
Slovin et al devised a similar nomogram for predicting the time to radiographically detectable metastases in patients with biochemical recurrence (n = 148) after either RP or external-beam radiotherapy. Similar to the nomogram described by Dotan et al, the nomogram described by Slovin et al requires the consideration of PSA kinetics in the form of PSADT and is limited to patients with PSADT values <.82 The predictive accuracy of this model was 69%, but it was validated neither internally nor externally.
Predicting Survival
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
Four nomograms have been devised for predicting survival in PCa patients (Table 6). Of these, 1 predicts cause-specific survival in PCa patients exposed to hormone therapy, regardless of the time of hormone therapy initiation. The remaining 3 nomograms predict the probability of all-cause survival in patients with androgen-insensitive PCa (AIPC).
Porter et al developed a nomogram for predicting cause-specific survival in patients who were exposed to hormone therapy after RP failure (n = 114 patients).83 The internally validated accuracy of their nomogram was only 66%. The nomograms of Smaletz et al84 and of Halabi et al85 were developed and externally validated in heavily pretreated patients with AIPC who had been exposed to 1 or several experimental agents. In external validation, the accuracies of the nomograms of Smaletz et al and Halabi et al were 67% and 68%, respectively.
Svatek et al devised a contemporary nomogram using a population with a median survival of 52 months who had not received experimental therapies. This nomogram relies predominantly on PSADT and PSA at hormone therapy initiation. Internal validation of this nomogram yielded an accuracy of 81%. The contemporaneous nature and homogeneity of the patient population make this model very attractive when survival needs to be assessed in patients with AIPC.
Predicting Life Expectancy
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
Life expectancy plays a crucial role in treatment considerations, especially in patients who are candidates for definitive therapy (Table 7). The 10-year rule of thumb generally is accepted as the minimal life-expectancy prerequisite for considering curative local treatment in men with PCa. Unfortunately, life tables are not reliable for predicting life expectancy in definitive therapy candidates and demonstrate only 60% accuracy.86 Moreover, clinicians also are poor raters of life expectancy, and 19 clinicians yielded only 69% accuracy. To circumvent this problem, Tewari et al (n = 3159 patients),87 Cowen et al (n = 506 patients),88 and Albertsen et al (n = 451 patients)43, 89 developed models that predict life expectancy in men with PCa. The accuracy of these models ranged from 69% to 73%. Unfortunately, none of the 3 models was capable of discerning between PCa-specific and all-cause mortality. To address these considerations, Walz et al devised a nomogram for predicting life expectancy in excess of 10 years in RP and external-beam radiotherapy candidates (n = 9131 patients).90 Their model focused on patients without evidence of recurrent cancer after definitive therapy. Its predictors consist of only age and comorbidities. Internal validation of this nomogram yielded 84% accuracy versus 81% for the model described by Tewari et al. On the basis of accuracy, simplicity, and generalizability, the model of Walz et al appears to provide the best estimates of life expectancy in excess of 10 years.
| Reference | Prediction form | Patient Population | Outcome | No. of Patients | Variables | Accuracy, % | Validation |
|---|---|---|---|---|---|---|---|
| |||||||
| Albertson 199689 | Probability formula | Clinically localized prostate cancer | Overall survival, 10 y | 451 | Age, Gleason sum, index of coexistent disease category | 71 | Not performed |
| Tewari 200487 | Probability graph | Clinically localized prostate cancer | Overall survival, 10 y | 6149 | Age, race, comorbidity, PSA, Gleason sum, treatment type | 63 | Not performed |
| Cowen 200688 | Probability nomogram development | Clinically localized prostate cancer | Life expectancy, 5-15 y | 506 | Age, Charlson comorbidity index, presence of angina, systolic blood pressure, body mass index, smoking, marital status, PSA, Gleason sum, clinical stage, treatment type (RP vs RT vs other) | 73 | Internal |
| Walz 200790 | Probability nomogram development | Clinically localized prostate cancer | Life expectancy, 10 y | 9131 (RP, 5955; external-beam RT, 3176) | Age, Charlson comorbidity index, treatment type (RP vs external-beam RT) | 84.3 | Internal |
Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
The accuracy of current predictive tools still is not perfect. To date, the addition of other potentially informative clinical and pathologic features has not improved the accuracy of these models significantly.91, 92 The incorporation of novel biomarkers and/or imaging tools that are associated with the biologic behavior of PCa potentially may improve predictive accuracy (Table 8). Despite numerous reports of promising new biomarkers in the urologic literature, to our knowledge only 3 studies to date have demonstrated a statistically significant improvement in predictive accuracy when biomarkers were added to established predictors in the nomogram setting (for example, see Fig. 6).33, 93, 94

Figure 6. Pretreatment nomogram for predicting 5-year biochemical disease recurrence-free probability after radical prostatectomy, including preoperative plasma levels of transforming growth factor β1 (TGFβ1) and interleukin-6 soluble receptor (IL6R). PSA indicates prostate-specific antigen; Bx, biopsy; GG, Gleason grade; Preop, preoperative; Prog Free Prob, progression-free probability. Reproduced with permission from Kattan MW, Shariat SF, Andrews B, et al. The addition of interleukin-6 soluble receptor and transforming growth factor beta1 improves a preoperative nomogram for predicting biochemical progression in patients with clinically localized prostate cancer. J Clin Oncol. 2003;21:3573-3579. Reprinted with permission. ©2008 American Society of Clinical Oncology. All rights reserved.
| Reference | Prediction Form | Operative Status | Novel Variable(s) | Outcome | No. of Patients | Variables | Accuracy, % | Validation |
|---|---|---|---|---|---|---|---|---|
| ||||||||
| Wang 200650 | Probability nomogram development | Preoperative | MRI and MRSI | LN invasion | 411 | MRI variables and Partin probability table (Partin 199719) | 89 | Internal |
| Wang 2007549 | Probability nomogram development | Preoperative | MRI and MRSI | Seminal vesicle invasion | 573 | MRI variables and preoperative Kattan probability nomogram (Kattan 199810) | 87 | Internal |
| Shukla-Dave 200795 | Probability nomogram development | Preoperative | MRI and MRSI | Insignificant cancer (organ-confined cancer ≤0.5 cm3 with no poorly differentiated elements) | 220 | Pretreatment PSA, clinical stage, biopsy cores positive, pretreatment MRI volume of prostate, and overall MRI/MRSI score | 85 | Internal |
| Kattan 200333 | Probability nomogram development | Preoperative | Plasma levels of TGF-β1 and IL-6 soluble receptor | Biochemical recurrence | 714 | Preoperative plasma TGF-β1 and IL-6 soluble receptor and preoperative Kattan probability nomogram (Kattan 199810) | 83 | Internal |
| Stephenson 200593 | Probability nomogram development | Postoperative | Gene expression based on oligonucleotide microarrays | Biochemical recurrence | 79 | Gene expression signatures and postoperative Kattan probability nomogram (Kattan 199911) | 89 | Internal |
| Shariat 200794 | Probability nomogram development | Preoperative | Plasma levels of plasminogen activator inhibitor 1 | Biochemical recurrence | 429 | Preoperative plasma plasminogen activator inhibitor 1 and preoperative Kattan probability nomogram (Kattan 199810) | 79 | Internal |
Noninvasive diagnostic imaging, especially magnetic resonance imaging and magnetic resonance spectroscopic imaging, has improved in recent years and is gaining widespread acceptance for aiding PCa diagnosis, tumor localization, staging, assessment of tumor aggressiveness, and treatment planning. Investigators have used nomogram and neural network modeling to predict organ-confined PCa,49 clinically significant disease,95 and biochemical recurrence after RP.96
DISCUSSION
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
The paucity of randomized trials in PCa makes diagnostic and treatment decisions complex. Decision rules such as nomograms provide evidence-based and, at the same time, individualized predictions of the outcome of interest. It has been demonstrated repeatedly that such predictions are more accurate than those of clinicians, regardless of their level of expertise. Nomograms have been embraced by the urologic community. The nomogram format also has been adopted in several other disciplines of oncology, such as breast, colon, bladder, gastric, and lung cancers.
The exponential growth of new nomograms prompted some criticisms. The fundamental issue raised by critiques of predictive tools is their usefulness. Indeed, limited data exist with respect to the impact of predictive tools on medical decision making. It has been demonstrated that decision aids, which can include prediction models, improve patient knowledge and affect decision-making behavior97; however, to our knowledge the actual patient outcome after the intervention of a predictive tool is unknown. In this respect, the role of predictive tools has yet to be proven. A clinical trial that established the effect of nomograms on patient medical decision making would be very valuable; however, informing patients with predictions regarding the impact of a medical procedure appears to be ethical, whereas withholding accurate outcome predictions from patients to achieve equipoise in a randomized trial in which the control arm lacks this information does not appear to be ethical. Currently, patients are using very limited information when making their decisions, and direct outcome predictions are the simplest factors for them to consider; decision making is facilitated when patients can see tailored predictions of their outcomes with various alternatives.
In addition to improved medical decision making, accurate risk estimates are also required for the evaluation of novel markers33, 98 and clinical trial design to ensure that homogeneous, high-risk patient groups are used to investigate new cancer therapeutics. Prediction models have the potential of improving the ability of phase 2 trials to discriminate between ineffective and potentially effective therapy. As in the majority of phase 2 trials, both the expected response rate from standard care and the actual response rate of novel therapy are group-level estimates: The researchers simply take the number of patients who respond and divide by the total treated to get a proportion. This takes no account of individual patient characteristics and, thus, implicitly assumes similarity of trial patients and historic controls. However, trial patients may differ from controls in terms of performance status, prior experience of chemotherapy, extent of disease, or other prognostic factors. Apparently promising or disappointing results from a phase 2 treatment trial merely may be the result of such differences.99 For phase 3 trials, prediction models can help to ensure that eligible patients are at sufficient levels of high risk, thereby increasing event rates and reducing sample size requirements. Risk-prediction models define high-risk patients more accurately than risk-grouping strategies. The use of risk predictions for individual patients, therefore, decreases the proportion of low-risk patients enrolled, avoiding unethical inclusion and increasing statistical power. Finally, future designs of phase 3 trials should include prediction models to increase the clinical utility of their findings.
The results of such trials typically are applied by citing the average group-level effect. However, the use of a risk-prediction model may indicate that a patient's true risk was substantially different from the group-level estimate. This could lead a patient to make a different decision regarding treatment. Predictions models, as discussed above, have greater value to the clinician for counseling individual patients, because prediction models discriminate between high-risk and low-risk patients more accurately than traditional subgroups, which are based only on risk factors. Therefore, we recommend the wider adoption of risk-prediction models in the design, analysis, and implementation of clinical trials. The electronic versions of many of the nomograms described in this report are available online at www.nomograms.org or at www.nomogram.org, accessed on January 12, 2008. On both sites, the tools are organized according to the disease stages of PCa.
Many more nomograms, as well as improvements to existing nomograms, are needed. For example, none of the nomograms predicts with perfect accuracy. Novel biomarkers, larger datasets, systematic and clean data collection, and more sophisticated modeling procedures are needed to improve predictive accuracy. Provider-specific or center-specific models may possibly increase the specificity and accuracy of nomograms further.
Conclusions
Despite their limitations and the limitations of data, predictive tools are difficult to beat for individualized, evidence-based medical decision making. Increasingly, patients, administrators, peers, and third-party payers demand to have an objective justification for nearly all clinical decisions. Evidence-based predictive tools can provide individualized estimates for several endpoints in urologic oncology. Moreover, when determining the usefulness of nomograms, many patients want to know their likely outcomes, and most clinicians would prefer to provide accurate estimates of those outcomes. When a nomogram is available, little else is able to make more accurate predictions of outcome, and this confirms the usefulness of nomograms. Predictive tools have empowered patients and physicians in their fight against PCa by providing highly accurate, reproducible, evidence-based, yet individualized disease-related risk estimations that facilitate management-related decisions.
REFERENCES
- Top of page
- Abstract
- Evaluating Predictive Tools
- Limitations of Predictive and Prognostic Tools
- Catalogue of Available Predictive Tools
- Staging Nomograms
- Predicting Biochemical Recurrence After Radical Prostatectomy
- Predicting Biochemical Recurrence After External-beam Radiotherapy or Brachytherapy
- Predicting Metastatic Disease Progression
- Predicting Survival
- Predicting Life Expectancy
- Nomograms of the Future—Inclusion of Novel Biomarkers and Imaging Tools
- DISCUSSION
- REFERENCES
- 1,,,,,. Cancer statistics, 2007. CA Cancer J Clin. 2007; 57: 43–66.Direct Link:
- 2,,. Recall and attitudes in patients with prostate cancer. Urology. 1999; 53: 169–174.
- 3,,. Living with treatment decisions: regrets and quality of life among men treated for metastatic prostate cancer. J Clin Oncol. 2001; 19: 72–80.
- 4. Heuristics and biases: selected errors in clinical reasoning. Acad Med. 1999; 74: 791–794.
- 5,. Game relativity: how context influences strategic decision making. J Exp Psychol Learn Mem Cogn. 2006; 32: 131–149.
- 6,. Heuristic and linear models of judgment: matching rules and environments. Psychol Rev. 2007; 114: 733–758.
- 7
- 8,,. A catalog of prostate cancer nomograms. J Urol. 2001; 165: 1562–1568.
- 9,,, et al. A critical appraisal of logistic regression-based nomograms, artificial neural networks, classification and regression-tree models, look-up tables and risk-group stratification models for prostate cancer. BJU Int. 2007; 99: 794–800.Direct Link:
- 10,,,,. A preoperative nomogram for disease recurrence following radical prostatectomy for prostate cancer. J Natl Cancer Inst. 1998; 90: 766–771.
- 11,,. Postoperative nomogram for disease recurrence after radical prostatectomy for prostate cancer. J Clin Oncol. 1999; 17: 1499–1507.
- 12,,,,. Predicting nonsentinel node status after positive sentinel lymph biopsy for breast cancer: clinicians versus nomogram. Ann Surg Oncol. 2005; 12: 654–659.
- 13,,, et al. Clinicians are poor raters of life-expectancy before radical prostatectomy or definitive radiotherapy for localized prostate cancer. BJU Int. 2007; 100: 1254–1258.Direct Link:
- 14,,, et al. The combination of preoperative prostate specific antigen and postoperative pathological findings to predict prostate specific antigen outcome in clinically localized prostate cancer. J Urol. 1998; 160(6 pt 1): 2096–2101.
- 15,,, et al. Clinical utility of the percentage of positive prostate biopsies in predicting prostate cancer-specific and overall survival after radiotherapy for patients with localized prostate cancer. Int J Radiat Oncol Biol Phys. 2002; 53: 581–587.
- 16,,, et al. Pretreatment nomogram for prostate-specific antigen recurrence after radical prostatectomy or external-beam radiation therapy for clinically localized prostate cancer. J Clin Oncol. 1999; 17: 168–172.
- 17,,, et al. Combination of the preoperative PSA level, biopsy Gleason score, percentage of positive biopsies, and MRI T-stage to predict early PSA failure in men with clinically localized prostate cancer. Urology. 2000; 55: 572–577.
- 18,,. Artificial neural networks in the diagnosis and prognosis of prostate cancer: a pilot study. J Urol. 1994; 152(5 pt 2): 1923–1926.
- 19,,, et al. Combination of prostate-specific antigen, clinical stage, and Gleason score to predict pathological stage of localized prostate cancer. A multi-institutional update [see comments] [published erratum appears in JAMA. 1997;278:118]. JAMA. 1997; 277: 1445–1451.
- 20,,, et al. Updated nomogram to predict pathologic stage of prostate cancer given prostate-specific antigen level, clinical stage, and biopsy Gleason score (Partin tables) based on cases from 2000 to 2005. Urology. 2007; 69: 1095–1101.
- 21,,, et al. Prospective validation of an algorithm with systematic sextant biopsy to predict pelvic lymph node metastasis in patients with clinically localized prostatic carcinoma. J Urol. 2002; 167(2 pt 1): 521–525.
- 22,,, et al. A validated strategy for side specific prediction of organ confined prostate cancer: a tool to select for nerve sparing radical prostatectomy. J Urol. 2001; 165: 857–863.
- 23
- 24,. Monographs on Statistics and Applied Probability: An Introduction to the Bootstrap. Boca Raton, Fla: Chapman & Hall/CRC; 1993.
- 25. Comparison of Cox regression with othermethods for determining prediction models and nomograms. J Urol. 2003; 170(6 pt 2): S6–S9; discussion S10.
- 26,,,,. Internal and external validation of predictive models: a simulation study of bias and precision in small samples. J Clin Epidemiol. 2003; 56: 441–447.
- 27,,,,,. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001; 54: 774–781.
- 28,,. Neural networks, logistic regression, and calibration. Med Decis Making. 1998; 18: 349–350.
- 29,,,,,. Prediction of indolent prostate cancer: validation and updating of a prognostic nomogram. J Urol. 2007; 177: 107–112; discussion 112.
- 30,,, et al. Differences in the rate of lymph node invasion in men with clinically localized prostate cancer might be related to the continent of origin. BJU Int. 2007; 100: 528–532.Direct Link:
- 31,,, et al. Nomograms provide improved accuracy for predicting survival after radical cystectomy. Clin Cancer Res. 2006; 12: 6663–6676.
- 32. Nomograms are superior to staging and risk grouping systems for identifying high-risk patients: preoperative application in prostate cancer. Curr Opin Urol. 2003; 13: 111–116.
- 33,,, et al. The addition of interleukin-6 soluble receptor and transforming growth factor beta1 improves a preoperative nomogram for predicting biochemical progression in patients with clinically localized prostate cancer. J Clin Oncol. 2003; 21: 3573–3579.
- 34,,, et al. Initial biopsy outcome prediction—head-to-head comparison of a logistic regression-based nomogram versus artificial neural network. Eur Urol 2007; 51: 1236–1240; discussion 1241-1243.
- 35,,,. Postoperative nomogram for disease-specific survival after an R0 resection for gastric carcinoma. J Clin Oncol. 2003; 21: 3647–3650.
- 36,,. Postoperative nomogram for 12-year sarcoma-specific death. J Clin Oncol. 2002; 20: 791–796.
- 37,,, et al. Validation of a nomogram predicting the probability of lymph node invasion based on the extent of pelvic lymphadenectomy in patients with clinically localized prostate cancer. BJU Int. 2006; 98: 788–793.Direct Link:
- 38,,, et al. Development and split-sample validation of a nomogram predicting the probability of seminal vesicle invasion at radical prostatectomy. Eur Urol. 2007; 52: 98–105.
- 39,,. Validation of a nomogram for prediction of side specific extracapsular extension at radical prostatectomy. J Urol. 2006; 175(3 pt 1): 939–944; discussion 944.
- 40. Comparison of artificial neural networks with other statistical approaches: results from medical data sets. Cancer. 2001; 91( 8 suppl): 1636–1642.Direct Link:
- 41
- 42,,,,. External validity of predictive models: a comparison of logistic regression, classification trees, and neural networks. J Clin Epidemiol. 2003; 56: 721–729.
- 43,,,. Competing risk analysis of men aged 55 to 74 years at diagnosis managed conservatively for clinically localized prostate cancer. JAMA. 1998; 280: 975–980.
- 44,,, et al. A tool for predicting breast carcinoma mortality in women who do not receive adjuvant therapy. Cancer. 2004; 101: 2509–2515.Direct Link:
- 45,,. A competing-risks nomogram for sarcoma-specific death following local recurrence. Stat Med. 2003; 22: 3515–3525.Direct Link:
- 46,,. A comparison of cause of death determination in men previously diagnosed with prostate cancer who died in 1985 or 1995. J Urol. 2000; 163: 519–523.
- 47,,, et al. Postoperative nomogram predicting the 10-year probability of prostate cancer recurrence after radical prostatectomy. J Clin Oncol. 2005; 23: 7005–7012.
- 48,,, et al. Preoperative nomogram predicting the 10-year probability of prostate cancer recurrence after radical prostatectomy. J Natl Cancer Inst. 2006; 98: 715–717.
- 49,,, et al. Prediction of seminal vesicle invasion in prostate cancer: incremental value of adding endorectal MR imaging to the Kattan nomogram. Radiology. 2007; 242: 182–188.
- 50,,, et al. Combined endorectal and phased-array MRI in the prediction of pelvic lymph node metastasis in prostate cancer. AJR Am J Roentgenol. 2006; 186: 743–748.
- 51,,,,. Development of a nomogram that predicts the probability of a positive prostate biopsy in men with an abnormal digital rectal examination and a prostate-specific antigen between 0 and 4 ng/mL. Urology. 1999; 54: 709–713.
- 52,,, et al. Development and external validation of an extended 10-core biopsy nomogram. Eur Urol. 2007; 52: 436–445.
- 53,,,,,. A nomogram for predicting a positive repeat prostate biopsy in patients with a previous negative biopsy session. J Urol. 2003; 170(4 pt 1): 1184–1188; discussion 1188.
- 54,,,. Validation of a nomogram for predicting positive repeat biopsy for prostate cancer. J Urol. 2005; 173: 421–424.
- 55,,, et al. Development and external validation of an extended repeat biopsy nomogram. J Urol. 2007; 177: 510–515.
- 56,,,,,. How well does the Partin nomogram predict pathological stage after radical prostatectomy in a community based population? Results of the cancer of the prostate strategic urological research endeavor. J Urol. 2002; 167: 1653–1657; discussion 1657-1658.
- 57,,, et al. Comparison of accuracy between the Partin tables of 1997 and 2001 to predict final pathological stage in clinically localized prostate cancer. J Urol. 2004; 171: 177–181.
- 58,,,,,. Contemporary update of prostate cancer staging nomograms (Partin tables) for the new millennium. Urology. 2001; 58: 843–848.
- 59,,, et al. Predicting the presence and side of extracapsular extension: a nomogram for staging prostate cancer. J Urol. 2004; 171: 1844–1849; discussion 1849.
- 60,,, et al. A nomogram to predict seminal vesicle invasion by the extent and location of cancer in systematic biopsy results. J Urol. 2003; 170(4 pt 1): 1203–1208.
- 61,,, et al. A preoperative nomogram identifying decreased risk of positive pelvic lymph nodes in patients with prostate cancer. J Urol. 2003; 170: 1798–1803.
- 62,,, et al. Validation of a nomogram predicting the probability of lymph node invasion among patients undergoing radical prostatectomy and an extended pelvic lymphadenectomy. Eur Urol. 2006; 49: 1019–1026; discussion 1026-1027.
- 63,,, et al. A nomogram for staging of exclusive nonobturator lymph node metastases in men with localized prostate cancer. Eur Urol. 2007; 51: 112–119; discussion 119-120.
- 64,,, et al. Natural history of early, localized prostate cancer. JAMA. 2004; 291: 2713–2719.
- 65,,, et al. Counseling men with prostate cancer: a nomogram for predicting the presence of small, moderately differentiated, confined tumors. J Urol. 2003; 170: 1792–1797.
- 66,,,. Small high grade adenocarcinoma of the prostate in radical prostatectomy specimens performed for nonpalpable disease: pathogenetic and clinical implications. J Urol. 1994; 151: 1587–1592.
- 67,,, et al. A validation of 2 preoperative nomograms predicting recurrence following radical prostatectomy in a cohort of European men. Urol Oncol. 2002; 7: 141–146.
- 68,,, et al. International validation of a preoperative nomogram for prostate cancer recurrence after radical prostatectomy. J Clin Oncol. 2002; 20: 3206–3212.
- 69,,,,,. Radical prostatectomy nomograms in black American men: accuracy and applicability. J Urol. 2003; 170: 73–76; discussion 76-77.
- 70,,,,,. Natural history of progression after PSA elevation following radical prostatectomy [see comments]. JAMA. 1999; 281: 1591–1597.
- 71,,, et al. Risk of prostate cancer-specific mortality following biochemical recurrence after radical prostatectomy. JAMA. 2005; 294: 433–439.
- 72,,,,,. Cancer control with radical prostatectomy alone in 1,000 consecutive patients. J Urol. 2002; 167(2 pt 1): 528–534.
- 73,,, et al. Validation study of the accuracy of a postoperative nomogram for recurrence after radical prostatectomy for localized prostate cancer. J Clin Oncol. 2002; 20: 951–956.
- 74,,, et al. A nomogram predicting long-term biochemical recurrence after radical prostatectomy. Cancer. 2008; 112: 1254–1263.Direct Link:
- 75[No authors listed] Consensus statement: guidelines for PSA following radiation therapy. American Society for Therapeutic Radiology and Oncology Consensus Panel. Int J Radiat Oncol Biol Phys. 1997; 37: 1035–1041.
- 76,,,,,. Pretreatment nomogram for predicting the outcome of 3-dimensional conformal radiotherapy in prostate cancer. J Clin Oncol. 2000; 18: 3352–3359.
- 77,,, et al. Biochemical outcome after radical prostatectomy or external beam radiation therapy for patients with clinically localized prostate carcinoma in the prostate specific antigen era. Cancer. 2002; 95: 281–286.Direct Link:
- 78,,, et al. Biochemical outcome after radical prostatectomy, external beam radiation therapy, or interstitial radiation therapy for clinically localized prostate cancer. JAMA. 1998; 280: 969–974.
- 79,,, et al. Pretreatment nomogram for predicting freedom from recurrence after permanent prostate brachytherapy in prostate cancer. Urology. 2001; 58: 393–399.
- 80,,, et al. Pretreatment nomogram that predicts 5-year probability of metastasis following 3-dimensional conformal radiation therapy for localized prostate cancer. J Clin Oncol. 2003; 21: 4568–4571.
- 81,,, et al. Pattern of prostate-specific antigen (PSA) failure dictates the probability of a positive bone scan in patients with an increasing PSA after radical prostatectomy. J Clin Oncol. 2005; 23: 1962–1968.
- 82,,,. Time to detectable metastatic disease in patients with rising prostate-specific antigen values following surgery or radiation therapy. Clin Cancer Res. 2005; 11(24 pt 1): 8669–8673.
- 83,,, et al. Prostate cancer-specific survival in men treated with hormonal therapy after failure of radical prostatectomy. Eur Urol. 2007; 52: 446–454.
- 84,,, et al. Nomogram for overall survival of patients with progressive metastatic prostate cancer after castration. J Clin Oncol. 2002; 20: 3972–3982.
- 85,,, et al. Prognostic model for predicting survival in men with hormone-refractory metastatic prostate cancer. J Clin Oncol. 2003; 21: 1232–1237.
- 86,,, et al. Accuracy of life tables in predicting overall survival in candidates for radiotherapy for prostate cancer. Int J Radiat Oncol Biol Phys. 2007; 69: 88–94.
- 87,,, et al. Long-term survival probability in men with clinically localized prostate cancer: a case-control, propensity modeling study stratified by race, age, treatment and comorbidities. J Urol. 2004; 171: 1513–1519.
- 88,,. Predicting life expectancy in men with clinically localized prostate cancer. J Urol. 2006; 175: 99–103.
- 89,,,,. The impact of co-morbidity on life expectancy among men with localized prostate cancer. J Urol. 1996; 156: 127–132.
- 90,,, et al. A nomogram predicting 10-year life expectancy in candidates for radical prostatectomy or radiotherapy for prostate cancer. J Clin Oncol. 2007; 25: 3576–3581.
- 91,,, et al. Tumour volume and high grade tumour volume are the best predictors of pathologic stage and biochemical recurrence after radical prostatectomy. Eur J Cancer. 2007; 43: 536–543.
- 92,,, et al. Obesity does not predispose to more aggressive prostate cancer either at biopsy or radical prostatectomy in European men. Int J Cancer. 2007; 121: 791–795.Direct Link:
- 93,,, et al. Integration of gene expression profiling and clinical variables to predict prostate carcinoma recurrence after radical prostatectomy. Cancer. 2005; 104: 290–298.Direct Link:
- 94,,,,,. Plasminogen activation inhibitor-1 improves the predictive accuracy of prostate cancer nomograms. J Urol. 2007; 178(4 pt 1): 1229–1238; discussion 1236-1237.
- 95,,, et al. The utility of magnetic resonance imaging and spectroscopy for predicting insignificant prostate cancer: an initial analysis. BJU Int. 2007; 99: 786–793.Direct Link:
- 96,,, et al. Preoperative neural network using combined magnetic resonance imaging variables, prostate-specific antigen, and Gleason score for predicting prostate cancer biochemical recurrence after radical prostatectomy. Urology. 2004; 64: 1165–1170.
- 97. Do shared decision making programs work? A systematic overview. Med Decis Making. 1999; 11: 523.
- 98. Judging new markers by their ability to improve predictive accuracy. J Natl Cancer Inst. 2003; 95: 634–635.
- 99. The phase III candidate: can we improve the science of selection? J Clin Oncol. 2004; 22: 211–213.
- 100,,,,,. Evaluation of prostAsure index in the detection of prostate cancer: a preliminary report. Urology. 1998; 51: 132–136.
- 101,,,. Estimation of prostate cancer probability by logistic regression: free and total prostate-specific antigen, digital rectal examination, and heredity are significant variables. Clin Chem. 1999; 45: 987–994.
- 102,,, et al. Predicting the outcomeof prostate biopsy in screen-positive men by a multilayer perceptron network. Urology. 2000; 56: 418–422.
- 103,,,,. The problem of cutoff levels in a screened population: appropriateness of informing screenees about their risk of having prostate carcinoma. Cancer. 2001; 91( 8 suppl): 1667–1672.Direct Link:
- 104,,, et al. A neurocomputational model for prostate carcinoma detection. Cancer. 2003; 98: 1849–1854.Direct Link:
- 105,,, et al. Predictive modeling for the presence of prostate carcinoma using clinical, laboratory, and ultrasound parameters in patients with prostate specific antigen levels < or = 10 ng/mL. Cancer. 2003; 98: 1417–1422.Direct Link:
- 106,,, et al. Algorithms based on prostate-specific antigen (PSA), free PSA, digital rectal examination and prostate volume reduce false-positive PSA results in prostate cancer screening. Int J Cancer. 2004; 111: 310–315.Direct Link:
- 107,,, et al. Development and validation of a nomogram predicting the outcome of prostate biopsy based on patient age, digital rectal examination and serum prostate specific antigen. J Urol. 2005; 173: 1930–1934.
- 108,,, et al. Model to predict prostate biopsy outcome in large screening population with independent validation in referral setting. Urology. 2005; 65: 937–941.
- 109,,, et al. Development of a nomogram to predict probability of positive initial prostate biopsy among Japanese patients. Urology. 2006; 67: 131–136.
- 110,,,. Analysis of repeated biopsy results within 1 year after a noncancer diagnosis. Urology. 2000; 55: 553–559.
- 111,,, et al. An artificial neural network to predict the outcome of repeat prostate biopsies. Urology. 2003; 62: 456–460.
- 112,,, et al. High incidence of prostate cancer detected by saturation biopsy after previous negative biopsy series. Eur Urol. 2006; 50: 498–505.
- 113,,. An algorithm combining age, total prostate-specific antigen (PSA), and percent free PSA to predict prostate cancer: results on 4298 cases. Urology. 1998; 52: 455–461.
- 114,,,,,. Novel artificial neural network for early detection of prostate cancer. J Clin Oncol. 2002; 20: 921–929.
- 115,,, et al. Multicenter evaluation of an artificial neural network to increase the prostate cancer detection rate and reduce unnecessary biopsies. Clin Chem. 2002; 48: 1279–1287.
- 116,,, et al. Predicting the outcome of prostate biopsy in a racially diverse population: a prospective study. Urology. 2002; 60: 831–835.
- 117,,, et al. The use of artificial neural network analysis to improve the predictive accuracy of prostate biopsy in the Japanese population. Jpn J Clin Oncol. 2004; 34: 602–607.
- 118. Neuro-fuzzy system for prostate cancer diagnosis. Urology. 2006; 68: 357–361.
- 119,,, et al. African-American race is a predictor of prostate cancer detection: incorporation into a pre-biopsy nomogram. BJU Int. 2006; 98: 783–787.Direct Link:
- 120,,, et al. The role of transrectal ultrasound-guided biopsy-based staging, preoperative serum prostate-specific antigen, and biopsy Gleason score in prediction of final pathologic diagnosis in prostate cancer. Urology. 1995; 46: 205–212.
- 121,,, et al. The use of prostate specific antigen, clinical stage and Gleason score to predict pathological stage in men with localized prostate cancer [see comments]. J Urol. 1993; 150: 110–114.
- 122,,,. Evaluation of a nomogram used to predict the pathologic stage of clinically localized prostate carcinoma. Cancer. 1997; 79: 528–537.Direct Link:
- 123,,. Validation of Partin tables for predicting pathological stage of clinically localized prostate cancer. J Urol. 2000; 164: 1591–1595.
- 124,,,. Pathologic and clinical findings to predict tumor extent of nonpalpable (stage T1c) prostate cancer. JAMA. 1994; 271: 368–374.
- 125,. Prediction of significant cancer in men with stage T1c adenocarcinoma of the prostate. World J Urol. 1997; 15: 359–363.
- 126,,,,,. Distinguishing clinically important from unimportant prostate cancers before treatment: value of systematic biopsies. J Urol. 1996; 156: 1059–1063.
- 127,,, et al. Development and internal validation of a nomogram predicting the probability of prostate cancer Gleason sum upgrading between biopsy and radical prostatectomy pathology. Eur Urol. 2006; 49: 820–826.
- 128,,, et al. Significant upgrading affects a third of men diagnosed with prostate cancer: predictive nomogram and internal validation. BJU Int. 2006; 98: 329–334.Direct Link:
- 129,,, et al. Development and internal validation of preoperative transition zone prostate cancer nomogram. Urology. 2006; 68: 1295–1300.
- 130,,,,. Sextant prostate biopsies. A histopathologic correlation with radical prostatectomy specimens. Cancer. 1995; 75: 530–538.Direct Link:
- 131,,,,. Analysis of risk factors associated with prostate cancer extension to the surgical margin and pelvic node metastasis at radical prostatectomy. J Urol. 1993; 150: 1845–1850.
- 132,,. Site specific predictors of positive margins at radical prostatectomy: an argument for risk based modification of technique. J Urol. 1998; 160: 1727–1733.
- 133,,, et al. Prediction of capsular perforation and seminal vesicle invasion in prostate cancer. J Urol. 1996; 155: 1361–1367.
- 134
- 135,,, et al. Predicting extracapsular extension of prostate cancer in men treated with radical prostatectomy: results from the population based Prostate Cancer Outcomes Study. J Urol. 1999; 162: 1341–1345.
- 136,,,,. Prediction of prostate carcinoma stage by quantitative biopsy pathology. Cancer. 2001; 91: 2322–2328.Direct Link:
- 137,,, et al. Quantitative biopsy pathology for the prediction of pathologically organ-confined prostate carcinoma: a multiinstitutional validation study. Cancer. 2003; 97: 969–978.Direct Link:
- 138,,, et al. An algorithm for predicting nonorgan confined prostate cancer using the results obtained from sextant core biopsies with prostate specific antigen level. J Urol. 1996; 156: 1375–1380.
- 139,,,,,. Correlation of pretherapy prostate cancer characteristics with seminal vesicle invasion in radical prostatectomy specimens. Int J Radiat Oncol Biol Phys. 1996; 36: 585–591.
- 140,,,,,. Complete resection of seminal vesicles at radical prostatectomy results in substantial long-term disease-free survival: multi-institutional study of 6740 patients. Urology. 2007; 69: 536–540.
- 141,,, et al. Predicting the risk of lymph node involvement using the pre-treatment prostate specific antigen and Gleason score in men with clinically localized prostate cancer. Int J Radiat Oncol Biol Phys. 1994; 28: 33–37.
- 142,,,. Eliminating the need for bilateral pelvic lymphadenectomy in select patients with prostate cancer. J Urol. 1994; 151: 1315–1320.
- 143,,, et al. Artificial neural network model for the assessment of lymph node spread in patients with clinically localized prostate cancer. Urology. 2001; 57: 481–485.
- 144,,, et al. Percentage of positive biopsy cores can improve the ability to predict lymph node invasion in patients undergoing radical prostatectomy and extended pelvic lymph node dissection. Eur Urol. 2007; 51: 1573–1581.
- 145,,, et al. Validation of the Kattan preoperative nomogram for prostate cancer recurrence using a community based cohort: results from Cancer of the Prostate Strategic Urological Research Endeavor (CaPSURE). J Urol. 2004; 171(6 pt 1): 2255–2259.
- 146,,, et al. [Can nomograms derived in the US applied to German patients? A study about the validation of preoperative nomograms predicting the risk of recurrence after radical prostatectomy]. Urologe A. 2003; 42: 685–692.
- 147,,, et al. Early prostate-specific antigen relapse after radical retropubic prostatectomy: prediction on the basis of preoperative and postoperative tumor characteristics. Eur Urol. 1999; 36: 21–30.
- 148,,, et al. Genetic adaptive neural network to predict biochemical failure after radical prostatectomy: a multi-institutional study. Mol Urol. 2001; 5: 163–169.
- 149,,, et al. Ability of 2 pretreatment risk assessment methods to predict prostate cancer recurrence after radical prostatectomy: data from CaPSURE. J Urol. 2005; 173: 1126–1131.
- 150,,, et al. The University of California, San Francisco Cancer of the Prostate Risk Assessment score: a straightforward and reliable preoperative predictor of disease recurrence after radical prostatectomy. J Urol. 2005; 173: 1938–1942.
- 151,,, et al. Multiinstitutional validation of the UCSF Cancer of the Prostate Risk Assessment for prediction of recurrence after radical prostatectomy. Cancer. 2006; 107: 2384–2391.Direct Link:
- 152,,, et al. Validity of the CAPRA score to predict biochemical recurrence-free survival after radical prostatectomy. Results from a European multicenter survey of 1296 patients. J Urol. 2007; 178: 1957–1962; discussion 1962.
- 153,,, et al. Biostatistical modeling using traditional preoperative and pathological prognostic variables in the selection of men at high risk for disease recurrence after radical prostatectomy for prostate cancer. J Urol. 1998; 159: 929–933.
- 154,,, et al. Predicting risk of prostate specific antigen recurrence after radical prostatectomy with the Center for Prostate Disease Research and Cancer of the Prostate Strategic Urologic Research Endeavor databases. J Urol. 2001; 166: 1322–1327.
- 155,,, et al. Genetically engineered neural networks for predicting prostate cancer progression after radical prostatectomy. Urology. 1999; 54: 791–795.
- 156,. An analysis of risk factors for biochemical progression in patients with seminal vesicle invasion: validation of Kattan's nomogram in a pathological subgroup. BJU Int. 2004; 93: 961–964.Direct Link:
- 157,,,,. Prostate cancer is highly predictable: a prognostic equation based on all morphological variables in radical prostatectomy specimens. J Urol. 2000; 163: 1155–1160.
- 158,,, et al. PSA outcome following radical prostatectomy for patients with localized prostate cancer stratified by prostatectomy findings and the preoperative PSA level. Urol Oncol. 2005; 23: 311–317.
- 159,,. Identification of intermediate-risk prostate cancer patients treated with radiotherapy suitable for neoadjuvant hormone studies. Radiother Oncol. 1996; 38: 7–12.
- 160,,. An enhanced prognostic system for clinically localized carcinoma of the prostate. Cancer. 1997; 79: 2154–2161.Direct Link:
- 161,,. Prognostic factors for clinically localized prostate carcinoma: analysis of 938 patients irradiated in the prostate specific antigen era. Cancer. 1997; 79: 1370–1380.
- 162,,, et al. Radiation therapy for clinically localized prostate cancer: a multi-institutional pooled analysis. JAMA. 1999; 281: 1598–1604.
- 163,,, et al. Ten-year disease free survival after transperineal sonography-guided iodine-125 brachytherapy with or without 45-gray external beam irradiation in the treatment of patients with clinically localized, low to high Gleason grade prostate carcinoma. Cancer. 1998; 83: 989–1001.Direct Link:
- 164,,, et al. Evaluation of serum prostate-specific antigen velocity after radical prostatectomy to distinguish local recurrence from distant metastases. Urology. 1994; 43: 649–659.
- 165,,,,,. Cancer-specific mortality after surgery or radiation for patients with clinically localized prostate cancer managed during the prostate-specific antigen era. J Clin Oncol. 2003; 21: 2163–2172.
- 166,,,,. Determinants of prostate cancer-specific survival after radiation therapy for patients with clinically localized prostate cancer. J Clin Oncol. 2002; 20: 4567–4573.
- 167,,,,. Determinants of prostate cancer specific survival following radiation therapy during the prostate specific antigen era. J Urol. 2003; 170(6 pt 2): S42–S46; discussion S46-S47.
- 168,,,,,. Predictors of prostate cancer-specific mortality after radical prostatectomy or radiation therapy. J Clin Oncol. 2005; 23: 6992–6998.
- 169,,, et al. Predicting the outcome of salvage radiation therapy for recurrent prostate cancer after radical prostatectomy. J Clin Oncol. 2007; 25: 2035–2041.
- 170,,,,,. Pre-treatment nomogram for disease-specific survival of patients with chemotherapy-naive androgen independent prostate cancer. Eur Urol. 2006; 49: 666–674.

1097-0142/asset/olbannerleft.gif?v=1&s=ca681f5719430b26e1bc15e9ea4c9fc0a7110104)
1097-0142/asset/olbannerright.gif?v=1&s=8142566facf7e76aef9be6c51162a2e920b3b9f9)
1097-0142/asset/cover.gif?v=1&s=a7299bc18f075294c232ade468773cd0672bd470)