The median informs the message: the accuracy of individualized scenarios for survival time based on oncologists’ estimates (#151)
Purpose: We sought the accuracy of oncologists’ estimates of survival time in individual patients with advanced cancer.
Methods: Medical oncologists estimated survival time for patients with advanced cancer as the “median survival of a group of identical patients.” Accuracy was defined by proportions of patients with observed survival time bounded by pre-specified multiples of their estimated survival time. We expected 50% to live longer (or shorter) than their oncologist’s estimate (calibration); 20-30% to live within 0.67-1.33 times their oncologist’s estimate (precision); 50% to live from half to double their estimate (typical scenario); 5-10% to live ≤¼ of their estimate (worst-case scenario) and 5-10% to live ≥3 times their estimate (best-case scenario). Discriminative value was assessed with Harrell’s C-statistic and prognostic significance with Cox proportional-hazards regression.
Results: Median survival time was 11 months after 68 deaths in 114 subjects. Oncologists’ estimates were well-calibrated (54% shorter than observed), imprecise (27% from 0.67-1.33 times observed), and had moderate discriminative value (Harrell’s C-statistic 0.62, p=0.001). The proportion of patients with an observed survival: half to double their oncologist’s estimate was 62%; ≤1/4 of their oncologist’s estimate was 6%; and ≥3 times their oncologist’s estimate was 9%. Independent predictors of observed survival were oncologists’ estimate (HR=0.92, p=0.004), dry mouth (HR=5.1, p<0.0001), alkaline phosphatase >101U/L (HR=2.8, p=0.0002), Karnofsky performance status ≤70 (HR=2.3, p=0.007), prostate primary (HR=0.23, p=0.002), and steroid use (HR=2.4, p=0.02).
Conclusion: Oncologists’ estimates of survival time were well-calibrated, imprecise, moderately discriminative, independently associated with observed survival, and accurate for estimating worst-case, typical and best-case scenarios for survival.