A family history of pancreatic cancer has consistently been associated with increased risk of pancreatic cancer. However, uncertainty remains about the strength of this association. Results from previous studies suggest a family history of select cancers (i.e., ovarian, breast and colorectal) could also be associated, although not as strongly, with increased risk of pancreatic cancer. We examined the association between a family history of 5 types of cancer (pancreas, prostate, ovarian, breast and colorectal) and risk of pancreatic cancer using data from a collaborative nested case-control study conducted by the Pancreatic Cancer Cohort Consortium. Cases and controls were from cohort studies from the United States, Europe and China, and a case-control study from the Mayo Clinic. Analyses of family history of pancreatic cancer included 1,183 cases and 1,205 controls. A family history of pancreatic cancer in a parent, sibling or child was associated with increased risk of pancreatic cancer [multivariate-adjusted odds ratios (ORs) = 1.76, 95% confidence interval (CI) = 1.19–2.61]. A family history of prostate cancer was also associated with increased risk (OR = 1.45, 95% CI = 1.12–1.89). There were no statistically significant associations with a family history of ovarian cancer (OR = 0.82, 95% CI = 0.52–1.31), breast cancer (OR = 1.21, 95% CI = 0.97–1.51) or colorectal cancer (OR = 1.17, 95% CI = 0.93–1.47). Our results confirm a moderate sized association between a family history of pancreatic cancer and risk of pancreatic cancer and also provide evidence for an association with a family history of prostate cancer worth further study.