The molecular chaperone HSP90 has been shown to facilitate cancer cell survival by stabilizing key proteins responsible for a malignant phenotype. We report here the results of parallel fragment-based drug design approaches in the design of novel HSP90 inhibitors. Initial aminopyrimidine leads were elaborated using high-throughput organic synthesis to yield nanomolar inhibitors of the enzyme. Second site leads were also identified which bound to HSP90 in two distinct conformations, an ‘open’ and ‘closed’ form. Intriguingly, linked fragment approaches targeting both of these conformations were successful in producing novel, micromolar inhibitors. Overall, this study shows that, with only a few fragment hits, multiple lead series can be generated for HSP90 due to the inherent flexibility of the active site. Thus, ample opportunities exist to use these lead series in the development of clinically useful HSP90 inhibitors for the treatment of cancers.