In this study, we investigated genetic diversity among 37 accessions in Arabidopsis thaliana from Eurasia, North Africa and North America using morphological traits and two polymerase chain reaction (PCR)-based marker systems: cleaved amplified polymorphic sequences (CAPS) and inter-simple sequence repeats (ISSR). Cluster analysis based on genetic similarities calculated from CAPS data grouped the accessions roughly according to their geographical origin: one large group contained accessions from Western, Northern and Southern Europe as well as North Africa, a second group consisted of Eastern European and Asian continental accessions. North American accessions were interspersed into these groups. Contrary to the CAPS analysis, the dendrogram obtained from the ISSR data did not reflect the geographical origin of the accessions, and the calculated genetic distances did not match the CAPS results. This could be attributable to an uneven genomic distribution of ISSR markers as substantiated by a database search for ISSR binding sites in A. thaliana genomic DNA sequence files, or to the ISSR’s different mode of evolution. We recommend CAPS markers for diversity analysis in A. thaliana because a careful selection of markers can ascertain an even representation of the entire genome.