Phylogeographical patterns of marine and diadromous organisms are often influenced by dynamic ocean histories. For example, the marine realm around the Japanese Archipelago is an interesting area for phylogeographical research because of the wide variation in the environments driven by repeated shifts in sea level in the Quaternary. We analysed mitochondrial cyt b gene and nuclear myh6 gene sequences for individuals collected from throughout the range of the anadromous fish Leucopsarion petersii to assess the lineage divergence, phylogeographical pattern and historical demography in relation to geological history and oceanographic features around the archipelago. Leucopsarion petersii has two major lineages (the Japan Sea and Pacific Ocean lineages), which diverged during the late-early to middle Pleistocene. Geographical distributions of the two lineages were closely related to the pathways of the two warm currents, the Tsushima Current and the Kuroshio Current, that flow past the archipelago. Evidence of introgressive hybridization between these lineages was found at two secondary contact zones. Demographic tests suggested that the Japan Sea and Pacific Ocean lineages carried the genetic signal of different historical demographic processes, and these signals are probably associated with differences in habitat stability during recent glacial periods. The Japan Sea lineage has a larger body-size and more vertebrae, probably in relation to severe habitat conditions through Pleistocene climatic oscillations. Thus, the two lineages have long independent evolutionary histories, and the phylogeographical structure and demography of this species have been influenced both by historical events and the present-day oceanography around the Japanese Archipelago.