Motopsin is a mosaic serine protease secreted from neuronal cells in various brain regions, including the hippocampus. The loss of motopsin function causes nonsyndromic mental retardation in humans and impairs long-term memory formation in Drosophila. To understand motopsin’s function in the mammalian brain, motopsin knockout (KO) mice were generated. Motopsin KO mice did not have significant deficits in memory formation, as tested using the Morris water maze, passive avoidance and Y-maze tests. A social recognition test showed that the motopsin KO mice had the ability to recognize two stimulator mice, suggesting normal social memory. In a social novelty test, motopsin KO mice spent a longer time investigating a familiar mouse than wild-type (WT) mice did. In a resident–intruder test, motopsin KO mice showed prolonged social interaction as compared with WT mice. Consistent with the behavioral deficit, spine density was significantly decreased on apical dendrites, but not on basal dendrites, of hippocampal pyramidal neurons of motopsin KO mice. In contrast, pyramidal neurons at the cingulate cortex showed normal spine density. Spatial learning and social interaction induced the phosphorylation of cAMP-responsive element-binding protein (CREB) in hippocampal neurons of WT mice, whereas the phosphorylation of CREB was markedly decreased in mutant mouse brains. Our results indicate that an extracellular protease, motopsin, preferentially affects social behaviors, and modulates the functions of hippocampal neurons.