Using classical neuroanatomical retrograde tracing methods we investigated the retinal ganglion cells projecting to the nucleus of the optic tract and dorsal terminal nucleus of the accessory optic system (NOT-DTN) in macaque monkeys. Our main aim was to quantify the strength of the projection from the ipsilateral retina to the NOT-DTN. We therefore examined the number, distribution, and soma size of retinal ganglion cells involved in this projection. Electrophysiologically controlled small injections into the NOT-DTN revealed a clearly bilateral retinal projection originating mainly from the central retina but also involving peripheral retinal regions. Labelled cells were found nasally in the contralateral retina and temporally in the ipsilateral retina with some overlap in the fovea. The projection from the ipsilateral retina was 36–43% of that from the contralateral retina. On average, only 1–6% of the local population of ganglion cells projected to the NOT-DTN. Small soma size and large dendritic fields imply that in monkey rarely encountered, ‘specialized’ ganglion cells provide the direct retinal input to the accessory optic system (AOS). These results are discussed with respect to the symmetry of monocular horizontal optokinetic nystagmus (OKN) in primates.