HIV-2 and closely related SIV Vpx proteins are essential for viral replication in macrophages and dendritic cells. Vpx hijacks DCAF1–DDB1–Cul4 E3 ubiquitin ligase to promote viral replication. DCAF1 is essential for cell proliferation and embryonic development and is responsible for the polyubiquitination of poorly defined cellular proteins. How substrate receptors recruit the DCAF1-containing E3 ubiquitin ligase to induce protein degradation is still poorly understood. Here we identify a highly conserved motif (Wx4Φx2Φx3AΦxH) that is present in diverse Vpx and Vpr proteins of primate lentiviruses. We demonstrate that the Wx4Φx2Φx3AΦxH motif in SIVmac Vpx is required for both the Vpx–DCAF1 interaction and/or Vpx-mediated degradation of SAMHD1. DCAF1-binding defective Vpx mutants also have impaired ability to promote SIVΔVpx virus infection of myeloid cells. Critical amino acids in the Wx4Φx2Φx3AΦxH motif of SIV Vpx that are important for DCAF1 interaction maintained the ability to bind SAMHD1, indicating that the DCAF1 and SAMHD1 interactions involve distinctive interfaces in Vpx. Surprisingly, VpxW24A mutant proteins that were still capable of binding DCAF1 and SAMHD1 lost the ability to induce SAMHD1 degradation, suggesting that Vpx is not a simple linker between the DCAF1–DDB1–Cul4 E3 ubiquitin ligase and its substrate, SAMHD1.VpxW24A maintained the ability to accumulate in the nucleus despite the fact that nuclear, but not cytoplasmic, mutant forms of SAMHD1 were more sensitive to Vpx-mediated degradation. The Wx4Φx2Φx3AΦxH motif in HIV-1 Vpr is also required for the Vpr–DCAF1 interaction and Vpr-induced G2 cell cycle arrest. Thus, our data reveal previously unrecognized functional interactions involved in the assembly of virally hijacked DCAF1–DDB1-based E3 ubiquitin ligase complex.