A new method that combines fractal theory and red, green and blue (RGB) colour intensity was developed to sort dried jujube fruits by using support vector machine (SVM). Our result shows that the new method is fast and accurate in dried jujube fruits classification. The SVM models based on fractal parameters only achieved 85.18–92.73% total accuracy rate. The total classification accuracy of SVM based on RGB intensity values was 94.44%. However, the SVM models based on combining fractal parameters with RGB intensity values achieved 94.44–98.15% total accuracy rate. The best classification accuracy (98.15%) was found when using SVM model based on combining fractal measures (FM) with RGB intensity values (C = 512, γ = 0.0078125). Therefore, the SVM model based on combining FMs with RGB intensity is recommended in dried jujube fruits classification.