Faced with the massive amount of online shopping clothing images, how to classify them quickly and accurately is a challenging task in image classification. In this paper, we propose a novel method, named Multi XMNet, to solve the clothing images classification problem. The proposed method mainly consists of two convolution neural network ( CNN) branches. One branch extracts multiscale features from the whole expressional image by Multi X which is designed by improving the Xception network, while the other extracts attention mechanism features from the whole expressional image by MobileNetV3-small network. Both multiscale and attention mechanism features are aggregated before making classification. Additionally, in the training stage, global average pooling(GAP), convolutional layers, and softmax classifiers are used instead of the fully connected layer to classify the final features, which speed up model training and alleviate the problem of overfitting caused by too many parameters. Experimental comparisons are made in the public DeepFashion dataset. The experimental results show that the classification accuracy of this method is 95. 38％, which is better than InceptionV3, Xception and InceptionV3 Xception by 5. 58％, 3. 32％, and 2. 22％, respectively. The proposed Multi XMNet image classification model can help enterprises and researchers in the field of clothing e-commerce to automaticly, efficiently and accurately classify massive clothing images.