The mechanical behavior and failure mechanism of recycled semi-lfexible pavement material were investigated by different scales method. The macroscopic mechanical behavior of samples was studied by static and dynamic splitting tensile tests on mechanics testing system (MTS). The mechanical analysis in micro scale was carried out by material image analysis method and ifnite element analysis system. The strains of recycled semi-lfexible pavement material on samples surface and in each phase materials were obtained. The test results reveal that the performance of recovered asphalt binder was the major determinant on the structural stability of recycled semi-lfexible pavement material. The asphalt binder with high viscoelasticity could delay the initial cracking time and reduce the residual strain under cyclic loading conditions. The failure possibility order of each phase in recycled semi-flexible pavement material was asphalt binder, reclaimed aggregate, cement paste and virgin aggregate.