In order to study the viscoelastic deformation response of asphalt mixture under different temperatures and different stresses, a method based on triaxial repeated load test to evaluate the anti-rutting ability of asphalt mixture was proposed, and the development law of asphalt pavement rutting was predicted. The semi-sinusoidal load is used to simulate the actual vehicle load on the road. Based on the viscoelastic five-element eight-parameter model, the mechanical model which can be applied to the triaxial repeated load test is derived. Combined with the test results of the triaxial repeated load test, the original 8.5 software was used to fit the three-axis repeated load test data to obtain the corresponding physical parameters. The flow numbers under different temperature and stress conditions were calculated and compared with the measured flow values. The results show that the higher the temperature and the higher the stress, the larger the permanent deformation of the mixture and the smaller the rheology. Under the repeated load, the correlation coefficient of the parameters of the permanent deformation viscoelastic mechanics model of asphalt mixture is over 95%. The model can effective reflects the permanent deformation characteristics of the asphalt mixture.