In order to improve the application effect of tennis match video in multimedia education, this paper puts forward a kind of method for retrieving the spectacular Rally scenes in tennis match video and classified the shots into Global View Shots and Non-Global View Shots. The Support Vector Machine (SVM) is for identifying the important types of audio in shots, applying the audio information in shots and setting up corresponding rules for retrieval. The results show that applying the retrieved spectacular Rally scenes in tennis match video in tennis multimedia education is line with most students’ psychological situation and greatly popular with students.