The image retrieval based on shape feature has become a hot research topic. In order to facilitate to retrieve image rapidly and accurately among the numerous image information, the major steps of image retrieval based on the shape feature have been researched in this paper. Still the algorithms involved in the steps have been compared, selected and improved. A system of the image retrieval based on the shape feature is developed in MATLAB. It is tested that the system can effectively retrieve similar images. And the experimental results of calculation and analysis of the precision and recall rate, the result proves that the system is feasible and has a certain popularization value and use value.