Citation: Kim H, et al. 2024. Similarity Evaluation of Patent Drawings using ResNet and SIFT. The Journal of Intellectual Property 19(3), 131-153.
DOI: https://doi.org/10.34122/jip.2024.19.3.7
The Journal of Intellectual Property, 2024 September, 19(3): 131-153.
Received on 4 May 2024, Revised on 11 June 2024, Accepted on 3 September 2024, Published on 30 September 2024.
Ph.D Candidate, IT Policy and Management, Soongsil University, Seoul, Republic of Korea
*Corresponding Author: Hyuna Kim (hannah_kim@naver.com)
The study of the similarity evaluation and retrieval of patent documents is critical not only for the efficient management of patent literature, but also for the rapid and effective collection of information in industrial and technological fields. Patent drawings visually represent the outcomes of technological advancements and innovations, but have not been given as much importance as texts in the past.
This study evaluated the similarity of patent drawings for effective retrieval using the representative deep-learning model, ResNet-50, and the traditional computer vision algorithm, scale-invariant feature transform (SIFT). First, a classification experiment using 10,827 patent drawings was conducted to evaluate the similarity of the visual types, achieving a classification performance with an accuracy exceeding 95%. Second, a retrieval experiment using 5,000 technical drawings was conducted to compare the features of ResNet and SIFT based on their similarity. Finally, the retrieval and matching performances of ResNet and SIFT were evaluated using 50 original data samples and 4,800 augmented data samples created by various forms of editing. ResNet demonstrated an average matching performance of 72.54%, whereas SIFT achieved an average matching performance of 86.71%.
The findings reveal that, unlike ResNet-50, which compares similarity using the entire image information, SIFT evaluates similarity based on attribute information, such as key points within the image. Consequently, ResNet is advantageous for identifying visually similar images, whereas SIFT excels in identifying identical images.
Patent drawings, binary images, classification and retrieval, ResNet-50, SIFT, similarity Comparison
The author received manuscript fees for this article from Korea Institute of Intellectual Property.
No potential conflict of interest relevant to this article was reported.