경량화 언어 모델 기반 비정형 물류 주문 정보 자동 추출에 관한 연구

초록

Recently, Large Language Models (LLMs) have made revolutionary advancements in the field of natural language processing, playing a significant role in the processing and analysis of unstructured data across various industries. Particularly in the logistics industry, efficiently handling unstructured data such as customer order information has become extremely important to maximize operational efficiency. However, traditional natural language processing techniques, while processing text as unstructured data, have limitations in understanding complex contexts or extracting nuanced meanings. This study proposes an approach to processing unstructured data through a lightweight language model that can run on a PC. Specifically, it addresses the limitations of existing statistical methods or rule-based approaches that cannot fully comprehend complex meanings and contexts. We believe that processing unstructured data in the logistics industry will serve as foundational data to systematize manual tasks and enhance efficiency. As a result of experiments using a model refined based on actual E-mail data, we achieved 100% accuracy for structured data. Among the main fields of unstructured data, three achieved 100% accuracy, the fourth field achieved 80%, and the last field showed a figure of about 1%. These results suggest the potential to dramatically increase operational efficiency in the logistics industry, especially for small and medium-sized enterprises, by introducing lightweight models to process unstructured data.

키워드