더 프롬프트 컴퍼니는 2024년 1월부터 한국어 교육을 위한 AI Activity 툴과 챗봇을 제작하고 있습니다. 이 프로젝트는 미국 UH Press 출판사, University of Hawaii at Manoa, EALL의 한국어과가 함께하고 있습니다. 2024년 봄학기에는 하와이 대학교의 초급 한국어를 수강하는 학생을 대상으로 툴과 챗봇의 파일럿 테스트를 마쳤는데요, 1차 프로젝트에서는 AI 툴과 챗봇 48개를 제작했습니다. 프롬프트만으로 LLM의 한계를 보완하고 학생의 수준에 맞춘 의미있는 학습 도구를 제공할 수 있다는 성과가 있었습니다. 이 글에서는 1차 프로젝트에 대한 소개, 프로젝트 배경, 프로젝트 진행 방법, 설문 조사를 담은 연구 내용을 담았습니다. 2024년 미국 인디애나 주 Indiana University 에서 열린 제29회 AATK 학회에 채택되었습니다. Abstract Enhancing Korean Language Learning through AI and Chatbots: An In-Depth Study of Efficacy, User Experiences, and Challenges The incorporation of Artificial Intelligence (AI) has become widespread in the field of language learning and teaching over the past decade. One form of AI, the chatbot, has gained popularity in language education for its ability to facilitate student learning in various aspects. This study focuses on evaluating the impact of these technologies on the Korean language learning experience, particularly at the beginner level. Its aim is to explore the effectiveness of generative AI in facilitating language acquisition, with a special emphasis on learners' engagement and perceptions. Empirical studies by Zhang and Aslan (2021), Schmidt and Strasser (2022), Jeon (2021), and Aihua (2021), assert the potential benefits of AI chatbots in language learning. Language learning applications like Duolingo and Babbel utilize AI to provide personalized feedback, serving as valuable adjunct tools in the language learning experience. However, applying generative AIs to language learning presents unique challenges due to their peculiar characteristics. Therefore, this study developed AI tools and chatbots utilizing the advanced capabilities of ChatGPT-3.5 and ChatGPT-4 models, tailoring them specifically for Korean language learning contexts. The current study involves the development of 48 unique AI tools and chatbots using advanced prompt engineering techniques. Designed to reinforce key language elements such as vocabulary, sentence structure, and verb conjugations, these chatbots were programmed to simulate real-world conversations, mirroring the scenarios presented in each textbook lesson. This functionality provides real-time feedback and correction on grammatical errors and vocabulary misuse. The primary aim is to create an immersive learning environment where learners can apply and test their language skills in practical, conversational contexts. Using the pilot test of these chatbots, a detailed user survey was conducted with 50 learners at a university in the US who had prior experience in learning Korean. This survey sought to understand various aspects of their learning process, including their firsthand experiences after using the specifically chosen AI tools and chatbots for this survey. According to the survey results, 70% of participants affirmed the utility of AI supplementary tools in their language progress. The conjugation tool, in particular, received high praise for its effectiveness in practicing grammar and vocabulary in a conversational setting. Notably, more than half of the participants acknowledged that AI tools positively influenced their understanding of Korean, especially in recognizing the subtle differences between Korean and English and appreciating the intricate details of language learning. However, the study also highlighted significant limitations and challenges. A notable issue was the occurrence of AI-generated inaccuracies or 'hallucinations', observed in about 20% of the cases. Participants reported instances where the AI provided incorrect sentence structures or tense forms, underlining its imperfection as a learning aid. The AI tools also struggled with nuances, specific contexts, and appropriate situational responses. The findings suggest that while AI can be a powerful aid in language learning, educators and developers must address its current limitations and ensure learners are well-informed about these technologies. Results and Insights: Positive Feedback: 70% of participants affirmed the utility of AI supplementary tools in their language learning progress. The conjugation tool was particularly praised for its effectiveness in practicing grammar and vocabulary in conversational settings. Improved Understanding: More than half of the participants acknowledged that AI tools positively influenced their understanding of Korean. They noted an enhanced ability to recognize subtle differences between Korean and English and appreciated the intricate details of language learning facilitated by these tools.