Elice, Inc. Unveils 'AI Helpy Pro' that Analyzes Images in Korean

Developing a multimodal model that best describes the Korean language and culture

Elice, an AI education solution company, has unveiled ‘AI Helpy Pro’, a multimodal AI model. It is specialized to understand Korean language and culture by adding an image recognition function to Elice’s generative AI chatbot ‘AI Helpy’.

‘AI Helpy Pro’ is equipped with ‘Helpy-V’, an AI model developed by Elice, Inc., which can understand and analyze text and images, and provides visual question and answer (VQA) that explains the answer when asked about an image. In addition to the accurate and fast Q&A that the existing AI Helpy could do, it also provides the ability to generate the desired image. Halucination, a problem with generative AI, is greatly mitigated by the real-time information search function.

Best performance on Korean-based VQA tasks among open-source AI models

They also excel at reading and analyzing the Korean language and culture. They can look at and describe pictures of famous Koreans, as well as understand and accurately describe images of traditional culture, such as traditional Korean music, and traditional foods.

CVQA benchmarks on the Korean VQA task domain also demonstrated its technical capabilities, with the best performance among open-source AI models, including Big Tech. This means that the existing publicly available VQA models are developed in English and have limited understanding of Korean culture and knowledge, and provide reliable Korean-based information.

Overcoming the limitations of the existing English-based VQA model due to poor understanding of Korean culture and knowledge

Elice recognized the need for a VQA function for learners who have difficulty acquiring visual information while running real-world training. AI Helpy Pro, which pursues Universal Design For Learning (UDL), which enables all learners to participate in learning, will be gradually applied to Elice LXP, which is used for AI training in more than 4,000 institutions.

AI Helpy Pro can provide accurate Korean explanations for images in Korean elementary and secondary school textbooks, and can be used to check the status of experimental instruments during science classes and answer questions on the screen. In addition, the company plans to expand the scope of utilization in various educational and industrial areas, such as detecting risks through video or images at industrial sites.

“The fact that the generative AI chatbot ‘AI Helpy’ received more than 150,000 questions and answers in the first two months of its release last year and was very helpful to real learners was very significant, and we were convinced that we had developed an AI model that added value to education,” said Suin Kim, CRO and Do-hyun Kwon, AI Engineer at Elice, who led the research on the AI model. ”We plan to develop a reliable AI model specialized in education that more people can utilize in the future.”