Comprehensive online and offline evaluation solutions powered by Elice Test

Sungkyunkwan University

Sungkyunkwan University, with a history spanning 626 years, is at the forefront of higher education innovation, embodying challenges, innovation, sharing, and co-prosperity. Guided by the motto ‘Inspiring Future, Grand Challenge,’ the university stands as a beacon of excellence, navigating the dawn of a new era. In 2023, it was honored by the Ministry of Science and ICT with selection for the ‘Metaverse Convergence Graduate School Support Project,’ leading to the creation of the Department of Immersive Media Engineering. This department is dedicated to nurturing versatile talents proficient in the entire spectrum of metaverse service development, from planning through R&D to commercialization. Its curriculum merges ICT technologies with the humanities and social sciences to underpin metaverse service realization, while its metaverse-focused research and courses, coupled with industry-academic partnerships, address real-world industrial challenges, fostering the growth of convergent professionals.

Sungkyunkwan University’s Department of Immersive Media Engineering is conducting competency evaluation and education with Elice to diagnose and educate new students. I met Yoo So-hee, who works at Sungkyunkwan University’s Intelligent Multimedia Research Center, and heard about the competency evaluation and education cases in detail.

Q. Could you introduce yourself and share what projects you’re currently involved with?

Hello, I’m Sohee Yoo, and I manage the planning and execution of various events, as well as both online and offline promotional activities for the Department of Immersive Media Engineering at Sungkyunkwan University’s Intelligent Multimedia Research Center. This department was inaugurated in the second half of 2023 as part of the government’s initiative to support Metaverse Convergence Graduate Schools. Emphasizing interdisciplinary studies, our student body showcases a diverse academic background, with a composition of 60% from science fields and 40% from the humanities.

Q. You conducted competency assessment and complementary education through Elice. Why did you choose Elice and what were your expectations?

I already knew Elice because I saw an interview with the CEO of Elice before. I was also a liberal arts student, so I had already encountered Elice while looking for coding lectures. When I came to Sungkyunkwan University’s Intelligent Multimedia Research Center and heard that I needed a programming competency assessment, I immediately thought of Elice and suggested it to the professor. Of course, I also considered and compared other competitors, and in the end, I chose Elice because I thought that its competency assessment and training were systematic.

Q. Who is the competency assessment conducted for, and what is its purpose?

The competency assessment is tailored for students admitted to the Department of Immersive Media Engineering, aimed at evaluating their fundamental skills necessary to navigate the department’s curriculum effectively. Given the department’s interdisciplinary nature, a key focus is on programming skills, acknowledging that some students, particularly those from liberal arts backgrounds, might not have prior programming experience. Conducted after admission, this assessment is crucial for identifying students’ basic competencies. Should their skills fall below a certain threshold, supplementary education through Elice is provided to elevate their competencies to the required level by the time of graduation. This step is deemed so vital that achieving a passing grade on the competency assessment is a condition for graduation.”

Q. What is the most important thing about the competency assessment?

The key to effective competency assessment lies in crafting question structures that precisely evaluate the targeted skill area. Before implementing the Elice Competency Assessment, I consolidated and shared the questions used by my professor with Elice. They then adeptly organized these questions to mirror the original difficulty level and structure, ensuring a nuanced and accurate assessment.

Q. What did you like about Elice Competency Assessment?

I was satisfied with the efficiency of the administration. It was easy and comfortable to manage from an administrative point of view, as it was seamless from question submission to scoring to training management. I also liked the fact that the administrator could supervise the test taker while viewing all three screens (webcam, monitor, and mobile screen) when taking the competency assessment.

▲ Competency Assessment Take Screen

Q. What changes have you seen before and after implementing Elice Competency Assessment?

Before Elice, the professors had to create the questions and manually evaluate them, which took a lot of resources. The tests were all manual, and the grading was also manual, so it took months to get the results back to the students. But after Elice Competency Assessment, we were able to quickly move from creating the questions to grading them. As an administrator, I think it was really nice to be able to see the results immediately after taking the competency assessment and get back to the students quickly.

Q. Based on the results of the competency assessment, remedial education is provided for students who do not pass. What are the goals of the remedial education?

The primary goal of the supplementary education is to raise the level of the students so that they can pass the competency assessment, so that they can build up their skills to the point where they can follow the curriculum of the department.

Also, the characteristic of our Department of Immersive Media Engineering is that we take care of students closely until graduation. The chairman of the department has a strong idea that students must graduate with the required competencies, so we provide free educational content to students and let them take retests to improve their competencies.

▲ Competency Complementary Training Domains

Q. What do you think is important in complementary education?

First and foremost, I think it’s important to be able to build competencies that can be utilized in practice, not just learn theory. What impressed me about Elice training was that the training content provided practical exercises along with theoretical lectures. It was great to be able to experience coding directly after learning the theory. This kind of hands-on training was one of the reasons I chose Elice.

Q. I was wondering if you have any further plans for competency assessment and training in the future.

We recruit new graduate students twice a year, so we plan to continue to conduct competency assessment twice a year, and we also plan to conduct supplementary training during vacation periods. :)

Would you recommend Elice to other organizations, and if so, why?

Certainly, I recommend Elice for its ability to facilitate swift and ongoing communication, a benefit stemming from their approach of assigning a dedicated point of contact to each organization. This personalized attention enabled us to tailor training programs and assessment questions to fit our specific needs seamlessly. Moreover, even our numerous, detailed inquiries were met with prompt and thorough responses, streamlining the management process significantly. For any organization in search of customized assessment or training solutions, Elice stands out as an excellent choice.

👉 Learn more about Elice test solutions

👉 Get an assessment and training consultation tailored to your organization

*This content is a work protected by copyright law and is copyrighted by Elice.

*The content is prohibited from secondary processing and commercial use without prior consent.

Korea’s First NPU Hackathon, Crafted with Content Production Skills and Operational Expertise

Have you heard about the latest buzz in the IT community, popularly referred to as a ‘hackathon’? This term merges ‘hacking’ and ‘marathon,’ characterizing an event where individuals from various disciplines—such as development, design, and planning—collaborate intensively to build a service in a constrained time. Hackathons offer a unique platform for direct engagement between participants and sponsoring organizations, facilitating superior brand exposure, promotional benefits, and the identification of exceptional talent.

Rapidly growing startup ‘FuriosaAI’ has also turned its attention to a hackathon tailored to its corporate characteristics. FuriosaAI is a semiconductor fabless startup specializing in designing high-performance NPUs (Neural Processing Units) optimized for deep learning.

▲ The sequence of events for the FuriosaAI Hackathon

Diverging from the norm of typical hackathons, we designed a special pre-event SDK (Software Development Kit) education for participants, both online and offline. Understanding the importance of effectively using the novel NPU and ‘Warboy,’ this educational segment was specifically tailored to equip participants with the necessary skills.

Participants attended theoretical lectures online and had the opportunity, offline, to witness demonstrations by FuriosaAI engineers and engage in a Q&A session. This approach aimed to enhance participants’ understanding of NPU, ensuring a more meaningful hackathon experience.

Even with meticulous preparation, hackathons, given their offline nature, can encounter unexpected variables. Leveraging the expertise accumulated through numerous hackathons, Elice ensured the stable operation of the event. Many participants appreciated the attention to detail in event operations, including meals and provisions, catering to the constraints on participants who might face mobility challenges during the hackathon.

▲ FuriosaAI Hackathon Venue

An Enriched Hackathon Through Tailored Content Development

As it was a hackathon that required not only qualifiers but also pre-event education, content development was crucial to the on-site proceedings. Being the first-ever NPU hackathon in Korea, unprecedented attention to detail was necessary.

Leveraging the rich experience of the Elice content development team in creating educational and evaluative content, tailored theory and practical training materials were developed based on the materials provided by FuriosaAI. Elice also took charge of creating the qualifying round questions, including SDK quizzes, AI modeling, algorithm coding tests, aligning them with the respective positions.

Learning and AI Development Simultaneously with EliceLXP

While the final round takes place offline, a platform for pre-event education, practical training, and preliminary evaluations is also necessary. All these challenges were addressed using EliceLXP.▲ Preliminary SDK Training for the Hackathon conducted on EliceLXP

EliceLXP hosted the pre-event educational materials and exercises, granting participants seamless access ahead of time. The platform further served for the online preliminary coding test, ensuring a consistent user experience.

FuriosaAI’s distinctive approach allowed each participant to gain practical experience with the ‘1 person 1 NPU’ policy. Through Jupyter Notebooks integrated into EliceLXP, participants could access detailed explanations and directly apply code for utilizing the Warboy chip, enabling a smooth and innovative learning experience.

The ability to utilize a single platform for all educational content and assessments proved particularly fitting for the hackathon format. Since hackathons typically span an extended period, maximizing convenience and maintaining participant engagement are crucial to prevent dropouts.

▲ EliceLXP’s Runbox Practice Interface

The final round of development was conducted on EliceLXP, housed within EliceCloud, where each team received dedicated GPU and NPU instance resources. Participants created their personal instances on EliceCloud, enabling straightforward server connections through Warboy, thus ensuring smooth access to the AI development environment.

Successful Hackathon Wrap-up! Creative Outputs and Participant Satisfaction

▲ Hackathon Review by Minseob Lee, HR Leader at FuriosaAI

👉 Explore the case of Elice AI Edu Hackathon with Over 1,500 Applicants

👉 Talk to sales for more information about hackathon

*This content is a work protected by copyright law and is copyrighted by Elice.

*The content is prohibited from secondary processing and commercial use without prior consent.

Woori FIS Co., Ltd.

Woori FIS is a full-service provider of financial IT services, offering IT development and management to the banking, credit card, securities, and insurance industries, among other financial sectors. We are accelerating digital innovation by completing the formation of our own standard development framework and implementing, for the first time in Korea, a complete IT outsourcing model that includes IT infrastructure operation as well as development. The objective is to accelerate the digital transformation process through the reinforcement of core technologies and the application of a systematic evaluation of job competencies for internal development. Since 2022, Woori FIS has been conducting developer competency assessments by introducing the Elice Test solution, which is intended to diagnose important digital competencies in digital transformation.

Introducing a design for test solution

The objectives of Woori FIS’s developer competency assessment were to diagnose field developers’ competencies, create competency frameworks for every role, and establish standards. Since the main objective was to assess the developer’s practical skills, tests were specifically administered based on language and included questions in the form of field activities like “developing an API” and “creating a search box.” A sizable online job competency assessment was carried out on the Elice Test platform with 200 to 300 developers following debate and revision of the questions by experts and developers.

Assess the hands-on competency of developers

The thorough evaluation of developer job competency was the most essential component of the Woori FIS test. Coding tests using industry-standard languages including SQL, Java, C, and JavaScript were utilized to assess actual work competency. The questions were organized into a task- and function-based units. Elice’s testing platform is evaluated in a manner that closely resembles the real-world development environment, enabling candidates to swiftly adjust and concentrate on the exam.

Using the “Reference Page Function” in the Elice Test, one can access the required library and search for or verify any references throughout the exam. The reference page feature is part of the Elice Test because it tests your ability to find and utilize the libraries you’ll need for everyday work.

▲ Test example screen (not the real Woori FIS test question, but an example question for reference)

Elice creates questions based on the candidates’ work and the industry the company operates. With the financial industry that is Woori FIS, the questions were developed using the banking database. In the case of SQL subjects, we aimed to assess the work competency of genuine field developers with industry-specific questions, like matching the columns utilized by actual banks. We generated over a million datasets and questions.

Simple to use and oversee test platform environment

Numerous locations host hundreds of test takers, therefore the expansive online testing platform is made to facilitate administrator supervision as much as possible. The remote ID authentication feature made it simple and quick to authenticate users on the Elice Test platform. ID authentication was made feasible without worrying about personal information leaking because ID cards are photographed and sent via the screen QR code. Personal information masking is possible immediately. It is simple to verify and check the ID card because the test manager has the ability to do so at any point throughout the test or after it has ended. Administrators can monitor the dashboard at any point during or after the exam, which simplifies management.

▲ Quick ID verification with a QR code

▲ Dashboard enabling the administrator to verify in real-time upon completion or throughout the test

Observation and methods to prevent cheating

The employment competency evaluation for Woori FIS developers is entirely done online, and because it was done at the candidate’s house, there were suspicions of cheating. Cheating on the Elice Test was prohibited by its triple monitoring system and solution. You are able to watch and manage the candidate’s smartphone screen, monitor, and camera thanks to the triple monitoring system. Complete blind spot monitoring is made possible by the triple monitoring system, and the recording feature allows for additional inspection. By sending specific notifications or verifying the number of managers on duty, monitoring also made it easier for us to administer and oversee exams when cheating was suspected.

▲ Three monitoring systems: mobile displays, webcams, and monitoring.

The Elice Test gives you the power to manage the environment, including stopping people from using two monitors to search for answers or share them, figuring out whether other apps like notepad and SNS are being used, and reporting results to managers. Since ChatGPT just became popular, there have been a lot of worries about people utilizing it to cheat. An automatic anti-cheating solution is available on the Elice online trial platform to aid in preventing this kind of behavior. The instructions were made impossible to copy and paste in order to prevent problem leaking, and the screen was automatically blocked even during the Woori FIS test when the complete screen was released or a special key was input.

▲ Platform screens that, upon release of the entire screen, become automatically blocked.

In order to assess practical development capabilities, the Woori FIS Developer Job Competency Assessment was created with a number of factors in mind, including exam goal, difficulty, quiz, and practice. Thanks to a robust test platform and questions that may systematically evaluate practitioners’ digital proficiency, we were able to execute the developer competency evaluation with ease. The basis for developing a trustworthy internal competency system was also established by this competency evaluation.

Throughout the years, Elice has identified the training and assessment needs of multiple enterprises by offering DX training. We comprehend the variations in the necessary competences and levels by industry, work group, and position based on the learning data gathered from DX training, and we build a systematic job competency evaluation solution on this foundation. Using the Elice Test solutions, numerous companies are already conducting developer competency exams, similar to the Woori FIS test case. Code reviews, data science, artificial intelligence, data literacy, and programming language proficiency can all be evaluated using thorough diagnostic tests of digital competency. We advise taking the Elice Test if you’re worried about assessing your developer ability or if you require a test to evaluate your actual job competency.

👉 Learn more about the Elice Test.

👉 Consultation on testing solutions for your business.

*Elice owns the copyright to this content, which is protected under copyright law.

*Without prior consent, secondary processing and commercial use of the content are prohibited.