文章基本信息

标题：Learn2Write: Augmented Reality and Machine Learning-Based Mobile App to Learn Writing
本地全文：下载
作者：Md. Nahidul Islam Opu ; Md. Rakibul Islam ; Muhammad Ashad Kabir 等
期刊名称：Computers
电子版ISSN：2073-431X
出版年度：2022
卷号：11
期号：1
页码：4
DOI：10.3390/computers11010004
语种：English
出版社：MDPI Publishing
摘要：Augmented reality (AR) has been widely used in education, particularly for child education. This paper presents the design and implementation of a novel mobile app, Learn2Write, using machine learning techniques and augmented reality to teach alphabet writing. The app has two main features: (i) guided learning to teach users how to write the alphabet and (ii) on-screen and AR-based handwriting testing using machine learning. A learner needs to write on the mobile screen in on-screen testing, whereas AR-based testing allows one to evaluate writing on paper or a board in a real world environment. We implement a novel approach to use machine learning for AR-based testing to detect an alphabet written on a board or paper. It detects the handwritten alphabet using our developed machine learning model. After that, a 3D model of that alphabet appears on the screen with its pronunciation/sound. The key benefit of our approach is that it allows the learner to use a handwritten alphabet. As we have used marker-less augmented reality, it does not require a static image as a marker. The app was built with ARCore SDK for Unity. We further evaluated and quantified the performance of our app on multiple devices.