3D Geometric Shape and Colors Interactive Learning Media using Raspberry Pi, OpenCV, and TensorFlow Lite

Mochamad Fajar Wicaksono, Myrna Dwi Rahmatya

Abstract


This study aims to create learning media for 3D geometric shapes and colors for early childhood. Early childhood can enter 3D objects into the device. Then, the device will mention and explain the shape and color of the object in question. As a contribution, this research provides a brief introduction and learning related to geometric shapes for early childhood. The method used is experimental. The hardware components of this system are Raspberry Pi 3, RPi Camera, PIR Sensor, 3.5inch LCD, and Speaker. Python, OpenCV, and TensorFlow Lite are used from the software side. OpenCV is used to detect colors. TensorFlow Lite is used to detect the shape of geometric objects. In this study, the model used is a custom model specifically for TensorFlow Lite, which was trained through Google Colab. This media has a learning mode and a question mode. In learning mode, early childhood only needs to insert objects into the learning media and will get information in the form of images and sounds related to the object. In question mode, the learning media will provide instructions and questions to enter objects with a specific color. After that, the learning media will determine whether the answer is right or wrong and give the score. The results of tests that cover both modes reach a success percentage of 100%, where this learning media can recognize and explain every shape and color of objects in both modes.

Keywords


3D geometric; Raspberry Pi; OpenCV; TensorFlow Lite; learning media

Full Text:

PDF PDF

References


M. F. Wicaksono, Syahrul, M. D. Rahmatya, and M. A. F. Rahman, “Raspberry Pi-Based Solar System Learning Media,†IOP Conf. Ser. Mater. Sci. Eng., vol. 879, no. 1, pp. 1–7, 2020, doi: 10.1088/1757-899X/879/1/012022.

R. M. Ryan and E. L. Deci, “Intrinsic and extrinsic motivation from a self-determination theory perspective: Definitions, theory, practices, and future directions,†Contemp. Educ. Psychol., vol. 61, p. 101860, 2020, doi: 10.1016/j.cedpsych.2020.101860.

L. Sun and C. E. Pan, “Effects of the Application of Information Technology to E-Book Learning on Learning Motivation and Effectiveness,†Front. Psychol., vol. 12, no. September, pp. 1–5, 2021, doi: 10.3389/fpsyg.2021.752303.

P. Y. Lin, C. S. Chai, M. S. Y. Jong, Y. Dai, Y. Guo, and J. Qin, “Modeling the structural relationship among primary students’ motivation to learn artificial intelligence,†Comput. Educ. Artif. Intell., vol. 2, no. October 2020, p. 100006, 2021, doi: 10.1016/j.caeai.2020.100006.

D. T. Wahyuningtyas, N. Yuniasih, N. R. Sesanti, and M. N. Hudha, “Two-dimensional interactive media for fourth grade students,†in Journal of Physics: Conference Series, 2019, vol. 1318, no. 1. doi: 10.1088/1742-6596/1318/1/012003.

D. Rohendi, S. Septian, and H. Sutarno, “The Use of Geometry Learning Media Based on Augmented Reality for Junior High School Students,†IOP Conf. Ser. Mater. Sci. Eng., vol. 306, no. 1, 2018, doi: 10.1088/1757-899X/306/1/012029.

S. Gargrish, A. Mantri, and D. P. Kaur, “Augmented reality-based learning environment to enhance teaching-learning experience in geometry education,†in Procedia Computer Science, 2020, vol. 172, no. 2019, pp. 1039–1046. doi: 10.1016/j.procs.2020.05.152.

T. Khan, K. Johnston, and J. Ophoff, “The Impact of an Augmented Reality Application on Learning Motivation of Students,†Adv. Human-Computer Interact., vol. 2019, p. 7208494, 2019, doi: 10.1155/2019/7208494.

T. Ridwan, E. Hidayat, R. Hikmawan, R. Andrian, and A. Yasin, “Research on the Development of Edu Games as Learning Media for Geometry and Arithmetic in Elementary School Children,†Int. Conf. Elem. Educ., vol. 3, no. November, pp. 57–61, 2020, [Online]. Available: http://proceedings2.upi.edu/index.php/icee/article/view/1443

N. M. Alzahrani, “Augmented Reality: A Systematic Review of Its Benefits and Challenges in E-learning Contexts,†Applied Sciences, vol. 10, no. 16. 2020. doi: 10.3390/app10165660.

R. O. Virata and J. D. L. Castro, “Augmented Reality in Science Classroom: Perceived Effects in Education, Visualization and Information Processing,†in Proceedings of the 10th International Conference on E-Education, E-Business, E-Management and E-Learning, 2019, pp. 85–92. doi: 10.1145/3306500.3306556.

R. Lovreglio and M. Kinateder, “Augmented reality for pedestrian evacuation research: Promises and limitations,†Saf. Sci., vol. 128, p. 104750, 2020, doi: https://doi.org/10.1016/j.ssci.2020.104750.

H. Hidayat, N. S. Hasibuan, and F. Wicaksono, “Design And Implementation Of Electronic Examination Device For Improving The Blind Students’ Comfort,†J. Eng. Sci. Technol., vol. 16, no. 1, pp. 807–815, 2021, [Online]. Available: https://jestec.taylors.edu.my/V16Issue1.htm

M. F. Amir, N. Fediyanto, H. E. Rudyanto, D. S. Nur Afifah, and H. S. Tortop, “Elementary students’ perceptions of 3Dmetric: A cross-sectional study,†Heliyon, vol. 6, no. 6, p. e04052, 2020, doi: https://doi.org/10.1016/j.heliyon.2020.e04052.

D. Rohendi and Y. Wihardi, “Learning Three-Dimensional Shapes in Geometry Using Mobile-Based Augmented Reality,†Int. J. Interact. Mob. Technol., vol. 14, no. 09 SE-Papers, pp. 48–60, Jun. 2020, doi: 10.3991/ijim.v14i09.13035.

U. Mulbar, Alimuddin, Rahmadani, and Adhar, “Using Augmented Reality Media in Three-Dimensional Geometric Shape Material,†J. Phys. Conf. Ser., vol. 1899, p. 12160, May 2021, doi: 10.1088/1742-6596/1899/1/012160.

S. Sumarwati, H. Fitriyani, F. M. Azhar Setiaji, M. Hasril Amiruddin, and S. Afiat Jalil, “Developing Mathematics Learning Media Based on E-Learning using Moodle on Geometry Subject to Improve Students’ Higher Order Thinking Skills,†Int. J. Interact. Mob. Technol., vol. 14, no. 04 SE-Papers, pp. 182–191, Mar. 2020, doi: 10.3991/ijim.v14i04.12731.

M. D. Abdulrahaman et al., “Multimedia tools in the teaching and learning processes: A systematic review,†Heliyon, vol. 6, no. 11, p. e05312, 2020, doi: https://doi.org/10.1016/j.heliyon.2020.e05312.

J. Sobota, M. Goubej, J. Königsmarková, and M. Čech, “Raspberry Pi-based HIL simulators for control education,†IFAC-PapersOnLine, vol. 52, no. 9, pp. 68–73, 2019, doi: https://doi.org/10.1016/j.ifacol.2019.08.126.

V. Chauhan, M. Patel, S. Tanwar, S. Tyagi, and N. Kumar, “IoT Enabled real-Time urban transport management system,†Comput. Electr. Eng., vol. 86, pp. 1–18, 2020, doi: https://doi.org/10.1016/j.compeleceng.2020.106746.

M. Murad, O. Bayat, and H. M. Marhoon, “Design and implementation of a smart home system with two levels of security based on IoT technology,†Indones. J. Electr. Eng. Comput. Sci., vol. 21, no. 1, pp. 546–557, 2021, doi: 10.11591/ijeecs.v21.i1.pp546-557.

S. Bin Saleh et al., “Design of Smart Home Security System using Object Recognition and PIR Sensor,†Energy Build., vol. 135, no. 1, pp. 465–472, 2020, doi: https://doi.org/10.1016/j.procs.2018.08.198.

M. F. Wicaksono, M. D. Rahmatya, and - Ilham, “IoT Implementation for Server Room Security Monitoring Using Telegram API,†Int. J. Adv. Sci. Eng. Inf. Technol., vol. 12, no. 5, pp. 1931–1937, 2022, doi: 10.18517/ijaseit.12.5.13922.

A. Murad, O. Bayat, and H. M. Marhoon, “Implementation of rover tank firefighting robot for closed areas based on arduino microcontroller,†Indones. J. Electr. Eng. Comput. Sci., vol. 21, no. 1, pp. 56–63, 2021, doi: 10.11591/ijeecs.v21.i1.pp56-63.

B. Alathari, M. F. Kadhim, S. Al-Khammasi, and N. S. Ali, “A framework implementation of surveillance tracking system based on pir motion sensors,†Indones. J. Electr. Eng. Comput. Sci., vol. 13, no. 1, pp. 235–242, 2019, doi: 10.11591/ijeecs.v13.i1.pp235-242.

T. Gambo, E. E. Omizegba, and A. B. Ba’ams, “Real-Time Video Display System in Articulated Vehicle for Road Safety Enhancement,†Int. J. Sci. Eng. Appl., 2019.

X. Mouy et al., “FishCam: A low-cost open source autonomous camera for aquatic research,†HardwareX, vol. 8, p. e00110, 2020, doi: https://doi.org/10.1016/j.ohx.2020.e00110.

K. Miikki et al., “An open-source camera system for experimental measurements,†SoftwareX, vol. 14, p. 100688, 2021, doi: https://doi.org/10.1016/j.softx.2021.100688.

M. Liu and D. Grana, “Accelerating geostatistical seismic inversion using TensorFlow: A heterogeneous distributed deep learning framework,†Comput. Geosci., vol. 124, no. Maret 2019, pp. 37–45, 2019, doi: IJ-OpenCV: Combining ImageJ and OpenCV for processing images in biomedicine.

B. Varshini, H. Yogesh, S. D. Pasha, M. Suhail, V. Madhumitha, and A. Sasi, “IoT-Enabled smart doors for monitoring body temperature and face mask detection,†Glob. Transitions Proc., vol. 2, no. 2, pp. 246–254, 2021, doi: 10.1016/j.gltp.2021.08.071.

N. Hussain et al., “Application of deep learning to detect Lamb’s quarters (Chenopodium album L.) in potato fields of Atlantic Canada,†Comput. Electron. Agric., vol. 182, no. February, p. 106040, 2021, doi: 10.1016/j.compag.2021.106040.

M. Amo-Boateng, N. Ekow Nkwa Sey, A. Ampah Amproche, and M. Kyereh Domfeh, “Instance segmentation scheme for roofs in rural areas based on Mask R-CNN,†Egypt. J. Remote Sens. Sp. Sci., vol. 25, no. 2, pp. 569–577, 2022, doi: 10.1016/j.ejrs.2022.03.017.

G. Anand and A. K. Kumawat, “Object detection and position tracking in real time using Raspberry Pi,†Mater. Today Proc., vol. 47, pp. 3221–3226, 2021, doi: 10.1016/j.matpr.2021.06.437.

S. Sivkov et al., “The algorithm development for operation of a computer vision system via the OpenCV library,†Procedia Comput. Sci., vol. 169, no. 2019, pp. 662–667, 2020, doi: 10.1016/j.procs.2020.02.193.

M. Qasaimeh et al., “Benchmarking vision kernels and neural network inference accelerators on embedded platforms,†J. Syst. Archit., vol. 113, p. 101896, 2021, doi: 10.1016/j.sysarc.2020.101896.

A. Issac, H. Yadav, G. Rains, and J. M. Velni, “Dimensionality Reduction of High-throughput Phenotyping Data in Cotton Fields,†IFAC-PapersOnLine, vol. 55, no. 32, pp. 153–158, 2022, doi: https://doi.org/10.1016/j.ifacol.2022.11.131.

V. P. Revelli, G. Sharma, and S．Kiruthika devi, “Automate Extraction of Braille Text to Speech From an Image,†Adv. Eng. Softw., vol. 172, p. 103180, 2022, doi: https://doi.org/10.1016/j.advengsoft.2022.103180.

A. Fanariotis, F. Andriopoulou, T. Orphanoudakis, and I. Politis, “An embedded framework enabling access of elderly and disabled persons to IP-based emergency communications,†Microprocess. Microsyst., vol. 68, pp. 74–83, 2019, doi: 10.1016/j.micpro.2019.05.006.




DOI: http://dx.doi.org/10.18517/ijaseit.13.5.18443

Refbacks

  • There are currently no refbacks.


Published by INSIGHT - Indonesian Society for Knowledge and Human Development