Design and Build a Prayer Rak’ah Reminder Device for Elderly People with Pose Detection Using MediaPipe Based on Raspberry Pi

Authors

  • Luthfi Kukuh Raharjo Digital Telecommunication Network Study Program, Department of Electrical Engineering, State Polytechnic of Malang, 65141, Indonesia
  • Abdul rasyid Telecommunication Engineering Study Program, Department of Electrical Engineering, State Polytechnic of Malang, 65141, Indonesia
  • Moh. Abdullah Anshori Digital Telecommunication Network Study Program, Department of Electrical Engineering, State Polytechnic of Malang, 65141, Indonesia

Keywords:

Prayer Rak’ah, Prayer Poses, MediaPipe, Pose Detection

Abstract

Establishing the five obligatory prayers is a necessity that Muslims must undertake. Problems often occur in people with memory problems, such as the elderly. Obstacles that often occur include forgetting the rak'ah and difficulty remembering the next pose to be performed. New technologies continue to emerge including digital imagery. Digital imagery can be used to help with these problems by utilizing pose detection using the MediaPipe library. MediaPipe is used to determine body parts visibility and joint angles captured by the webcam to detect performed pose. By detecting the pose, the output is then generated in an LED Matrix display namely the rak'ah and pose. The results of this study showed that the percentage of success in identifying ruku’ is 93.73%, i’tidal is 94.12%, sujud is 92.55%, first tahiyah is 89.17%, final tahiyah is 82%, with the highest percentage of 98.04% in standing pose. The pose detection success percentages based on the distance between the performer and the webcam are from 150cm is 91.88% success percentage, at 200cm success percentage is 92.42%, and at a distance of 250cm is 93.75%, with the highest success percentage at the distance of 250cm. The system average delay for detecting poses is 1.028 seconds.

References

A. Anilkumar, A. K.T., S. Sajan, and S. K.A., “Pose Estimated Yoga Monitoring System,” SSRN Electron. J., no. Icicnis, pp. 1–8, 2021, doi: 10.2139/ssrn.3882498.

A. Halder and A. Tayade, “Real-time Vernacular Sign Language Recognition using MediaPipe and Machine Learning,” Int. J. Res. Publ. Rev., no. 2, pp. 9–17, 2021, [Online]. Available: www.ijrpr.com

B. Lanza, M. Lancini, C. Nuzzi, and S. Pasinetti, “Deep Learning for Gesture Recognition in Gym Training Performed By a Vision-Based Augmented Reality Smart Mirror,” pp. 363–366, 2022.

H. Moetia Putri and W. Fuadi, “Pendeteksian Bahasa Isyarat Indonesia Secara Real-Time Menggunakan Long Short-Term Memory (Lstm)”.

Indriani, M. Harris, and A. S. Agoes, “Applying Hand Gesture Recognition for User Guide Application Using MediaPipe,” Proc. 2nd Int. Semin. Sci. Appl. Technol. (ISSAT 2021), vol. 207, no. Issat, pp. 101–108, 2021, doi: 10.2991/aer.k.211106.017.

C. Lugaresi et al., “MediaPipe: A Framework for Building Perception Pipelines,” 2019, [Online]. Available: http://arxiv.org/abs/1906.08172

Google LLC, “MediaPipe Pose,” GitHub, 2020. https://google.github.io/mediapipe/solutions/pose (accessed Feb. 20, 2022).

G. Bradski and A. Kaehler, Learning OpenCV: Computer Vision with the OpenCV Library, First. Sebastopol: O’Reilly Media, Inc, 2008.

G. Zaccone, M. R. Karim, and A. Menshawy, Deep Learning with TensorFlow, First. Mumbai: Packt Publishing Ltd., 2017.

Raspberry Pi Foundation, “What is a Raspberry Pi?,” Raspberry Pi Foundation, 2014. https://www.raspberrypi.org/help/what- is-a-raspberry-pi/#:~:text=The Raspberry Pi is a,languages like Scratch and Python. (accessed Feb. 20, 2022).

H. A. Dharmawan, Mikrokontroler: Konsep Dasar dan Praktis. Malang: UB Press, 2017.

A. S. Nataprawira, A. Rizal, and A. S. Wibowo, “Perancangan Display Led Dot Matrix Via Wi-Fi Menggunakan Aplikasi Mobile Android,” Intech, vol. 1, no. 1, pp. 1–7, 2020.

A. Sonita and R. F. Fardianitama, “Aplikasi E-Order Menggunakan Firebase dan Algoritme Knuth Morris Pratt Berbasis Android,” Pseudocode, vol. 5, no. 2, pp. 38–45, 2018, doi: 10.33369/pseudocode.5.2.38-45.

Herlinah and M. KH, Pemrograman Aplikasi Android dengan Android Studio, Photoshop, dan Audition. Jakarta: Elex Media Komputindo, 2019.

Sri Haryati, “( R & D ) Sebagai Salah Satu Model Penelitian Dalam Bidang Pendidikan,” Academia, vol. 37, no. 1, p. 13, 2012.

Downloads

Published

2023-09-19

How to Cite

[1]
L. K. Raharjo, A. rasyid, and M. A. Anshori, “Design and Build a Prayer Rak’ah Reminder Device for Elderly People with Pose Detection Using MediaPipe Based on Raspberry Pi”, Jartel, vol. 13, no. 3, pp. 292-298, Sep. 2023.