AR Simulasi: An Augmented Reality Real-Time Cloud-based Simulation for Off-Site Monitoring in Industrial Manufacturing Application

Jaafar, Siti Aisyah; Abdullah, Sukarnur Che; Jusoh, Mohammad Azzeim Mat; Azmat, Farok; Jaffar, Ahmed

:: International Transaction Journal of Engineering, Management, & Applied Sciences & Technologies

http://TuEngr.com

ISSN 2228-9860
eISSN 1906-9642
CODEN: ITJEA8

FEATURE PEER-REVIEWED ARTICLE

Vol.12(9) (2021)
Special Issue on the Universiti Teknologi MARA (UiTM) R&D Showcase

AR Simulasi: An Augmented Reality Real-Time Cloud-based Simulation for Off-Site Monitoring in Industrial Manufacturing Application

Siti Aisyah Jaafar, Sukarnur Che Abdullah, Mohammad Azzeim Mat Jusoh (Faculty of Mechanical Engineering, Universiti Teknologi MARA, Shah Alam, Selangor, MALAYSIA),
Farok Azmat (Faculty of Computer and Mathematical Science, Universiti Teknologi MARA, Shah Alam, Selangor, MALAYSIA),
Ahmed Jaffar (Faculty of Mechanical Engineering, Universiti Teknologi MARA, Shah Alam, Selangor, MALAYSIA).

Disciplinary: Mechanical and Manufacturing Engineering, Computer Science, Information Technology.
➤ FullText

doi: 10.14456/ITJEMAST.2021.172

Keywords: Augmented Reality (AR); Internet of Things (IoT); 3D Visualization; Real-time remote monitoring; AR conveyor testing; AR-IoT application; Color sorting conveyor; CAD design; AR-IoT application; AR conveyor machine animation; Unity 3D; Accuracy of the color sensing process; Error from IDE; IDE debug.
Abstract

The conventional AR-IoT applications only specialize in the localized area for on-site application, thus leaving a research gap in the utilization of Augmented Reality (AR) for off-site monitoring purposes. Thus, this paper introduces AR-Simulasi, the use of AR as support to off-site IoT monitoring data visualization. An experiment investigates the ability to establish an off-site monitoring system using the AR visualization approach for the AR-Simulasi application. This study applies to a simple material handling system, which is a color sorting conveyor. The real-world machine was re-designed in CAD and imported into Unity to create a working simulation. The simulation is in-sync with the movements of the real machine through the communication between smart sensors and ESP32 microcontrollers. The connection is cloud-based and using MQTT to communicate between different devices. The AR-Simulasi application is easily accessible and can be used to view the real-time processes of the conveyor in 3D visualization. The number of colored cubes, color errors, and several controls are projected in the application's interface. The relationships between accuracy and augmented simulation error were investigated. The result shows the maximum lag time of around one second. The presented results show great potential for improvements in the current AR-IoT monitoring applications for industrial uses.

Paper ID: 12A9D

Cite this article:

Jaafar, S. A., Abdullah, S. C., Jusoh, M. A. M., Azmat, F., and Jaffar, A. (2021). AR Simulasi: An Augmented Reality Real-Time Cloud-based Simulation for Off-Site Monitoring in Industrial Manufacturing Application. International Transaction Journal of Engineering, Management, & Applied Sciences & Technologies, 12(9), 12A9D, 1-9. http://DOI.ORG/10.14456/ITJEMAST.2021.172

References

Alarcon, R. et al. (2020). Augmented Reality for the enhancement of space product assurance and safety. Acta Astronautica, IAA, 168, pp. 191-199. DOI: 10.1016/j.actaastro.2019.10.020
Andreas et al. (2019). Door security system for home monitoring based on ESp32. In Procedia Computer Science, pp. 673-682. DOI: 10.1016/j.procs.2019.08.218
Bellalouna, F. (2020). Industrial Case Studies for Digital Transformation of Engineering Processes using the Virtual Reality Technology. Procedia CIRP, 90, pp. 636-641. DOI: 10.1016/j.procir.2020.01.082
Chylinski, M. et al. (2020). Augmented reality marketing: A technology-enabled approach to situated customer experience. Australasian Marketing Journal. DOI: 10.1016/j.ausmj.2020.04.004
Egger, J. and Masood, T. (2020). Augmented reality in support of intelligent manufacturing - A systematic literature review. Computers and Industrial Engineering, p. 106195. DOI: 10.1016/j.cie.2019.106195
Khan, W. Z. et al. (2020). Industrial internet of things: Recent advances, enabling technologies and open challenges. Computers and Electrical Engineering, 81. DOI: 10.1016/j.compeleceng.2019.106522
Lavingia, K. and Tanwar, S. (2020). Augmented Reality and Industry 4.0. pp. 143-155. DOI: 10.1007/978-3-030-14544-6_8
van Lopik, K. et al. (2020). Developing augmented reality capabilities for industry 4.0 small enterprises: Lessons learnt from a content authoring case study. Computers in Industry, 117. DOI: 10.1016/j.compind.2020.103208
Mehta, R., Sahni, J., Khanna, K. (2018). Internet of Things: Vision, Applications and Challenges. Procedia Computer Science, 132, pp. 1263-1269. DOI: 10.1016/j.procs.2018.05.042
Patel, C. and Doshi, N. (2020). A Novel MQTT Security framework in Generic IoT Model. in Procedia Computer Science, pp. 1399-1408. DOI: 10.1016/j.procs.2020.04.150
Phupattanasilp, P. and Tong, S. R. (2019). Augmented reality in the integrative internet of things (AR-IoT): Application for precision farming. Sustainability, 11(9). DOI: 10.3390/su11092658
Rajkumar, S., Srikanth, M. and Ramasubramanian, N. (2018). Health monitoring system using Raspberry PI. 2017 International Conference on Big Data, IoT and Data Science, BID 2017, 2018-Janua(1), pp. 116-119. DOI: 10.1109/BID.2017.8336583
de Souza Cardoso, L. F., Mariano, F. C. M. Q. and Zorzal, E. R. (2020). A survey of industrial augmented reality. Computers and Industrial Engineering, 139. DOI: 10.1016/j.cie.2019.106159

Other issues:
Vol.12(9)(2021)
Vol.12(8)(2021)
Vol.12(7)(2021)
Vol.12(6)(2021)
Vol.12(5)(2021)
Vol.12(4)(2021)
Archives

Call-for-Papers

Call-for-Scientific Papers
Call-for-Research Papers: ITJEMAST invites you to submit high quality papers for full peer-review and possible publication in areas pertaining engineering, science, management and technology, especially interdisciplinary/cross-disciplinary/multidisciplinary subjects.

To publish your work in the next available issue, your manuscripts together with copyright transfer document signed by all authors can be submitted via email to Editor @ TuEngr.com (no space between). (please see all detail from Instructions for Authors)

Publication and peer-reviewed process:
After the peer-review process (4-10 weeks), articles will be on-line published in the available next issue. However, the International Transaction Journal of Engineering, Management, & Applied Sciences & Technologies cannot guarantee the exact publication time as the process may take longer time, subject to peer-review approval and adjustment of the submitted articles.