MARINE MACHINERY FAULT DIAGNOSIS AND PREDICTIVE MAINTENANCE: A MOBILE AUGMENTED REALITY-DRIVEN HUMAN-COMPUTER INTERACTION FRAMEWORK FOR SHIP AUXILIARY SYSTEMS
Abstract
Marine auxiliary systems operate under variable loads and harsh environments, making early fault identification essential for safety, reliability, and maintenance efficiency. This study develops a mobile augmented reality (AR)-driven human–computer interaction framework for marine machinery fault diagnosis and predictive maintenance. The framework integrates real-time sensor acquisition, machine-learning-based condition assessment, remaining useful life estimation, and context-aware AR visualization to support onboard maintenance decisions. A design-and-experimental research approach was employed using a ship auxiliary machinery testbed representing pumps, compressors, and cooling-system components. Vibration, temperature, pressure, and rotational-speed signals were collected under normal and simulated fault conditions, processed through feature extraction, and classified using an optimized diagnostic model. Predictive performance was evaluated through accuracy, precision, recall, F1-score, and prediction error, while usability was assessed through task completion time and operator evaluation. The proposed framework achieved 96.4% diagnostic accuracy and an F1-score of 0.958, while reducing maintenance task completion time by 28.7% compared with conventional screen-based procedures. Remaining useful life predictions produced a mean absolute percentage error of 8.6%. The findings demonstrate that integrating predictive analytics with mobile AR can improve fault interpretation, maintenance responsiveness, and human–machine collaboration in ship auxiliary systems, providing a practical foundation for intelligent maritime maintenance, particularly during onboard operations.
Full text article
References
Bagci Das, D. (2025). Real-time adaptable fault analysis of rotating machines based on Marine predator algorithm optimised LightGBM approach. Nondestructive Testing and Evaluation, 40(3), 831–866. https://doi.org/10.1080/10589759.2024.2328750
Du, Y., Kong, W., Zhou, F., Wang, R., & Liu, B. (2025). Intelligent fault diagnosis technique for rotating machinery based on parameter-optimised variational mode decomposition and improved bidirectional gated recurrent unit. Insight - Non-Destructive Testing and Condition Monitoring, 67(2), 100–110. https://doi.org/10.1784/insi.2025.67.2.100
Fernandes, M. M., Sousa, J. M. C., & Mendonça, L. F. (2026). Machine Learning Framework for Fault Detection and Diagnosis in Rotating Machinery. Journal of Marine Science and Engineering, 14(3), 291. https://doi.org/10.3390/jmse14030291
Gao, B., Xu, J., Zhang, Z., Liu, Y., & Chang, X. (2024). Marine diesel engine piston ring fault diagnosis based on LSTM and improved beluga whale optimization. Alexandria Engineering Journal, 109, 213–228. https://doi.org/10.1016/j.aej.2024.08.075
Gruia, S.-D., ?tefan, I. A., Oarga, S. A., & Vitca, H. (2026). Scalable Experimental AR Mini-Game for Story-Based Enhancement of Cognitive and Emotional Development in Children. 2026 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR), 1–6. https://doi.org/10.1109/AQTR70159.2026.11577927
Gui, A. (2026). Mobile Interaction Technology-Driven Blended Learning for Higher Education. International Journal of Interactive Mobile Technologies (iJIM), 20(13). https://doi.org/10.3991/ijim.v20i13.62396
Guo, H., & Zhao, X. (2026). An interpretable fault diagnosis method for marine rotating machinery under strong noise based on constrained penalty leech algorithm optimized ICEEMDAN. Ocean Engineering, 344, 123685. https://doi.org/10.1016/j.oceaneng.2025.123685
Guo, X., Yang, Y., He, Z., & Tan, M. (2024). Fault Diagnosis Method Based on MSCNN-BiLSTM for Marine Engine Rolling Bearing. 2024 3rd International Joint Conference on Information and Communication Engineering (JCICE), 212–216. https://doi.org/10.1109/JCICE61382.2024.00051
Guo, Y., Ju, G., & Zhang, J. (2024). A domain generalization network for imbalanced machinery fault diagnosis. Scientific Reports, 14(1), 25447. https://doi.org/10.1038/s41598-024-75088-8
Gustavsen, M., & Louka, M. (2025). Augmented Reality for On-Site Human Factors Control Room Assessment. Nuclear Plant Instrumentation and Control & Human-Machine Interface Technology (NPIC&HMIT 2025), 1650–1658. https://doi.org/10.13182/xyz-46676
Jiang, J., Hu, Y., Chen, Y., & Yan, G. (2024). Feature Extraction and Intelligent Fault Diagnosis of Marine Machinery. Journal of Vibration Engineering & Technologies, 12(1), 201–211. https://doi.org/10.1007/s42417-022-00837-w
Katikala, J., Sharma, K., Ravi Kumar, T. S., & Sharma, S. (2026). Conversational AI for Safety-Critical Virtual and Extended Reality: Intelligent Agents Across Health Informatics, Navigation, and Urban Sensing. 2026 IEEE International Conference on Artificial IntelligenceTesting (AITest), 207–210. https://doi.org/10.1109/AITest70988.2026.00040
Ke, Y., Peng, J., Ding, H., Song, E., Gong, Q., & Jiang, L. (2025). Fault Diagnosis of the Shaft System of Sea Launch Hydrological Ship Based on Dual-Path Residual Convolutional Network under Strong Noise Conditions. 2025 Global Reliability and Prognostics and Health Management Conference (PHM-Xian), 1–7. https://doi.org/10.1109/PHM-Xian66756.2025.11427598
Khan, J., & Nene, M. J. (2026). ThermoNet: A diagnostic thermal imaging AI model for realtime machinery health monitoring. Proceedings of the Institution of Mechanical Engineers, PartO: Journal of Risk and Reliability, 240(4), 1379–1398. https://doi.org/10.1177/1748006X261444412
Kim, S. H., Song, H. M., Jeong, S. H., Lee, W. J., & Kim, S. J. (2025). Fault Signal Emulation of Marine Turbo-Rotating Systems Based on Rotor-Gear Dynamic Interaction Modeling. Journal of Marine Science and Engineering, 13(7), 1321. https://doi.org/10.3390/jmse13071321
Latreche, M. R., Gouin-Vallerand, C., Mosconi, E., & Friji, R. (2026). Smart AR: A BPMN-Based Authoring Tool for Sensor-Driven Augmented Reality Workflows. In J. Y. C. Chen & G. Fragomeni (Eds.), Virtual, Augmented and Mixed Reality (Vol. 16718, pp. 199–217). Springer Nature Switzerland. https://doi.org/10.1007/978-3-032-31424-6_12
Liu, Y., & Gan, H. (2025). PFGAF and MSPCANet-GCL: A general fault diagnosis method for marine machinery components with data imbalance. Ocean Engineering, 333, 121497. https://doi.org/10.1016/j.oceaneng.2025.121497
Lou, C., Atoui, M. A., Zhang, X., Xu, D., & Zhong, H. (2026). Semi-supervised graph neural networks for fault diagnosis in marine machinery. Engineering Applications of Artificial Intelligence, 177, 114951. https://doi.org/10.1016/j.engappai.2026.114951
Lv, Y., Hao, J., Tang, M., & Wu, J. (2025). Multimodal data fusion-based intelligent fault diagnosis for ship rotating machinery: Status quo and perspectives. Engineering Applications of Artificial Intelligence, 160, 111767. https://doi.org/10.1016/j.engappai.2025.111767
Lv, Y., Xiong, K., Yao, J., Zhao, S., & Li, Y. (2025). Virtual-physical collaborative intelligent fault diagnosis for marine rotating machinery under data scarcity towards digital twin. Ocean Engineering, 340, 122198. https://doi.org/10.1016/j.oceaneng.2025.122198
Ma, X., Patil, C., Zhang, X., & Tadros, M. (2026). Machine Learning-Based Discrimination of Pre- and Post-Cleaning Marine Turbocharger Recordings Using Rotational-Speed Signals. Journal of Marine Science and Engineering, 14(19), 1812. https://doi.org/10.3390/jmse14191812
Moolkham, M. (2025). Digital transformation, financial performance and firm valuation: The moderating effect of environmental risk. Journal of Climate Finance, 13, 100075. https://doi.org/10.1016/j.jclimf.2025.100075
Nawaz, F., & Mughal, H. (2025). Enabling Low-Latency Real-Time Gaming through Edge Computing and Wireless Optimization: Trends, Challenges, and Future Directions. 2025 5th International Conference on Digital Futures and Transformative Technologies (ICoDT2), 1–6. https://doi.org/10.1109/ICoDT269104.2025.11360713
Nayana, B. R., Subha, R., Radhakrishnan, R., & Geethanjali, P. (2025). Scalable bearing fault diagnosis using metaheuristic feature selection and machine learning for diverse operating conditions. Systems Science & Control Engineering, 13(1), 2469606. https://doi.org/10.1080/21642583.2025.2469606
Orhan, M., & Celik, M. (2024). A literature review and future research agenda on fault detection and diagnosis studies in marine machinery systems. Proceedings of the Institution of Mechanical Engineers, Part M: Journal of Engineering for the Maritime Environment, 238(1), 3–21. https://doi.org/10.1177/14750902221149291
Rakesh, I. V., Markande, A., Dheeraj, R., Anand, V., & Jha, S. (2025). Demonstration of Robotic Welding Operation Using Immersive Augmented Reality Experience. In A. Chakrabarti, S. Suwas, & M. Arora (Eds.), Industry 4.0 and Advanced Manufacturing, Volume 2 (pp. 129–138). Springer Nature Singapore. https://doi.org/10.1007/978-981-97-6176-0_12
Ranganayaka, C., Sandamali, R., Priyashan, S., Himsara, N., Siriwardana, G. C., & Sooriyapperuma, K. C. (2026). Development of a Vibration-Based System to Detect Internal Combustion Engine Faults. 2026 Moratuwa Engineering Research Conference (MERCon), 1010–1015. https://doi.org/10.1109/MERCon71835.2026.11691471
Sang, P., Tan, Y., & Gao, Q. (2025). Cross-domain simultaneous fault diagnosis of marine machinery with multi-source and multi-scale feature fusion. Engineering Research Express, 7(4), 045246. https://doi.org/10.1088/2631-8695/ae1281
Sehri, M., Hua, Z., Boldt, F. D. A., & Dumond, P. (2025). Selective embedding for deep learning. Knowledge-Based Systems, 330, 114535. https://doi.org/10.1016/j.knosys.2025.114535
Su, Y., Guo, Y., Zhang, J., & Shi, J. (2024). A Novel Open Set Adaptation Network for Marine Machinery Fault Diagnosis. Journal of Marine Science and Engineering, 12(8), 1382. https://doi.org/10.3390/jmse12081382
Sun, J., Ren, H., Dong, Y., Zhang, B., Qiu, S., & Zhou, Y. (2026). An Enhanced Digital Twin-Driven Fault Diagnosis Approach Based on Deep Multimodal Information Fusion for Marine Machinery. IEEE Sensors Journal, 26(3), 4139–4156. https://doi.org/10.1109/JSEN.2025.3644934
Tadi?, L., Golub Medvešek, I., Vujovi?, I., & Šoda, J. (2025). Infrared Thermography in Maritime Systems: A Systematic Review. Applied Sciences, 15(23), 12551. https://doi.org/10.3390/app152312551
Van Reen, S., Serbülent, B., & Yao, H.-D. (2025). Machine learning-based multipoint optimisation for improving aerodynamics of symmetrically cambered wing sails in wind-assisted ship propulsion. Ocean Engineering, 342, 122829. https://doi.org/10.1016/j.oceaneng.2025.122829
Velasco-Gallego, C., Lazakis, I., & Cubo-Mateo, N. (2024). Development of a Hierarchical Clustering Method for Anomaly Identification and Labelling of Marine Machinery Data. Journal of Marine Science and Engineering, 12(10), 1792. https://doi.org/10.3390/jmse12101792
Wang, L., Cao, H., Ai, Z., Shen, H., Wang, T., Wang, Y., & Meng, L. (2026). From limited historical conditions to unseen working conditions: A diffusion-guided distribution and semantic collaborative alignment network. Applied Soft Computing, 203, 116001. https://doi.org/10.1016/j.asoc.2026.116001
Wang, S., Lian, G., Cheng, C., & Chen, H. (2024). A novel method of rolling bearings fault diagnosis based on singular spectrum decomposition and optimized stochastic configuration network. Neurocomputing, 574, 127278. https://doi.org/10.1016/j.neucom.2024.127278
Wu, J., & Shen, Y. (2025). Design and Evaluation of an Augmented Reality and Generative AI-Driven English Speaking Training System. International Journal of Interactive Mobile Technologies (iJIM), 19(21), 34–48. https://doi.org/10.3991/ijim.v19i21.58851
Zhang, H., Han, W., Bai, C., Li, W., Wang, X., & Liu, Y. (2025). Recent progress and development trends of oil wear particle detection sensors applied in marine machinery condition monitoring. Physica Scripta, 100(1), 012003. https://doi.org/10.1088/1402-4896/ad9c29
Authors
Copyright (c) 2026 Ardiansyah Ardiansyah

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.