Improving Imbalanced Data Classification Using Deep Learning
DOI:
https://doi.org/10.22399/ijcesen.3367Keywords:
Imbalanced Data, Fraud Detection, Deep Learning, Neural Networks, Ensemble LearningAbstract
Classifying imbalanced data is a difficult task in many machine learning applications, especially in the context of fraud detection. This paper evaluated the performance of traditional models (e.g., Random Forests, XGBoost, and CatBoost) against the performance of deep learning models. While the traditional models were able to obtain high accuracy, they struggled to identify the rare classes (i.e., fraudulent transactions) when the F1 scores did not get above 0.33. In turn, a deep learning model was proposed that applied ideas such as class weights, decision thresholds, and F1-maximizing training objectives and was designed to employ voting of multiple submodels. The results demonstrated that the proposed model (Ensemble Neural Network) was able to achieve an F1 score of 0.5997 and an AUC-PR score of 0.6205 which outperformed the traditional methods previously used in the study. This design was used to achieve a better balance between identifying the rare classes and overall model performance.
References
[1] Razzaq, K., & Shah, M. (2025). Machine Learning and Deep Learning Paradigms: From Techniques to Practical Applications and Research Frontiers. Computers, 14(3), 93.
[2] Dritsas, E., & Trigka, M. (2025). Exploring the Intersection of Machine Learning and Big Data: A Survey. Machine Learning and Knowledge Extraction, 7(1), 13.
[3] Ghosh, K., Bellinger, C., Corizzo, R. et al. The class imbalance problem in deep learning. Mach Learn 113, 4845–4901 (2024).
[4] Altalhan, Manahel & Algarni, Abdulmohsen & Monia, Turki. (2025). Imbalanced Data Problem in Machine Learning: A Review. IEEE Access. PP. 1-1. 10.1109/ACCESS.2025.3531662.
[5] Theodorakopoulos, L., Theodoropoulou, A., Tsimakis, A., & Halkiopoulos, C. (2025). Big Data-Driven Distributed Machine Learning for Scalable Credit Card Fraud Detection Using PySpark, XGBoost, and CatBoost. Electronics, 14(9), 1754.
[6] Kim, H. (2025). Novel Deep Learning-Based Facial Forgery Detection for Effective Biometric Recognition. Applied Sciences, 15(7), 3613.
[7] Kopyt, M., Piotrowski, P., & Baczyński, D. (2024). Short-Term Energy Generation Forecasts at a Wind Farm—A Multi-Variant Comparison of the Effectiveness and Performance of Various Gradient-Boosted Decision Tree Models. Energies, 17(23), 6194.
[8] Kumar, V., Kedam, N., Sharma, K. V., Khedher, K. M., & Alluqmani, A. E. (2023). A Comparison of Machine Learning Models for Predicting Rainfall in Urban Metropolitan Cities. Sustainability, 15(18), 13724.
[9] Aguilar-Ruiz, J.S., Michalak, M. Classification performance assessment for imbalanced multiclass data. Sci Rep 14, 10759 (2024).
[10] Pagano, T. P., Loureiro, R. B., Lisboa, F. V. N., Peixoto, R. M., Guimarães, G. A. S., Cruz, G. O. R., Araujo, M. M., Santos, L. L., Cruz, M. A. S., Oliveira, E. L. S., Winkler, I., & Nascimento, E. G. S. (2023). Bias and Unfairness in Machine Learning Models: A Systematic Review on Datasets, Tools, Fairness Metrics, and Identification and Mitigation Methods. Big Data and Cognitive Computing, 7(1), 15.
[11] Sakri, S., & Basheer, S. (2023). Fusion Model for Classification Performance Optimization in a Highly Imbalance Breast Cancer Dataset. Electronics, 12(5), 1168.
[12] Yang, Yuxuan & Khorshidi, Hadi & Aickelin, Uwe. (2024). A review on over-sampling techniques in classification of multi-class imbalanced datasets: insights for medical problems. Frontiers in Digital Health. 6. 1430245. 10.3389/fdgth.2024.1430245.
[13] Irfan, Muhammad & Mushtaq, Zohaib & Khan, Nabeel & Mursal, Salim & Rahman, Saifur & Magzoub, Muawia & Latif, Muhammad Armghan & Althobiani, Faisal & Khan Yousufzai, Imran & Abbas, Ghulam. (2023). A Scalo gram-based CNN Ensemble Method with Density-Aware SMOTE Oversampling for Improving Bearing Fault Diagnosis. IEEE Access. PP. 1-1. 10.1109/ACCESS.2023.3332243.
[14] Mazdadi, Muhammad & Saragih, Triando Hamonangan & Budiman, Irwan & Farmadi, Andi & Tajali, Ahmad. (2024). The Effectiveness of Data Imputations on Myocardial Infarction Complication Classification Using Machine Learning Approach with Hyperparameter Tuning. Jurnal Ilmiah Teknik Elektro Komputer dan Informatika. 10. 520-533. 10.26555/jiteki.v10i3.29479.
[15] Farhadpour, Sarah & Warner, Timothy & Maxwell, Aaron. (2024). Selecting and Interpreting Multiclass Loss and Accuracy Assessment Metrics for Classifications with Class Imbalance: Guidance and Best Practices. Remote Sensing. 16. 533. 10.3390/rs16030533.
[16] Imrana, Y., Xiang, Y., Ali, L. et al. CNN-GRU-FF: a double-layer feature fusion-based network intrusion detection system using convolutional neural network and gated recurrent units. Complex Intell. Syst. 10, 3353–3370 (2024).
[17] Palak Gupta, Anmol Varshney, Mohammad Rafeek Khan, Rafeeq Ahmed, Mohammed Shuaib, Shadab Alam, Unbalanced Credit Card Fraud Detection Data: A Machine Learning-Oriented Comparative Study of Balancing Techniques, Procedia Computer Science, Volume 218, 2023, Pages 2575-2584, ISSN 1877-0509.
[18] Sarker, I.H. Machine Learning: Algorithms, Real-World Applications and Research Directions. SN COMPUT. SCI. 2, 160 (2021).
[29] Razzaq, K., & Shah, M. (2025). Machine Learning and Deep Learning Paradigms: From Techniques to Practical Applications and Research Frontiers. Computers, 14(3), 93.
[20] S. Cheng et al., "Machine Learning With Data Assimilation and Uncertainty Quantification for Dynamical Systems: A Review," in IEEE/CAA Journal of Automatica Sinica, vol. 10, no. 6, pp. 1361-1387, June 2023, doi: 10.1109/JAS.2023.123537.
[21] Eduardo F. Morales, Hugo Jair Escalante, Chapter 6 - A brief introduction to supervised, unsupervised, and reinforcement learning, Editor(s): Alejandro A. Torres-García, Carlos A. Reyes-García, Luis Villaseñor-Pineda, Omar Mendoza-Montoya, Biosignal Processing and Classification Using Computational Learning and Intelligence, Academic Press, 2022, Pages 111-129, ISBN 9780128201251.
[22] Ali, A., Abd Razak, S., Othman, S. H., Eisa, T. A. E., Al-Dhaqm, A., Nasser, M., Elhassan, T., Elshafie, H., & Saif, A. (2022). Financial Fraud Detection Based on Machine Learning: A Systematic Literature Review. Applied Sciences, 12(19), 9637.
[23] Fazil, A. W., Hakimi, M., Akbari, R., Quchi, M. M., & Khaliqyar, K. Q. (2023). Comparative analysis of machine learning models for data classification: An in-depth exploration. Journal of Computer Science and Technology Studies, 5(4), 160-168.
[24] Lijie Zhang, Dominik Jánošík, Enhanced short-term load forecasting with hybrid machine learning models: CatBoost and XGBoost approaches, Expert Systems with Applications, Volume 241, 2024, 122686, ISSN 0957-4174.
[25] Sharma, S., & Gosain, A. (2025). Addressing class imbalance in remote sensing using deep learning approaches: a systematic literature review. Evolutionary Intelligence, 18(1), 1-28. ISO 690
[26] M. Altalhan, A. Algarni and M. Turki-Hadj Alouane, "Imbalanced Data Problem in Machine Learning: A Review," in IEEE Access, vol. 13, pp. 13686-13699, 2025, doi: 10.1109/ACCESS.2025.3531662.
[27] Taye, M. M. (2023). Understanding of Machine Learning with Deep Learning: Architectures, Workflow, Applications and Future Directions. Computers, 12(5), 91. https://doi.org/10.3390/computers12050091.
[28] Sakib, M., Mustajab, S., & Alam, M. (2025). Ensemble deep learning techniques for time series analysis: a comprehensive review, applications, open issues, challenges, and future directions. Cluster Computing, 28(1), 1-44.
[29] Ruby, U., & Yendapalli, V. (2020). Binary cross entropy with deep learning technique for image classification. Int. J. Adv. Trends Comput. Sci. Eng, 9(10). ISO 690
[30] Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., ... & Gandomi, A. H. (2023). Deep learning modelling techniques: current progress, applications, advantages, and challenges. Artificial Intelligence Review, 56(11), 13521-13617. ISO 690
[31] Mienye, I. D., & Swart, T. G. (2024). A comprehensive review of deep learning: Architectures, recent advances, and applications. Information, 15(12), 755.
[32] M. Altalhan, A. Algarni and M. Turki-Hadj Alouane, "Imbalanced Data Problem in Machine Learning: A Review," in IEEE Access, vol. 13, pp. 13686-13699, 2025, doi: 10.1109/ACCESS.2025.3531662.
[33] Fang, C., He, H., Long, Q., & Su, W. J. (2021). Exploring deep neural networks via layer-peeled model: Minority collapse in imbalanced training. Proceedings of the National Academy of Sciences, 118(43), e2103091118.
[34] Esposito, C., Landrum, G. A., Schneider, N., Stiefl, N., & Riniker, S. (2021). GHOST: adjusting the decision threshold to handle imbalanced data in machine learning. Journal of Chemical Information and Modeling, 61(6), 2623-2640.
[35] Fadi Thabtah, Suhel Hammoud, Firuz Kamalov, Amanda Gonsalves, Data imbalance in classification: Experimental evaluation, Information Sciences, Volume 513, 2020, Pages 429-441, ISSN 0020-0255, https://doi.org/10.1016/j.ins.2019.11.004
[36] M. Altalhan, A. Algarni and M. Turki-Hadj Alouane, "Imbalanced Data Problem in Machine Learning: A Review," in IEEE Access, vol. 13, pp. 13686-13699, 2025, doi: 10.1109/ACCESS.2025.3531662.
[37] Calabrese, F., Regattieri, A., Bortolini, M., & Galizia, F. G. (2022). Data-driven fault detection and diagnosis: Challenges and opportunities in real-world scenarios. Applied Sciences, 12(18), 9212.
[38] Owusu-Adjei, M., Ben Hayfron-Acquah, J., Frimpong, T., & Abdul-Salaam, G. (2023). Imbalanced class distribution and performance evaluation metrics: A systematic review of prediction accuracy for determining model performance in healthcare systems. PLOS Digital Health, 2(11), e0000290.
[39] Douzas, G., Bacao, F., Fonseca, J., & Khudinyan, M. (2019). Imbalanced learning in land cover classification: Improving minority classes’ prediction accuracy using the geometric SMOTE algorithm. Remote Sensing, 11(24), 3040.
[40] Asare, M. (2024). Evaluating Feature Selection Methods in Machine Learning With Class Imbalance (Master's thesis, The University of Texas Rio Grande Valley).
[41] Wongvorachan, T., He, S., & Bulut, O. (2023). A comparison of undersampling, oversampling, and SMOTE methods for dealing with imbalanced classification in educational data mining. Information, 14(1), 54.
[42] Ghosh, K., Bellinger, C., Corizzo, R., Branco, P., Krawczyk, B., & Japkowicz, N. (2024). The class imbalance problem in deep learning. Machine Learning, 113(7), 4845-4901.
[43] Khatir, Ahmed & Bee, Marco. (2022). Machine Learning Models and Data-Balancing Techniques for Credit Scoring: What Is the Best Combination?. Risks. 10. 10.3390/risks10090169.
[44] Akinjole, Abisola & Shobayo, Olamilekan & Popoola, Jumoke & Okoyeigbo, Obinna & Ogunleye, Bayode. (2024). Ensemble-Based Machine Learning Algorithm for Loan Default Risk Prediction. Mathematics. 12. 3423. 10.3390/math12213423.
[45] Alagic, A., Zivic, N., Kadusic, E., Hamzic, D., Hadzajlic, N., Dizdarevic, M., & Selmanovic, E. (2024). Machine Learning for an Enhanced Credit Risk Analysis: A Comparative Study of Loan Approval Prediction Models Integrating Mental Health Data. Machine Learning and Knowledge Extraction, 6(1), 53-
[46] T. Chaturvedi, S. Halder, U. S. kumar, N. Das and S. Bittu, "Comparative Performance Analysis of Machine Learning Algorithms for Non-Performing Loan Prediction," 2025 International Conference on Computational, Communication and Information Technology (ICCCIT), Indore, India, 2025, pp. 13-18, doi: 10.1109/ICCCIT62592.2025.10928008.
[47] Zhao, Z., Cui, T., Ding, S., Li, J., & Bellotti, A. G. (2024). Resampling Techniques Study on Class Imbalance Problem in Credit Risk Prediction. Mathematics, 12(5), 701.
[48] Yang, Dongqi & Xiao, Binqing. (2024). Feature Enhanced Ensemble Modeling With Voting Optimization for Credit Risk Assessment. IEEE Access. PP. 1-1. 10.1109/ACCESS.2024.3445499.
[49] Abidemi, Abiodun & Ajegbile, Mojeed & Ajegbile, Yusuff & Adedeji, Joy & Dada, Cecilia. (2023). A Deep Learning Prediction Model For Loan Default.
[50] Long, Zhi & Chen, Xiangzhou. (2023). Early warning research on enterprise carbon emission reduction credit risk based on deep learning model under unbalanced data. Frontiers in Energy Research. 11. 10.3389/fenrg.2023.1274425.
[51] Paudel, Sagun & Devkota, Bidur & Timilsina, Suresh. (2023). Multi-Class Credit Risk Analysis Using Deep Learning. Journal of Engineering and Sciences. 2. 82-87. 10.3126/jes2.v2i1.60399.
[52] Fan Yang, Yanan Qiao, Cheng Huang, Shan Wang, Xiao Wang, An Automatic Credit Scoring Strategy (ACSS) using memetic evolutionary algorithm and neural architecture search, Applied Soft Computing, Volume 113, Part A, 2021, 107871, ISSN 1568-4946.
[53] Zhuang, Yanyu & Wei, Hua. (2024). Design of a Personal Credit Risk Prediction Model and Legal Prevention of Financial Risks. IEEE Access. PP. 1-1. 10.1109/ACCESS.2024.3466192.
[54] Liang, Yancheng & Zhang, Jiajie & Li, Hui & Liu, Xiaochen & Hu, Yi & Wu, Yong & Zhang, Jinyao & Liu, Yongyan & Wu, Yi. (2023). DeRisk: An Effective Deep Learning Framework for Credit Risk Prediction over Real-World Financial Data. 10.48550/arXiv.2308.03704.
[55] Hung, Ming-Hung & Ku, Chao-Hsun & Chen, Kai-Ying. (2023). Application of Task-Aligned Model Based on Defect Detection. Automation. 4. 327-344. 10.3390/automation4040019.
[56] Olushola, Akinbusola & Mart, Joseph. (2024). Fraud Detection using Machine Learning. 10.14293/PR2199.000647.v1.
[57] A, Mrs. (2025). Online Payment Fraud Detection Using Machine Learning. INTERANTIONAL Journal Of Scientific Research In Engineering And Management. 09. 1-9. 10.55041/Ijsrem42092.
[58] John, Ada & Elly, Abill & Noah, Asher. (2025). Real-Time Fraud Detection Using Machine Learning Techniques.
[59] Chung, Jiwon & Lee, Kyungho. (2023). Credit Card Fraud Detection: An Improved Strategy for High Recall Using KNN, LDA, and Linear Regression. Sensors. 23. 7788. 10.3390/s23187788.
[60] Nobel, S.M.N., Swapno, S.M.M.R., Islam, M.R. et al. A machine learning approach for vocal fold segmentation and disorder classification based on ensemble method. Sci Rep 14, 14435 (2024).
[61] Emi-Johnson, Oluwabukola & Nkrumah, Kwame & Folasole, Adetayo & Amusa, Tope. (2023). Optimizing Machine Learning for Imbalanced Classification: Applications in U.S. Healthcare, Finance, and Security. 10.5281
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 International Journal of Computational and Experimental Science and Engineering
This work is licensed under a Creative Commons Attribution 4.0 International License.
