MACHINE LEARNING FOR STOCK MARKET SECURITY MEASUREMENT: A COMPARATIVE ANALYSIS OF SUPERVISED, UNSUPERVISED, AND DEEP LEARNING MODELS
Abdullah Al Mamun , Department of Computer & Info Science, Gannon University, Erie, Pennsylvania, USA Md Shakhaowat Hossain , Department of Management Science and Quantitative Methods, Gannon University, USA S M Shadul Islam Rishad , Master Of Science in Information Technology, Westcliff University, USA Md Mohibur Rahman , Fred DeMatteis School of Engineering and Applied Science, Hofstra University, USA Farhan Shakil , Master’s in Cybersecurity Operations, Webster University, Saint Louis, MO, USA Mashaeikh Zaman Md. Eftakhar Choudhury , Master of Social Science in Security Studies, Bangladesh University of Professional (BUP), Dhaka, Bangladesh Ashim Chandra Das , Master of Science in Information Technology, Washington University of Science and Technology, USA Radha Das , IEEE Research Community, IEEE, NJ, USA Sadia Sultana , IEEE Research Community, IEEE, NJ, USAAbstract
This study presents a comprehensive analysis of machine learning techniques for measuring and predicting security in stock markets, comparing the performance of supervised, unsupervised, and deep learning models. Using a diverse dataset from Kaggle that includes historical stock prices, financial news sentiment, company fundamentals, and macroeconomic indicators, we applied feature engineering and rigorous preprocessing methods to optimize model accuracy. The study evaluated Random Forest, Support Vector Machines (SVM), K-Means clustering, and Long Short-Term Memory (LSTM) networks across key performance metrics. Results indicate that Random Forest outperformed other models in classification tasks with an accuracy of 92%, making it highly effective for real-time security assessment. SVM also demonstrated strong classification capabilities, particularly in high-dimensional spaces, with an accuracy of 88%. K-Means and DBSCAN clustering algorithms excelled in anomaly detection, identifying unusual patterns that could signal market irregularities. LSTM models, designed for time-series forecasting, achieved a root mean square error (RMSE) of 1.78, proving their utility in predicting future stock trends but requiring more computational resources.Our findings suggest that a hybrid approach, combining the strengths of supervised and deep learning models, can provide a robust solution for stock market security measurement. By leveraging explainable AI techniques such as SHAP and LIME, we also improved model interpretability, making these predictions more actionable for stakeholders. This research highlights the potential of machine learning in financial security monitoring and supports the growing integration of AI in the finance industry.
Keywords
Machine Learning, Stock Market Security Measurement, Unsupervised
References
Md Abu Sayed, Badruddowza, Md Shohail Uddin Sarker, Abdullah Al Mamun, Norun Nabi, Fuad Mahmud, Md Khorshed Alam, Md Tarek Hasan, Md Rashed Buiya, & Mashaeikh Zaman Md. Eftakhar Choudhury. (2024). COMPARATIVE ANALYSIS OF MACHINE LEARNING ALGORITHMS FOR PREDICTING CYBERSECURITY ATTACK SUCCESS: A PERFORMANCE EVALUATION. The American Journal of Engineering and Technology, 6(09), 81–91. https://doi.org/10.37547/tajet/Volume06Issue09-10
Chen, K. Y., Chang, Y. C., & Hsu, Y. W. (2019). The study of machine learning for stock price prediction. International Journal of Computer Science and Network Security, 19(8), 108-116.
Dixon, M. F., Halperin, I., & Bilokon, P. (2020). Machine Learning in Finance: From Theory to Practice. Springer.
Fischer, T., & Krauss, C. (2018). Deep learning with long short-term memory networks for financial market predictions. European Journal of Operational Research, 270(2), 654-669.
Huang, K., Yu, B., & Hu, Y. (2019). Anomaly detection in stock price movements using machine learning models. Expert Systems with Applications, 123, 246-255.
Jiang, Z., Xu, D., & Liu, J. (2017). Stock market prediction based on deep learning with sentiment analysis. IEEE Access, 5, 388-394.
Lundberg, S. M., & Lee, S. I. (2017). A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems (pp. 4765-4774).
Patel, J., Shah, S., Thakkar, P., & Kotecha, K. (2015). Predicting stock market index using fusion of machine learning techniques. Expert Systems with Applications, 42(4), 2162-2172.
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). "Why should I trust you?" Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1135-1144).
Rundo, F., Trenta, F., Cannata, S., & Martini, M. (2019). Machine learning for quantitative finance applications: A survey. Computers & Electrical Engineering, 81, 106527.
Siami-Namini, S., Tavakoli, N., & Siami Namin, A. (2018). A comparison of ARIMA and LSTM in forecasting time series. 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), 1394-1401.
Zhang, H., & Li, S. (2020). Financial market prediction with machine learning models: A review. Financial Innovation, 6(1), 1-26.
Zhu, X., Zhou, Y., & Wu, Q. (2021). A novel approach for financial time-series data forecasting using deep learning. Journal of Forecasting, 40(3), 352-365.
Md Al-Imran, Salma Akter, Md Abu Sufian Mozumder, Rowsan Jahan Bhuiyan, Tauhedur Rahman, Md Jamil Ahmmed, Md Nazmul Hossain Mir, Md Amit Hasan, Ashim Chandra Das, & Md. Emran Hossen. (2024). EVALUATING MACHINE LEARNING ALGORITHMS FOR BREAST CANCER DETECTION: A STUDY ON ACCURACY AND PREDICTIVE PERFORMANCE. The American Journal of Engineering and Technology, 6(09), 22–33. https://doi.org/10.37547/tajet/Volume06Issue09-04
Md Murshid Reja Sweet, Md Parvez Ahmed, Md Abu Sufian Mozumder, Md Arif, Md Salim Chowdhury, Rowsan Jahan Bhuiyan, Tauhedur Rahman, Md Jamil Ahmmed, Estak Ahmed, & Md Atikul Islam Mamun. (2024). COMPARATIVE ANALYSIS OF MACHINE LEARNING TECHNIQUES FOR ACCURATE LUNG CANCER PREDICTION. The American Journal of Engineering and Technology, 6(09), 92–103. https://doi.org/10.37547/tajet/Volume06Issue09-11
Md Habibur Rahman, Ashim Chandra Das, Md Shujan Shak, Md Kafil Uddin, Md Imdadul Alam, Nafis Anjum, Md Nad Vi Al Bony, & Murshida Alam. (2024). TRANSFORMING CUSTOMER RETENTION IN FINTECH INDUSTRY THROUGH PREDICTIVE ANALYTICS AND MACHINE LEARNING. The American Journal of Engineering and Technology, 6(10), 150–163. https://doi.org/10.37547/tajet/Volume06Issue10-17
DYNAMIC PRICING IN FINANCIAL TECHNOLOGY: EVALUATING MACHINE LEARNING SOLUTIONS FOR MARKET ADAPTABILITY. (2024). International Interdisciplinary Business Economics Advancement Journal, 5(10), 13-27. https://doi.org/10.55640/business/volume05issue10-03
M. S. Haque, M. S. Taluckder, S. Bin Shawkat, M. A. Shahriyar, M. A. Sayed and C. Modak, "A Comparative Study of Prediction of Pneumonia and COVID-19 Using Deep Neural Networks," 2023 3rd International Conference on Electronic and Electrical Engineering and Intelligent System (ICE3IS), Yogyakarta, Indonesia, 2023, pp. 218-223, doi: 10.1109/ICE3IS59323.2023.10335362.
Zhao, L., Zhang, Y., Chen, X., & Huang, Y. (2021). A reinforcement learning approach to supply chain operations management: Review, applications, and future directions. Computers & Operations Research, 132, 105306. https://doi.org/10.1016/j.cor.2021.105306
Nguyen, T. N., Khan, M. M., Hossain, M. Z., Sharif, K. . S., Radha Das, & Haque, M. S. (2024). Product Demand Forecasting For Inventory Management with Freight Transportation Services Index Using Advanced Neural Networks Algorithm. American Journal of Computing and Engineering, 7(4), 50–58. https://doi.org/10.47672/ajce.2432
INNOVATIVE MACHINE LEARNING APPROACHES TO FOSTER FINANCIAL INCLUSION IN MICROFINANCE. (2024). International Interdisciplinary Business Economics Advancement Journal, 5(11), 6-20. https://doi.org/10.55640/business/volume05issue11-02
Md Al-Imran, Eftekhar Hossain Ayon, Md Rashedul Islam, Fuad Mahmud, Sharmin Akter, Md Khorshed Alam, Md Tarek Hasan, Sadia Afrin, Jannatul Ferdous Shorna, & Md Munna Aziz. (2024). TRANSFORMING BANKING SECURITY: THE ROLE OF DEEP LEARNING IN FRAUD DETECTION SYSTEMS. The American Journal of Engineering and Technology, 6(11), 20–32. https://doi.org/10.37547/tajet/Volume06Issue11-04
Tauhedur Rahman, Md Kafil Uddin, Biswanath Bhattacharjee, Md Siam Taluckder, Sanjida Nowshin Mou, Pinky Akter, Md Shakhaowat Hossain, Md Rashel Miah, & Md Mohibur Rahman. (2024). BLOCKCHAIN APPLICATIONS IN BUSINESS OPERATIONS AND SUPPLY CHAIN MANAGEMENT BY MACHINE LEARNING. International Journal of Computer Science & Information System, 9(11), 17–30. https://doi.org/10.55640/ijcsis/Volume09Issue11-03
Md Jamil Ahmmed, Md Mohibur Rahman, Ashim Chandra Das, Pritom Das, Tamanna Pervin, Sadia Afrin, Sanjida Akter Tisha, Md Mehedi Hassan, & Nabila Rahman. (2024). COMPARATIVE ANALYSIS OF MACHINE LEARNING ALGORITHMS FOR BANKING FRAUD DETECTION: A STUDY ON PERFORMANCE, PRECISION, AND REAL-TIME APPLICATION. International Journal of Computer Science & Information System, 9(11), 31–44. https://doi.org/10.55640/ijcsis/Volume09Issue11-04
Nafis Anjum, Md Nad Vi Al Bony, Murshida Alam, Mehedi Hasan, Salma Akter, Zannatun Ferdus, Md Sayem Ul Haque, Radha Das, & Sadia Sultana. (2024). COMPARATIVE ANALYSIS OF SENTIMENT ANALYSIS MODELS ON BANKING INVESTMENT IMPACT BY MACHINE LEARNING ALGORITHM. International Journal of Computer Science & Information System, 9(11), 5–16. https://doi.org/10.55640/ijcsis/Volume09Issue11-02
Md Nur Hossain, Nafis Anjum, Murshida Alam, Md Habibur Rahman, Md Siam Taluckder, Md Nad Vi Al Bony, S M Shadul Islam Rishad, & Afrin Hoque Jui. (2024). PERFORMANCE OF MACHINE LEARNING ALGORITHMS FOR LUNG CANCER PREDICTION: A COMPARATIVE STUDY. International Journal of Medical Science and Public Health Research, 5(11), 41–55. https://doi.org/10.37547/ijmsphr/Volume05Issue11-05
Article Statistics
Copyright License
Copyright (c) 2024 Abdullah Al Mamun, Md Shakhaowat Hossain, S M Shadul Islam Rishad, Md Mohibur Rahman, Farhan Shakil, Mashaeikh Zaman Md. Eftakhar Choudhury, Ashim Chandra Das, Radha Das, Sadia Sultana

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain the copyright of their manuscripts, and all Open Access articles are disseminated under the terms of the Creative Commons Attribution License 4.0 (CC-BY), which licenses unrestricted use, distribution, and reproduction in any medium, provided that the original work is appropriately cited. The use of general descriptive names, trade names, trademarks, and so forth in this publication, even if not specifically identified, does not imply that these names are not protected by the relevant laws and regulations.