Data Infrastructure Modernization as a Foundation for Real-Time AI Decisioning: A Case Study in Relational-to-NoSQL Migration for Large-Scale Retail Platforms

Authors

  • Kunal Arya

DOI:

https://doi.org/10.22399/ijcesen.5558

Keywords:

Data Infrastructure Modernization, NoSQL Migration, Real-Time AI Decisioning, Microservices Architecture, Distributed Databases,, Azure Cosmos DB

Abstract

Real-time AI/ML-driven decisioning is increasingly central to consumer platforms, from fraud detection to product-eligibility scoring — but these systems depend on a data layer capable of low-latency reads, horizontal scale, and high availability, which legacy relational architectures are often not designed for. This paper presents a case study of migrating a set of Oracle-based enterprise applications, spanning customer profile management and loyalty programs at a large multinational retailer, to a distributed multi-model NoSQL architecture (Azure Cosmos DB) alongside PostgreSQL, carried out alongside decomposing seven-plus monolithic applications into highly available microservices across more than fifteen tier-1 and ten tier-2 production systems. We report the operational outcomes observed — an approximately 50% reduction in infrastructure cost and sustained 99.99% availability (100% during peak holiday traffic) — and discuss the architectural decisions (service decomposition boundaries, phased cutover, rollback strategy) that made them achievable. We then connect these data-layer modernization patterns to the broader industry shift toward embedding AI-driven decisioning directly into consumer-facing transaction flows, illustrating with a public example from a separate large-scale fintech platform where a comparable low-latency data foundation is reported to have supported an AI-based decisioning engine that improved decision speed by approximately 75%. We argue that the data-layer modernization choices described here are a necessary, and frequently underexamined, prerequisite for organizations pursuing real-time AI decisioning at scale.

References

1. Al Manir, M. S., Brenas, J. H., Baker, C. J., & Shaban-Nejad, A. (2018). A surveillance infrastructure for malaria analytics: provisioning data access and preservation of interoperability. JMIR Public Health and Surveillance, 4(2), e10218. https://publichealth.jmir.org/2018/2/e10218/ DOI: https://doi.org/10.2196/10218

2. Bhardwaj, P. (2020). Designing Multi-Tier Applications Using Azure App Services. IJSAT-International Journal on Science and Technology, 11(1). https://www.academia.edu/download/120880280/Designing_Multi_Tier_Applications_Using_Azure_App_Services.pdf

3. Borra, P. (2022). Exploring Microsoft Azure's Cloud Computing: A Comprehensive Assessment. International Journal of Advanced Research in Science, Communication and Technology (IJARSCT) Volume, 2. https://papers.ssrn.com/sol3/Delivery.cfm?abstractid=4914159

4. Castro, A., Machado, J., Roggendorf, M., & Soller, H. (2020). How to build a data architecture to drive innovation—today and tomorrow. Technology, McKinsey& Company. https://www.mckinsey.com/~/media/McKinsey/Business%20Functions/McKinsey%20Digital/Our%20Insights/How%20to%20build%20a%20data%20architecture%20to%20drive%20innovation%20today%20and%20tomorrow/How-to-build-a-data-architecture-to-drive-innovation.pdf

5. Di Francesco, P., Lago, P., & Malavolta, I. (2018, April). Migrating towards microservice architectures: an industrial survey. In 2018 IEEE international conference on software architecture (ICSA) (pp. 29-2909). IEEE. https://research.vu.nl/files/246830036/Migrating_towards_Microservice_Architectures_an_Industrial_Survey.pdf DOI: https://doi.org/10.1109/ICSA.2018.00012

6. Kodakandla, P. (2022). Modernizing legacy Hadoop infrastructure through cloud-native migration on AWS. Cloud Computing Advances and Security Systems Journal, 7(5), 768-782. https://www.researchgate.net/profile/Praveen-Kodakandla/publication/397281085_Modernizing_Legacy_Hadoop_Infrastructure_through_Cloud-Native_Migration_on_AWS/links/690ade75a2b691617b697fbe/Modernizing-Legacy-Hadoop-Infrastructure-through-Cloud-Native-Migration-on-AWS.pdf

7. Li, S., Zhang, H., Jia, Z., Li, Z., Zhang, C., Li, J., ... & Shan, Z. (2019). A dataflow-driven approach to identifying microservices from monolithic applications. Journal of Systems and Software, 157, 110380. https://drive.google.com/file/d/1elMxFkpaxjx8V7BSzKA_sbYsMpaCtXz3/view DOI: https://doi.org/10.1016/j.jss.2019.07.008

8. Lu, J., & Holubová, I. (2019). Multi-model databases: a new journey to handle the variety of data. ACM Computing Surveys (CSUR), 52(3), 1-38. https://dl.acm.org/doi/pdf/10.1145/3323214 DOI: https://doi.org/10.1145/3323214

9. Mays, A. N., Goethals, T., & Volckaert, B. (2022, October). Intent-based decentralized orchestration for green energy-aware provisioning of fog-native workflows. In 2022 18th International Conference on Network and Service Management (CNSM) (pp. 184-190). IEEE. https://repository.essex.ac.uk/33720/1/wf_distribution-3.pdf DOI: https://doi.org/10.23919/CNSM55787.2022.9964993

10. Narani, S. R., Ayyalasomayajula, M. M. T., & Chintala, S. (2018). Strategies for migrating large, mission-critical database workloads to the cloud. Webology (ISSN: 1735-188X), 15(1). https://www.researchgate.net/profile/Sandeep-Narani/publication/384267374_Strategies_For_Migrating_Large_Mission-Critical_Database_Workloads_To_The_Cloud/links/66f22d8d19c9496b1fb9b497/Strategies-For-Migrating-Large-Mission-Critical-Database-Workloads-To-The-Cloud.pdf

11. van de Laar, A. W., Van Rijswijk, A. S., Kakar, H., & Bruin, S. C. (2018). Sensitivity and specificity of 50% excess weight loss (50% EWL) and twelve other bariatric criteria for weight loss success. Obesity surgery, 28(8), 2297-2304. https://research.vu.nl/ws/portalfiles/portal/398266555/vrijsw2%20-%2067bb9a22cf6a2.pdf#page=47 DOI: https://doi.org/10.1007/s11695-018-3173-4

12. Zou, J., Iyengar, A., & Jermaine, C. (2018). Pangea: monolithic distributed storage for data analytics. arXiv preprint arXiv:1808.06094. https://arxiv.org/pdf/1808.06094

Downloads

Published

2023-03-29

How to Cite

Kunal Arya. (2023). Data Infrastructure Modernization as a Foundation for Real-Time AI Decisioning: A Case Study in Relational-to-NoSQL Migration for Large-Scale Retail Platforms . International Journal of Computational and Experimental Science and Engineering, 9(2). https://doi.org/10.22399/ijcesen.5558

Issue

Section

Research Article