Revolutionizing Supply Chain Management: Real-time Data Processing and Concurrency


Authors : Suwarna Shukla; Prabhneet Singh

Volume/Issue : Volume 9 - 2024, Issue 5 - May

Google Scholar : https://tinyurl.com/rharn34y

Scribd : https://tinyurl.com/9fxyu4at

DOI : https://doi.org/10.38124/ijisrt/IJISRT24MAY207

Abstract : In the contemporary business landscape, effective supply chain management (SCM) is paramount for organizations seeking to thrive amidst evolving market dynamics and heightened customer expectations. This research paper presents a pioneering approach to SCM that harnesses cutting-edge technologies, namely Kafka and Akka, to revolutionize data integration and decision-making processes. By leveraging Kafka as a robust distributed event streaming platform and Akka as a versatile toolkit for developing concurrent and distributed applications, our system facilitates seamless communication and coordination across diverse nodes within the supply chain network. This paper elucidates the intricacies of the proposed architecture, detailing the implementation methodology and performance evaluation metrics. Through a comprehensive examination, we demonstrate how our solution enhances supply chain visibility, fosters operational agility, and enables real-time responsiveness to market fluctuations and customer demands. Moreover, practical use cases exemplify the transformative impact of our approach on inventory management optimization, order fulfillment efficiency, and logistics optimization. Furthermore, we delve into the challenges encountered during implementation and deployment, offering insights into potential mitigative strategies. Finally, we outline avenues for future research, exploring emerging trends and opportunities in the realm of SCM empowered by Kafka and Akka technologies.

Keywords : Supply chain management(SCM), Event-driven architecture, Distributed systems, Real-time data processing, Akka framework, Kafka messaging, Data integration, Decision support systems, Inventory optimization, Logistics management, Scalability, Fault tolerance, Performance evaluation, Operational efficiency, Stream processing.

References :

  1. K. Peddireddy, ”Streamlining Enterprise Data Processing, Reporting and Realtime Alerting using Apache Kafka,” 2023 11th International Symposium on Digital Forensics and Security (ISDFS), Chattanooga, TN, USA, 2023, pp. 1-4, doi: 10.1109/ISDFS58141.2023.10131800. keywords: Industries;Fault tolerance; Filtering;Scalability;Fault tolerant systems ;Refining; Organizations;Data Engineering; Kafka; Machine learning Data reporting;Data alerting;Efficiency;Accuracy;Time reduction;Cost reduction,
  2. P. Le Noac’h, A. Costan and L. Bouge, ”A performance evaluation´ of Apache Kafka in support of big data streaming applications,” 2017 IEEE International Conference on Big Data (Big Data), Boston, MA, USA, 2017, pp. 4803-4806, doi: 10.1109/Big Data.2017.8258548. keywords: Throughput; Big Data;Real-time systems; Benchmark testing; Measurement; Internet of Things; Sparks;Stream computing;Apache Kafka;Big Data,
  3. A. Sayar, S¸. Arslan, T. C¸akar, S. Ertugrul and A. Akc¸ay, ”High-˘ Performance Real-Time Data Processing: Managing Data Using Debezium, Postgres, Kafka, and Redis,” 2023 Innovations in Intelligent Systems and Applications Conference (ASYU), Sivas, Turkiye, 2023, pp. 1-4, doi: 10.1109/ASYU58738.2023.10296737. keywords: Technological innovation;Relational databases;Data processing;Real-time systems;Intelligent systems;Monitoring;Kafka;Debezium;Redis;EventDriven,
  4. Y.   Drohobytskiy, V. Brevus and Y.  Skorenkyy,”Spark Structured  Streaming: Customizing Kafka         Stream Processing,” 2020             IEEE Third International Conference on        Data Stream Mining Processing (DSMP), Lviv, Ukraine, 2020, pp. 296299, doi: 10.1109/DSMP47368.2020.9204304. keywords: Sparks;Task analysis;Monitoring;Data mining;Conferences;Realtime systems;Containers;Distributed systems;Stream processing;Kafka streams;Spark v 2.3.2;HDFS file granulation,
  5. Bill Bejeck, Kafka Streams in Action: Real-time apps and microservices with the Kafka Streams API , Manning, 2018.
  6. Y. Yorozu, M. Hirano, K. Oka, and Y. Tagawa, “Electron spectroscopy studies on magneto-optical media and plastic substrate interface,” IEEE Transl. J. Magn. Japan, vol. 2, pp. 740–741, August 1987 [Digests 9th Annual Conf. Magnetics Japan, p. 301, 1982].
  7. D. Elmazi, T. Oda, E. Kulla, E. Spaho, L. Barolli and K. Uchida, ”A Selection of Actor Node in Wireless Sensor Actor Networks: A Case Study for Static and Mobile Actor Nodes,” 2015 Ninth International Conference on Complex, Intelligent, and Software Intensive Systems, Santa Catarina, Brazil, 2015, pp. 36-43, doi: 10.1109/CISIS.2015.85. keywords: Wireless sensor networks;Monitoring;Real-time systems;Wireless communication;Electronic mail;Fuzzy logic;Energy consumption;Wireless Networks;WSAN;Fuzzy Logic;Actor Mobil-ity;Intelligent Systems,
  8. W. Li, X. Zhang and X. Xu, ”Receding-Horizon Actor-Critic Design for Learning-Based Control of Nonlinear Continuous-time Systems,” 2020 3rd International Conference on Unmanned Systems (ICUS), Harbin, China, 2020, pp. 1095-1101, doi: 10.1109/ICUS50048.2020.9274838. keywords: Optimal control;Tuning;Mathematical model;Symmetric matrices;Simulation;Prediction algorithms;Optimization;receding horizon actor critic design (RH-ACD);continuous-time (CT) systems;Adaptive dynamic programming (ADP),
  9. Q. Zhu, S. Su, T. Tang and X. Xiao, ”Energy-efficient train control method based on soft actor-critic algorithm,” 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), Indianapolis, IN, USA, 2021, pp. 2423-2428, doi: 10.1109/ITSC48978.2021.9564449. keywords: Training;Process control;Reinforcement learning;Markov processes;Energy efficiency;Stability analysis;Robustness;Energy-efficient train control;deep reinforcement learning;soft actor-critic,
  10. E. Kulla, M. Ikeda and L. Barolli, ”A Fuzzy Approach to Actor Selection in Wireless Sensor and Actor Networks,” 2014 17th International Conference on Network-Based Information Systems, Salerno, Italy, 2014, pp. 244-248, doi: 10.1109/NBiS.2014.99. keywords: Wireless sensor networks; Wireless communication; Ad hoc networks; Robot sensing systems; Optimization; Conferences; Protocols;WSAN; Coordination Protocols;Connectivity Restoration; Sensor- Actor Coordination; Actor-Actor Coordination;Fuzzy;Linear Programming,
  11. H. Lv, S. Zhang, X. Zhang, Q. Guo, J. Dong and Y. Zhao, ”The Actor Model based Distributed Fault Tolerant Control System,” 2020 IEEE 9th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), Chongqing, China, 2020, pp. 1591-1594, doi: 10.1109/ITAIC49862.2020.9338801. keywords: Industries;Instruction sets;Fault tolerant systems;Control systems;Sensor systems;Real-time systems;Sensors;actor model; distribution control system; reactive system;message driven,
  12. N. W. Grady, M. Underwood, A. Roy and W. L. Chang, ”Big Data: Challenges, practices and technologies: NIST Big Data Public Working Group workshop at IEEE Big Data 2014,” 2014 IEEE International Conference on Big Data (Big Data), Washington, DC, USA, 2014, pp. 11-15, doi: 10.1109/BigData.2014.7004470. keywords: Big data;Data privacy;NIST;Security;Education;Computer architecture;Data models;Big Data;reference architec- ture;collaboration;security;privacy;metadata;standards,
  13. A. Cuzzocrea, ”Big OLAP Data Cube Compression Algorithms in Column-Oriented Cloud/Edge Data Infrastructures,” 2023 IEEE Ninth Multimedia Big Data (BigMM), Laguna Hills, CA, USA, 2023, pp. 1-2, doi: 10.1109/BigMM59094.2023.00020. keywords: Big Data;Market research;Compression algorithms;Next generation networking;Big Data;Big Data Analytics;Big OLAP Data Cubes;ColumnOriented Big OLAP Data Cubes,
  14. A. Cuzzocrea, ”Big Data Lakes: Models, Frameworks, and Techniques,” 2021 IEEE International Conference on Big Data and Smart Computing (BigComp), Jeju Island, Korea (South), 2021, pp. 1-4, doi: 10.1109/BigComp51126.2021.00010. keywords: Warehousing;Semantics;Big Data;Lakes;Market research;Data models;Research initiatives;Big Data;Big Data Lakes;Big Data Representation;Big Data Processing;Big Data Analytics,
  15. J. McHugh, P. E. Cuddihy, J. W. Williams, K. S. Aggour, V. S. Kumar and V. Mulwad, ”Integrated access to big data polystores through a knowledge-driven framework,” 2017 IEEE International Conference on Big Data (Big Data), Boston, MA, USA, 2017, pp. 1494-1503, doi: 10.1109/BigData.2017.8258083. keywords: Semantics;Big Data;Data models;Ontologies;Time series analysis;Databases;Triples (Data structure);semantic modeling;knowledge representation;big data;data integration;query processing,
  16. H. Zhang, ”Research on the Application of Big Data in Industrial Structure Adjustment and Economic Indexes,” 2020 International Conference on Intelligent Transportation, Big Data Smart City (ICITBS), Vientiane, Laos, 2020, pp. 687-690, doi: 10.1109/ICITBS49701.2020.00151. keywords: Economic indicators;Smart cities;Big Data;Big Data applications;Data models;Indexes;Business;Big data;Industrial structure adjustment;Economic index,
  17. D. Hu, W. Ji and Z. Wang, ”Multi-stream Adaptive Offloading of Joint Compressed Video Streams, Feature Streams, and Semantic Streams in Edge Computing Systems,” 2023 IEEE International Conference on Multimedia and Expo (ICME), Brisbane, Australia, 2023, pp. 996-1001, doi: 10.1109/ICME55011.2023.00175. keywords: Energy consumption;Adaptation models;Adaptive systems;Computational modeling;Bit rate;Streaming media;Approximation algorithms;Compressed video streams;feature streams;multi-stream offloading;resource allocation,
  18. ”IEEE/ISO/IEC International Standard - Information technology Telecommunications and information exchange between systems Local and metropolitan area networks - Specific requirements Part 1Q:Bridges and bridged networks- AMENDMENT 6: Per-stream filtering and policing,” in ISO/IEC/IEEE 88021Q:2016/Amd.6:2019(E) , vol., no., pp.1-68, 8 March 2019, doi: 10.1109/IEEESTD.2019.8664696. keywords: IEEE Standards;ISO Standards;IEC Standards;Local area networks;Metropolitan area networks;Information technology;Information exchange;Bridge circuits;Streaming media;Bridged Local Area Networks;IEEE 802®;IEEE 802.1Q™;IEEE Std 802.1Qbu™;IEEE 802.1Qbv™;IEEE Std 802.1Qbz™;IEEE 802.1Qca™;IEEE 802.1Qcd™;IEEE 802.1Qci™;local area networks (LANs);MAC Bridges;metropolitan area networks;per-stream filtering and policing;PSFP;scheduled traffic;TimeSensitive Networking;Virtual Bridged Local Area Networks (virtual LANs),
  19. G. Jiang, Z. Li, F. Wang and S. Wei, ”A High-Utilization Scheduling Schemeof Stream Programs on ClusteredVLIW Stream Architectures,” in IEEE Transactions on Parallel and Distributed Systems, vol. 25, no. 4, pp. 840-850, April 2014, doi: 10.1109/TPDS.2013.80. keywords: Kernel;Streaming media;Instruction sets;Registers;Computer architecture;System-on-chip;VLIW;Stream architecture;stream program;scheduling scheme;homogeneous multiple threads;arithmetic unit utilization,
  20. J. G. Min and Y. Lee, ”High-Quality HTTP Live Streaming System for Limited Communication Bandwidth,” 2020 International SoC Design Conference (ISOCC), Yeosu, Korea (South), 2020, pp. 113-114, doi: 10.1109/ISOCC50952.2020.9333086. keywords: Interpolation;Protocols;Simulation;Bandwidth;Streaming media;Media;Servers;bandwidth-limited communication systems;quality-aware video processing;HTTP live streaming protocol,
  21. Ashley Davis, Bootstrapping Microservices with Docker, Kubernetes, and Terraform: A project-based guide , Manning, 2021. keywords: Bootstrapping;Microservices;Docker;Kubernetes;Terraform,
  22. V. Sharma, H. K. Saxena and A. K. Singh, ”Docker for Multi-containers Web Application,” 2020 2nd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA), Bangalore, India, 2020, pp. 589-592, doi: 10.1109/ICIMIA48430.2020.9074925. keywords: Containers;Operating systems;Cloud computing;Servers;Virtual machining;Virtualization;Linux;Container;docker;swarm;docker file;virtual machine,
  23. I. Tronnebati and F. Jawab, ”The similarities and differences between the green and sustainable supply chain management definitions and factors: A literature review,” 2020 IEEE 13th International Colloquium of Logistics and Supply Chain Management (LOGISTIQUA), Fez, Morocco, 2020, pp. 16, doi: 10.1109/LOGISTIQUA49782.2020.9353939. keywords: Supply chain management;Bibliographies;Green products;Supply chains;Stakeholders;Sustainable development;Environmental economics;sustainable development;supply chain management;green supply chain management;Sustainable supply chain management,
  24. D. N. Nya and H. Aboua¨ıssa, ”An Efficient Framework for Tactical Management in Supply Chain Systems,” 2022 14th International Colloquium of Logistics and Supply Chain Management (LOGISTIQUA), EL JADIDA, Morocco, 2022, pp. 16, doi: 10.1109/LOGISTIQUA55056.2022.9938109. keywords: Supply chain management;Uncertainty;Simulation;Supply chains;Stochastic processes;Production;Petrochemicals;Supply chain management;modelfree control;in-ventory control;intelligent controllers,
  25. M. Imran, N. Haider, and M. Alnuem, ”Efficient Movement Control Actor Relocation for Honing Connected Coverage in Wireless Sensor and Actor Networks,” in 8th IEEE International Workshop on Performance and Management of Wireless and Mobile Networks, 2012.
  26. J. Passerat-Palmbach, R. Reuillon, C. Mazel, and D. R.C. Hill, ”Prototyping Parallel Simulations on Manycore Architectures Using Scala: A Case Study,” Clermont Universite, BP 10448, F-63000 CLERMONT-´ FERRAND, CNRS, UMR 6158, Universite Blaise Pascal, LIMOS,´ F-63173, ISIMA, Institut Superieur d’Informatique, de Mod´ elisation´ et de leurs Applications, BP 10125, F-63177, Institut des Systemes` Complexes, 57-59 rue Lhomond, F-75005 PARIS.
  27. J. A. Miller, C. Bowman, V. G. Harish, and S. Quinn, ”Open Source Big Data Analytics Frameworks Written in Scala,” *Department of Computer Science, University of Georgia, Athens, GA, USA*. jam@cs., bowman99@, vishnu.gowdahari25@, [email protected]. 2016 IEEE International Congress on Big Data.
  28. M. H. Javed, X. Lu, and D. K. Panda, ”Cutting the Tail: Designing High Performance Message Brokers to Reduce Tail Latencies in Stream Processing,” *Department of Computer Science and Engineering, The Ohio State University, Columbus, OH, USA*. javed.19, lu.932, [email protected]. 2018 IEEE International Conference on Cluster Computing.
  29. H. K. Gupta and R. Parveen, ”Comparative Study of Big Data Frameworks,” in *2019 2nd International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT)*, Ghaziabad, India, 2019, pp. 1-5, ISBN: 978-1-7281-1772-0.
  30. P. Goyal and R. Mikkilineni, ”Policy-based Event-driven Servicesoriented Architecture for Cloud Services Operation Management,” in *2009 IEEE International Conference on Cloud Computing*, Bangalore, India, 2009, pp. 1-6.
  31. A. Luckow, G. Chantzialexiou, and S. Jha, ”Pilot-Streaming: A Stream Processing Framework for High-Performance Computing,” in 2018 IEEE 14th International Conference on e-Science, Amsterdam, The Netherlands, 2018, pp. 1-6.
  32. C. Boelmann, L. Schwittmann, M. Waltereit, M. Wander, and T. Weis, ”Application-level Determinism in Distributed Systems,” in 2016 IEEE 22nd International Conference on Parallel and Distributed Systems, Wuhan, China, 2016, pp. 1-8.
  33. H. lv, X. Ge, H. Zhu, C. Wang, Z. Yuan and Y. Zhu, ”Design and Implementation of Reactive Distributed Internet of Things Platform based on Actor Model,” 2019 IEEE 3rd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chengdu, China, 2019, pp. 1993-1996, doi: 10.1109/ITNEC.2019.8729169. keywords: Automation;Conferences;Actor Model;Internet of Things;Akka Toolkit;Reactive System;Functional Programming
  34. Jones A, Ay lward R, Jones A (2019) Enhanced supervision: new ways to promo te safety and well-being in pa tients requiring one-to-one or cohort nursing. Nursing Management. doi: 10.7748/nm.2019.e1827
  35. Rinaldi, L., Torquati, M., Mencagli, G., Danelutto, M. (Year). HighThroughput Stream Processing with Actors. Computer Science Department, University of Pisa, Italy.
  36. Rosa, Andrea Chen, Lydia Binder, Walter. (2016). Profiling Actor Uti-` lization and Communication in Akka. 24-32. 10.1145/2975969.2975972.
  37. Mukaj, Jon. (2023). Containerization: Revolutionizing Software Development and Deployment Through Microservices Architecture Using Docker and Kubernetes. 10.13140/RG.2.2.23804.51841.
  38. Hiraman, Bhole M, Chapte Abhijeet, C. (2018). A Study of Apache Kafka in Big Data Stream Processing. 1-3. 10.1109/ICICET.2018.8533771.

In the contemporary business landscape, effective supply chain management (SCM) is paramount for organizations seeking to thrive amidst evolving market dynamics and heightened customer expectations. This research paper presents a pioneering approach to SCM that harnesses cutting-edge technologies, namely Kafka and Akka, to revolutionize data integration and decision-making processes. By leveraging Kafka as a robust distributed event streaming platform and Akka as a versatile toolkit for developing concurrent and distributed applications, our system facilitates seamless communication and coordination across diverse nodes within the supply chain network. This paper elucidates the intricacies of the proposed architecture, detailing the implementation methodology and performance evaluation metrics. Through a comprehensive examination, we demonstrate how our solution enhances supply chain visibility, fosters operational agility, and enables real-time responsiveness to market fluctuations and customer demands. Moreover, practical use cases exemplify the transformative impact of our approach on inventory management optimization, order fulfillment efficiency, and logistics optimization. Furthermore, we delve into the challenges encountered during implementation and deployment, offering insights into potential mitigative strategies. Finally, we outline avenues for future research, exploring emerging trends and opportunities in the realm of SCM empowered by Kafka and Akka technologies.

Keywords : Supply chain management(SCM), Event-driven architecture, Distributed systems, Real-time data processing, Akka framework, Kafka messaging, Data integration, Decision support systems, Inventory optimization, Logistics management, Scalability, Fault tolerance, Performance evaluation, Operational efficiency, Stream processing.

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe