The current global health situation (primarily due to Covid-19) has encouraged a change in customer behavior toward the use of telecommunications services, which has increased data traffic. Telecommunications operators now have a golden opportunity to use Big Data Analytics (BDA) solutions to develop new sources of revenue. We encountered a number of difficulties when trying to set up a BDA project, particularly when it came to selecting the technical solution from the vast array of available tools and the governance methods for managing the project and the data. Most study papers on the telecommunications sector have not covered BDA project implementation from beginning to end. This paper's focus is on BDA telecommunications, the value of open-source data pipelines, architecture, implementation methodologies, and architectural levels. The study's last section offers practical BDA use cases for applications that support cost reduction and revenue generation. It appears that this effort will make it easier to implement BDA initiatives and give telecoms operators a better understanding of the crucial factors that need to be prioritized. This research that will help achieve this objective.

Keywords : Big Data Analytics, Open Source, Data Pipeline architecture, Implementation of open source Data Pipeline for BDA, Apache Kafka, Big Data Architecture Layers, Apache Kafka, Spark, Telecommunication, Telecom BDA Use Cases, Kubernetes for Telco data analytics