International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Call for Papers | Fully Refereed | Open Access | Double Blind Peer Reviewed

ISSN: 2319-7064


Downloads: 4 | Views: 161 | Weekly Hits: ⮙2 | Monthly Hits: ⮙4

Informative Article | Information Technology | United States of America | Volume 13 Issue 8, August 2024 | Popularity: 4.9 / 10


     

Optimizing Data Workflows through the Migration from MapR ETL to Airflow S3 Pipelines

Pankaj Dureja


Abstract: This article outlines the strategic migration from legacy MapR ETL data loading to AirflowS3 pipelines, emphasizing the operational efficiency gained through cloud storage and Apache Airflow orchestration. The process, challenges encountered, and solutions deployed during this migration are detailed, highlighting significant improvements in data handling, cost reduction, and scalability.


Keywords: Data Migration, ETL, Apache Airflow, Amazon S3, Data Pipelines


Edition: Volume 13 Issue 8, August 2024


Pages: 1503 - 1505


DOI: https://www.doi.org/10.21275/SR24819091312



Make Sure to Disable the Pop-Up Blocker of Web Browser




Text copied to Clipboard!
Pankaj Dureja, "Optimizing Data Workflows through the Migration from MapR ETL to Airflow S3 Pipelines", International Journal of Science and Research (IJSR), Volume 13 Issue 8, August 2024, pp. 1503-1505, URL: https://www.ijsr.net/getabstract.php?paperid=SR24819091312, DOI: https://www.doi.org/10.21275/SR24819091312



Downloads: 357 | Views: 1005 | Weekly Hits: ⮙2 | Monthly Hits: ⮙4

Information Technology, Ghana, Volume 8 Issue 6, June 2019

Pages: 64 - 69

The Use of Information and Communication Technology (ICT) in Teaching and Learning of Mathematics in Al-Faruq College of Education, Wenchi-Ghana

Abu Sulemana, Yahuza Abdul-Kadir


Downloads: 301 | Views: 564 | Weekly Hits: ⮙2 | Monthly Hits: ⮙4

Information Technology, India, Volume 8 Issue 1, January 2019

Pages: 456 - 460

Analysis of Blockchain and its Working Principle

S. Banupriya, G. Renuka Devi


Downloads: 266 | Views: 413 | Weekly Hits: ⮙2 | Monthly Hits: ⮙4

Information Technology, China, Volume 9 Issue 1, January 2020

Pages: 107 - 112

Network Optimization using Multi-Agent Genetic Algorithm

Sikandar Hanif


Downloads: 260 | Views: 478 | Weekly Hits: ⮙2 | Monthly Hits: ⮙4

Information Technology, Malaysia, Volume 8 Issue 1, January 2019

Pages: 64 - 70

University of the Future (UotF): Redesign Business Model for Local University in Malaysia through Humanising Education and 4IR

Nor Zaiasron Bin Yahaya, Abdul Rahman Bin Ahmad Dahlan


Downloads: 254 | Views: 423 | Weekly Hits: ⮙2 | Monthly Hits: ⮙4

Information Technology, India, Volume 9 Issue 1, January 2020

Pages: 477 - 479

IoT Based Smart Street Light for Energy Efficiency and Safety

Tanmay Patil, Arjun Ramendra


Top