Downloads: 1 | Views: 144 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Informative Article | Engineering Science | India | Volume 9 Issue 10, October 2020 | Popularity: 4.6 / 10

Rate This Article!      

Low Latency Data Lookups in Real - Time Data Engineering Pipelines

Girish Ganachari

Abstract: Healthcare, finance, and the Internet of Things need real - time data engineering pipelines with low - latency data lookups for processing and decision - making. Incremental ETL pipeline scheduling, FPGA - based hardware acceleration, and on - GPU thread - data remapping minimise latency in this research. It covers low - latency data pipeline applications, benefits, drawbacks, and prospects. It improves flexibility, productivity, and decision - making. To improve real - time data pipelines, the research proposes resource management, hardware - software interaction, and data consistency.

Keywords: Low - latency, Real - time data, Data engineering pipelines, FPGA acceleration, Incremental ETL, On - GPU processing, Data consistency

Edition: Volume 9 Issue 10, October 2020

Pages: 1815 - 1819

DOI: https://www.doi.org/10.21275/SR24801075034

Make Sure to Disable the Pop-Up Blocker of Web Browser

Click to Cite this Article