Downloads: 118 | Views: 261
Survey Paper | Computer Science & Engineering | India | Volume 4 Issue 3, March 2015 | Popularity: 6.4 / 10
Survey on Schedulers Optimization to Handle Multiple Jobs in Hadoop Cluster
Shivaraj B. G., Nagaraj Naik
Abstract: An apache Hadoop project is a good platform that supports cost-effective such as commodity hardware implementation, with scalable infrastructure called Hadoop Distributed File System HDFS with parallel processing mechanism called MapReduce. Hadoop is well known for Big Data analytics requires more resources for collecting, storing, processing petabytes of large data requires one meaningful resource management. Hadoop handles jobs in batch modes, allocating resources, scheduling to these modes is an important issue in terms of Network Bandwidth, CPU time and Memory. Resources handled by MapReduce schedulers assigning resources in the form of MapReduceTasks. The MapReduceTasks are carefully handled by MapReduce schedulers by setting some benchmarks for individual namely MapCombineReducer and different Block Sizes, which ensures schedulers are optimized to achieve maximum efficiency in storage capacity, time and cost for handling multiple batch jobs in multiple cluster while guaranteeing the effectiveness of individual scheduler in terms of job execution.
Keywords: Big Data, Hadoop, HDFS, MapReduce, Schedulers optimization
Edition: Volume 4 Issue 3, March 2015
Pages: 1179 - 1184
Make Sure to Disable the Pop-Up Blocker of Web Browser
Similar Articles
Downloads: 1
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 6, June 2021
Pages: 1188 - 1193Profit Contribution of Bank Customer from Different Business Liabilities
Vinod Desai, Shalini B Ullagaddi, Vittal A Odeyar
Downloads: 1
Research Paper, Computer Science & Engineering, India, Volume 11 Issue 1, January 2022
Pages: 1229 - 1231Big Data in Healthcare
Pratiksha Patil
Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Research Proposals or Synopsis, Computer Science & Engineering, India, Volume 11 Issue 9, September 2022
Pages: 837 - 842An Optimized IoT-Enabled Big Data Analytics Architecture for Edge-Cloud Computing Using Deep Learning
Bharathi K.
Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Review Papers, Computer Science & Engineering, India, Volume 13 Issue 3, March 2024
Pages: 1036 - 1039An Investigation of the Applications of Artificial Intelligence and Other New Technologies in Smart Energy Infrastructure
Karan Chawla
Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Informative Article, Computer Science & Engineering, India, Volume 9 Issue 9, September 2020
Pages: 1607 - 1610Comprehensive Review on Automated Suspicious Activity Report Generation (SAR)
Ankur Mahida