Downloads: 128 | Views: 241
Research Paper | Computer Science & Engineering | India | Volume 4 Issue 7, July 2015 | Popularity: 6.8 / 10
A MapReduce Framework for an Effective Scheduler Based on the Job Size in Hadoop
Madhumala R B, Ravichandra Y B
Abstract: The MapReduce framework and its open source implementation in Hadoop is existing as an standard for Bigdata related processing in industry and academies. When a bunch of jobs are simultaneously submitted together to a MapReduce cluster, bunch of jobs will compete for available resources by this the overall system performance may go down, this is because in MapReduce cluster different kinds of workload is shared among multiple users. Existing scheduling algorithms which are supported by Hadoop always cannot guarantee good average response time with different workloads. Therefore it is a challenging ability to design an effective scheduler which can work with shared MapReduce cluster. To solve this problem we propose a new hadoop scheduler which works on the different workload patterns and reduces overall execution time and job response time by dynamically tuning the available resources that is shared among multiple users and scheduling algorithm for each user. The experimental results are obtained from CloudEra shows that proposed scheduler reduces the average job response time under different workloads that are compared with existing Fair and FIFO Scheduler.
Keywords: Index Terms Job Scheduling, Hadoop, Mapreduce, Workload, HDFS,
Edition: Volume 4 Issue 7, July 2015
Pages: 261 - 266
Make Sure to Disable the Pop-Up Blocker of Web Browser
Similar Articles
Downloads: 1
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 6, June 2021
Pages: 1188 - 1193Profit Contribution of Bank Customer from Different Business Liabilities
Vinod Desai, Shalini B Ullagaddi, Vittal A Odeyar
Downloads: 1
Research Paper, Computer Science & Engineering, India, Volume 11 Issue 1, January 2022
Pages: 1229 - 1231Big Data in Healthcare
Pratiksha Patil
Downloads: 3 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Research Paper, Computer Science & Engineering, India, Volume 13 Issue 8, August 2024
Pages: 934 - 939Advanced Computation Techniques for Complex AI Algorithms
Mohammed Saleem Sultan, Mohammed Shahid Sultan
Downloads: 103 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015
Pages: 1721 - 1725Secured Load Rebalancing for Distributed Files System in Cloud
Jayesh D. Kamble, Y. B. Gurav
Downloads: 105
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015
Pages: 2133 - 2136One Class Clustering Tree for Implementing Many to Many Data Linkage
Ravi R, Michael G