Submit Paper

Article Processing Fee

Pay Online

           

Crossref logo

  DOI Prefix   10.20431


 

International Journal of Research Studies in Computer Science and Engineering
Volume 2, Issue 2, 2015, Page No: 13-17

Performance Optimization for Short Job in Hadoop

Parmeshwari Sabnis1, Prof Chaitali Laulkar1

1.Computer Department, Sinhgad College of Engineering Pune University, Pune, India.

Citation : Parmeshwari Sabnis, Prof Chaitali Laulkar, Performance Optimization for Short Job in Hadoop International Journal of Research Studies in Computer Science and Engineering 2015, 2(2) : 13-17

Abstract

For solving large data-intensive problem, Hadoop Map Reduce, parallel computing framework is a widely used. To be able to process large-scale datasets, Hadoop focuses on high throughput of data than on job execution performance,. So when there is use of Hadoop Map Reduce to execute short jobs that requires quick responses, causes performance limitation. Short Map Reduce job are usually expected for short execution or quick response times. We optimized the standard Hadoop for greater performance. By optimizing the job initialization and termination stages, changing the task assignment from heartbeat-based pull-model to a push model, and providing an instant message communication mechanism instead of heartbeats, increase in execution speed is achieved.


Download Full paper: Click Here