Conference Proceedings

International Conference on Advances In Engineering And Technology - ICAET 2014

Efficient Utilization of Profiles to Reduce Time in Very Large Data Set

Author(s) : KAMINI GUPTA, R.H.GOUDAR

Abstract

Hadoop is a software framework for analysis of large data sets. Hadoop distributed file system and map reduce paradigm provide an efficient way to deal with terabyte of data being produced every second. MapReduce is known as a popular way to hold data in the cloud environment due to its excellent scalability and good fault tolerance. However, creating profiles for the same job again and again makes it less efficient. This paper proposes an INTERFACE that optimizes time taken to match sampled mapreduce jobs (Js) with already created profiles. It acts as mediator between profile store and worker (nodes).

Conference Title : International Conference on Advances In Engineering And Technology - ICAET 2014
Conference Date(s) : 24 - 25 May, 2014
Place : RIT, Roorkee, India
No fo Author(s) : 2
DOI : 10.15224/978-1-63248-028-6-01-16
Page(s) : 79 - 83
Electronic ISBN : 978-1-63248-028-6
Views : 913   |   Download(s) : 183