Hadoop Projects Description
2
SHORT PROJECTS FOR TRAINING PROJECT –I Social media analysis on Hadoop Framework! "escrip#ion$ The project provides a brief overview on how Hadoop framework & processing can be leveraged to perform analysis on social media data. The mode of data extraction and analysis would vary depending up on different tools present with Hadoop, but the basic idea of what can be done using the power of Hadoop will remain the same throughout. This project will not be a full-fledged distribution to the students rather to provide them a basic understanding of what they can do in Hadoop. The uestion of !how to do it" will have to be to the discretion of the students after they learn the Hadoop framework. %rie&s$ #$ %ata extr actio n from social med ia portal s like ace'ook , Twitte r, (hang e, etc. )$ *re-p rocess ing the ext racte d data to conf orm the Ha doop nor ms for s torage . +$ %ata st orage a nd repre senta tion i n Hadoop favore d wareho uses. $ %ata epr esent ation o nly if it/ s not an overh ead and time per mit s$. 0$ *erfo rmin g short analy tics on the sto red data usi ng diff erent too ls of Hadoo p ecosystem. PROJECT II 'ea#(er da#a analysis )sin* core +apRed)ce pro*rammin*! "escrip#ion$ This project/s purpose is only to provide a brief description of how to write a 1apedu ce program in Hadoop for any problem. The students will be given a brief understanding of how they can design their own mappers & reducers for any specific problem. %rie&s$ #$ (lean sing, anal ysi s & storage of the we ather dat a set fre ely dist ribut ed$. )$ 2hort 1a peduce pr ogram wr iting to unde rsta nd the inter nal funct ioning of Hadoop. +$ %ispl ay and ana lysi s of dat a based o n speci fic re uirem ents.
-
Upload
suhaskurdukar -
Category
Documents
-
view
9 -
download
0
description
you can find a small description about hadoop projects
Transcript of Hadoop Projects Description
SHORT PROJECTS FOR TRAINING
PROJECT ISocial media analysis on Hadoop Framework->
Description:
The project provides a brief overview on how Hadoop framework & processing can be leveraged to perform analysis on social media data. The mode of data extraction and analysis would vary depending upon different tools present with Hadoop, but the basic idea of what can be done using the power of Hadoop will remain the same throughout. This project will not be a full-fledged distribution to the students rather to provide them a basic understanding of what they can do in Hadoop. The question of how to do it will have to be to the discretion of the students after they learn the Hadoop framework. Briefs:
1) Data extraction from social media portals like FaceBook, Twitter, Change, etc.
2) Pre-processing the extracted data to conform the Hadoop norms for storage.
3) Data storage and representation in Hadoop favored warehouses.
4) Data Representation (only if its not an overhead and time permits).
5) Performing short analytics on the stored data using different tools of Hadoop ecosystem.
PROJECT- II
Weather data analysis using core MapReduce programming->
Description:
This projects purpose is only to provide a brief description of how to write a MapReduce program in Hadoop for any problem. The students will be given a brief understanding of how they can design their own mappers & reducers for any specific problem. Briefs:
1) Cleansing, analysis & storage of the weather data set (freely distributed).
2) Short MapReduce program writing to understand the internal functioning of Hadoop.3) Display and analysis of data based on specific requirements.
