Job Profiles in Big Data - StackDataLabs

Post on 15-Feb-2017

130 views 0 download

Transcript of Job Profiles in Big Data - StackDataLabs

Job Profiles & Future Scope ofBig Data

Stack Data Labs - Immersive Training Provider

Introduction

● In the past few years, there is an increase in job profiles in Big Data.

● Big data is hot and it's unlikely that this will change in the near future.

● Companies’ have increased their focus on acquiring Big Data talent with the creation of a whole new set of Big Data roles and titles.

Trends in Big Data 2017

● Big Data becomes fast and approachable.

● Spark and Machine Learning light up big data.

● Convergence of IoT, Cloud and big data creates

new opportunities for self-service analytics.

Trends in Big Data 2017 ● Self-service data prep becomes mainstream as end

users begin to shape big data.

● Big data no longer just Hadoop.

● Big Data grows up, Hadoop adds to Enterprise

standards.

Job Profiles in Big Data

Data Scientist● A data scientist is as rare as a unicorn and gets to

work every day with the mindset of a curious data wizard.

● He/she masters a whole range of skills and talents going from being able to handle the raw data, analyzing that data with the help of statistical techniques, to share his/her insights with his peers in a compelling way.

Responsibilities of Data Scientist

● Selecting features, building and optimizing classifiers

using machine learning techniques

● Data mining using state-of-the-art methods

● Extending company’s data with third party sources of

information when needed

Responsibilities of Data Scientist

● Enhancing data collection procedures to include

information that is relevant for building analytic

systems

● Processing, cleansing, and verifying the integrity of

data used for analysis

Responsibilities of Data Scientist

Data Analyst

● Just like the data scientist, the skills and talents that

are needed for this role are diverse and range the

entire spectrum of the data science process combined

with a healthy “figure-it-out” attitude. ● Languages like R, Python, SQL and C are elementary

to him/her.

Responsibilities of Data Analyst

● Analytical Skills: Data analysts work with large

amounts of data.You will need to see the data and

analyze it to find conclusions.

● Communication Skills: Data analysts are often called

to present their findings, or translate the data into an

understandable document.

Responsibilities of Data Analyst

● Critical Thinking: Data analysts must look at the

numbers, trends, and data and come to new

conclusions based on the findings.

● Attention to Detail: Data is precise. Data analysts have

to make sure they are vigilant in their analysis to come

to correct conclusions.

Responsibilities of Data Analyst

Data Engineer

● The data engineer often has a background in software

engineering and loves to play around with databases

and large –scale processing systems.● Every role is different, though, so some may require

more specialized knowledge in one of these areas

over the others.

Responsibilities of Data Engineer

● Data Analysis: Are you a pro with MapReduce, Hadoop

or even data mining? In addition to processing data,

you may also need to know more specialized

techniques like machine learning or even statistical

analysis.

Responsibilities of Data Engineer

● Data Warehousing: Are you familiar with large data

stores? Do you know how to get data in or take data

out?

● Data Transformation: Sometimes data needs to be

changed or transformed into a different format in order

to properly analyze it.

Responsibilities of Data Engineer

● Data Collection: You have to crawl before you can

walk. Crawling the Web or extracting data from an

existing database or API are common chores for Big

Data engineers.

Responsibilities of Data Engineer

Database Administrator

● Database Administrator makes sure that the database

is available to all relevant users, is performing

properly and is being kept safe.● A Database Administrator makes sure that all backup

and recovery systems are in place, and keeps track of

the different technologies that are being used.

● Implement, support and manage the corporate

database.

● Design and configure relational database objects.

● Are responsible for data integrity and availability.

● May design, deploy and monitor database servers.

● Design data distribution and data archiving solutions.

Responsibilities of Database Administrator

● Ensure database security, including backups & disaster

recovery.

● Plan and implement application and data provisioning.

Responsibilities of Database Administrator

Responsibilities of Database Administrator

Data Architect

● The person in this role creates the blueprints for data

management systems to integrate, centralize, protect

and maintain the data sources.● The data architect masters technologies like Hive, Pig,

and Spark, and needs to be on top of every new

innovation in the industry.

Responsibilities of Data Architect

● Determines database structural requirements by

analyzing client operations, applications, and

programming; reviewing objectives with clients;

evaluating current systems;

● Prepares users by conducting training.

● Develops database solutions by designing proposed

system; defining database physical structure and

functional capabilities, security, backup, and recovery

specifications.

● Installs database systems by developing flowcharts.

Responsibilities of Data Architect

Data & Analytics Manager

● A data analytics manager steers the direction of the

data science team and makes sure the right priorities

are set.● This person combines strong technical skills with a

diverse set of technologies (SQL, R, SAS, …) with the

social skills required to manage a team.

Responsibilities of Data & Analytics Manager

● Suggest an area for and methods of improving

operations.

● May collect and analyze external market data to

provide benchmarks for comparison purposes.

Responsibilities of Data & Analytics Manager

● Demonstrates expertise in a variety of the field's

concepts, practices, and procedures.

● Presents reports to management for use in decision

making and strategic planning.

Responsibilities of Data & Analytics Manager

Business Analyst

● The business analyst is often a bit different from the

rest of the team.● While often less technically oriented, the business

analyst makes up for it with his/her deep knowledge of

the different business processes.

Responsibilities of Business Analyst

● Assisting with the business case

● Planning and monitoring

● Eliciting requirements

● Requirements organization

● Translating and simplifying requirements

● Requirements management and communication

Responsibilities of Business Analyst

Statistician

● Although often forgotten or replaced by fancier

sounding job titles, the statistician represents what

the data science field stands for: getting useful

insights from data.● Statisticians can handle all sorts of data

Statistician

● With his/her strong background in statistical theories

and methodologies, and a logical and stats oriented

mindset, he/she harvests the data and turns it into

information and knowledge

Responsibilities of Statistician

● Apply statistical theories and methods to solve

practical problems in business, engineering, the

sciences, or other fields

● Decide what data are needed to answer specific

questions or problems

● Determine methods for finding or collecting data

Responsibilities of Statistician

● Design surveys or experiments or opinion polls to

collect data

● Collect data or train others to do so

● Analyze and interpret data

● Report conclusions from their analysis

Responsibilities of Statistician

Why is Big Data the best career move?● Soaring Demand for Analytics Professionals

● Huge Job Opportunities & Meeting the Skill Gap

● Huge Salary Aspects

● Big Data Analytics: A Top Priority in a lot of

Organizations

● Adoption of Big Data Analytics is Growing

Why is Big Data the best career move?● Analytics: A Key Factor in Decision Making

● The Rise of Unstructured and Semistructured Data

Analytics

● Big Data Analytics is Used Everywhere!