Bigdata presentation

Tuesday, May 2, 2023 Big Data By Sathish Yellanki Slide No : 1

A Very Big Question To Answer

What is Big Data?

Formal Definitions of Big Data

Big Data is The Frontier of A Firm's Ability To

Store, Process, Access (SPA)

All The Data it Needs To

Operate Effectively

Make Decisions

Reduce Risks

Serve Customers

Definition 01

…Forrester

Big Data in General is Defined As

High Volume, Velocity And Variety

Information Assets That Demands

Cost-Effective

Innovative Forms of Information Processing For Enhanced Insight And Decision Making

Definition 02

…Gartner

Big Data is Data That Exceeds The

Processing Capacity of Conventional Database Systems

The Data is Too Big, Moves Too Fast, OR Doesn't Fit The Structures of Clients Database Architectures

To Gain Value From This Data, The Client Must Choose An Alternative Way To Process it

Definition 03

…O’Reilly

Big Data is The Data Characterized By 3 Attributes Volume

Variety

Velocity

Definition 04

…IBM

Big Data is Data Characterized By 4 Key Attributes

Volume

Variety

Velocity

Value

Definition 05

…Oracle

How An Analyst, Designer, Administrator, Architect And Developer Should See The Big Data

By Complexity of Storage Size

By Criticality of Backup And Recovery

By Challenge of Search And Optimizing Time

By Variations of The Tools And Technologies

By The Dynamism of Change And Scalability

By The Resistance in Building The Man Power

By The Speed of Research in Applying

By The Variety of Data Formats That Arise

By The Composition of Demanded Multiple Skillsets

How To Build An Idea Practically About Big Data?

QuestionWhat is The Size That We Need To Fit A Single Character of Data?AnswerOne ByteSituational QuestionDo You Have The Required Memory Size?Scenarios That May Arise• Yes, Then it is Small Data• No, Then it is Big Data As Per Your RequirementWhat To Do To Fit The Data When it is “NO”• Design And Develop Architecture For Big Data

QuestionWhat is The Size That We Need To Fit A Single Digit of a Number?AnswerTwo BytesSituational QuestionDo You Have The Required Memory Size?Scenarios That May Arise• Yes, Then it is Small Data• No, Then it is Big Data As Per Your RequirementWhat To Do To Fit The Data When it is “NO”• Design And Develop Architecture For Big Data

QuestionWhat is The Maximum Size of Data Storage in A MS-Word File?Answer32 MBSituational QuestionDo You Have Your Data Upto OR More Than 32 MBScenarios That May Arise• Yes, Then it is Small Data• No, Then it is Big Data As Per Your RequirementWhat To Do To Fit The Data When it is “NO”• Design And Develop Architecture For Big Data

QuestionWhat is The Maximum Size of Data Storage in A Data File of Oracle?Answer

Block Size Maximum Datafile File Size 2K 4194303 * 2K = 8 GB4K 4194303 * 4K = 16 GB 8K 4194303 * 8K = 32 GB 16K 4194303 * 16K = 64 GB 32K 4194303 * 32K = 128 GB

Block Size Maximum Datafile File Size 2k 4294967295 * 2K = 8 TB4k 4294967295 * 4K = 16 TB 8k 4294967295 * 8K = 32 TB16k 4294967295 * 16K = 64 TB 32k 4294967295 * 32K = 128 TB

Big File Table Space

Normal File Table Space

Finally How To Identify The “Big Data” Limit?

• Big Data is Something When it is Unable To Fit into The RAM.

• Small Data is Something When it Can Fit into The RAM.

Let Us Have A Symbolic Reference For Clarity

Byte : One Grain of Rice


Kilobyte : Cup of Rice



Megabyte : 8 Bags of Rice




Gigabyte : 3 Semi Trucks





Terabyte : 2 Container Ships






Petabyte : Blankets ManhattanArea • Total 33.6 SQ MI (87 KM2) • Land 22.8 SQ MI (59 KM2) • Water 10.8 SQ MI (28 KM2) 32%Population (2013) • Total 1,626,159

• Density 70,825.6/SQ MI (27,345.9/KM2)






Petabyte : Blankets Manhattan

Exabyte : Blankets West Coast States








Zettabyte : Fills The Pacific OceanArea of 165,200,000 KM²








Zettabyte : Fills The Pacific Ocean

Yottabyte : A Earth Size Rice Ball!Surface Area : 510,072,000 KM²Radius : 6,371 KMVolume : 1.08321×1012 KM3

Area of Application By Memory Size









Yottabyte : A Earth Size Rice Ball!

Hobbyist










Hobbyist

Desktop










Hobbyist

Desktop

Internet










Big Data










Hobbyist

Desktop

Internet

Big Data

Who Knows?

What is The Key Parameter To Be Considered in Big Data?

• Big Data is Not About The Size of The Data.

• Big Data is About The Value Within The Data.

So, What is The Level of value?

When Big Data Will Be Valued?

Market Intelligence?


Business Intelligence?



Secret Intelligence?




Forensic Intelligence?





Medical Intelligence?





Space Intelligence?

Medical Intelligence?

Big Data


A Big Question For The Next Generation

Big Data By Sathish Yellanki

AnswerYes, Our Society And System is Leaving Behind A Digital Footprint.

Tuesday, May 2, 2023 Slide No : 46

QuestionAre We Going To Be A Digital World?


A Big Question For The Community of Humans


AnswerMajority of The Human Race is Living Online.

QuestionWhere Are We Living And Spending Time Today?

We All Are Digitally And Virtually Expressing Our




We All Are Digitally And Virtually Expressing Our• Attitudes




We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes




We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions




We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives




We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow




We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow• Responsibilities And Rights




We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow• Responsibilities And Rights• Governance




We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives

• Governance

• Happiness And Sorrow• Responsibilities And Rights

• Strategies And Standards




We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow• Responsibilities And Rights• Governance• Strategies And Standards• Intelligence And Implementation




We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow• Responsibilities And Rights• Governance• Strategies And Standards• Intelligence And Implementation• Research And Application


A Big Question For The System Developers


AnswerYes

QuestionAre We Generating Huge Amounts of Data?


QuestionWhat This Data is Actually Containing?AnswerData Integrated With A Lot of Information.Information in Association With A Lot of Noise.


QuestionWhat This Data is Actually Containing?AnswerData Integrated With A Lot of Information.Information in Association With A Lot of Noise.

Dat

a

Inte

llige

nt S

yste

m


AnswerA Developer Should Develop The Ability To Hear The Signal From The Noise.Catching The Exact Signal For The Analysis And Research is Considered As The Key.

QuestionWhat Ability The Developers Should Develop?

Inte

llige

nt

Syst

em


Are We Aware of The Big Challenge That is Ahead


QuestionWhat is The Challenge We Will Face?AnswerUnlock The Human Conversation That is Taking

Place Around Us.


QuestionWhat Are The Other Conversations We Should

Monitor?Answer• The Human Machine Interaction And

Interdependency• The Ability To Make Machines More Expertise

in Managing The Failures OR if Possible Avoid The Failure

• The Ability To Achieve The Super User Friendliness Architectures

• Achieve Systems That Can Operate As Per The Thought of The Humans


What Happens if We Can Listen To The Conversation of The Humans Around?


• Move Towards The Unexpected Discoveries• Re-Invent The Failed Prophesies in Science And

Technology• Analyze The Systems With More Deeper In-

Sight• Cross Question The Process For Greater

Success• Identify And Correct The Failures At The Early

Stages• Report The System Break Ups At The Earliest

Than Expected• Prevent a Total Failure of The System


The Biggest Question Finally on Big Data


Shall We Mine The Data OR Mind The Data?

Does The Organizations And People Know What They Have To Do With Data What They Have With

Them?

No, Most People Do Not Know What To Do With All The Data They Already Have…

• First We Should Mind The Data, Then Mine The Data, Then Mind The Data Then Mine The Data,

Then Mind The Data Then Mine The Data…


So Finally Where To Start With Big Data?


Get Big

The Bulls Eye For Success Finally Lies in

By Starting

Small


Where I Should Focus For My Success?


Focus on The Areas That Contradict With Impact of

Business

System

Process

Methodology


What is The Flow Chart of Big Data Analytics?


Start

Did it Work?

Stop

Try Something Out of The Business Data

YESNO

YES


Is Big Data is Really Big?


To Speak Frankly No

For The People Who Know How To Use The Concept And Credits of The Big Data

Big Data is Not Big


What is The End Result if I Know How To Tame The Big Data?


Big Data Simply Obliges All Your Needs And

Looks And Executes Like Smart Data


Thank You See You Soon With Hadoop

Bigdata presentation

Education

Transcript of Bigdata presentation