Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments
-
Upload
hubert-schweinesbein -
Category
Technology
-
view
254 -
download
3
description
Transcript of Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments
![Page 1: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/1.jpg)
• Textmasterformate durch Klicken bearbeitenZweite EbeneDritte EbeneVierte EbeneFünfte Ebene
Smart Backup Architectures for Big Data in complex, Open Source based IT Environments
Hubert [email protected]
![Page 2: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/2.jpg)
Session title
Hot IT Topics
Forrester Research Inc.
IT Projects 2013
• Virtualization• Master Data Management• Enterprise Security• Integration of Standard and
Individual Software• Data Quality Management
Cap Gemini
The Top 10 Strategic Technology Trends• Mobile device battles• Mobile applications and HTML5• The personal cloud• The Internet of Things• Hybrid IT and cloud computing• Strategic big data
![Page 3: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/3.jpg)
Session title
Big Data
Cloud Computing
Cost
driven by OSS
![Page 4: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/4.jpg)
RE CO V E RY
SEP sesam
B A CK UPRE S T O RE
KEY
Co m p e te n c i e s
![Page 5: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/5.jpg)
Session title
Big Data
![Page 6: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/6.jpg)
Session title
SEP & Big Data
SMART Architecture
Multiple StreamMultilocation Backup
Deduplication
![Page 7: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/7.jpg)
Session title
Cloud Computing
![Page 8: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/8.jpg)
Session title
SEP & Cloud
It's about Agility - Flexibility
Hybrid BackupWidest DB & OS support
Dedup & Replication
![Page 9: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/9.jpg)
![Page 10: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/10.jpg)
Session title
Cost
![Page 11: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/11.jpg)
Session title
SEP & Costs
Unlimited Usage
One subscribtion – use alle SEP backup modules
Reduce your investCOO instead COG
![Page 12: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/12.jpg)
The Real World
• Founded 1998 - Spin-off from the Institute of Clinical Chemistry at the University Hospital Grosshadern of the Ludwig-Maximilians University
• Specialized in genetic and immunological diagnostics
• Health Care - very cost sensitive• Open Source is a key strategy of their IT• Use of Standard Hardware instead of
expensive dedicated Storage solutions• Special Linux Distribution - Scientific Linux
www.scientificlinux.org• Different databases – huge amount of Data
![Page 13: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/13.jpg)
Requirements
• Sophisticated backup strategy with different medias, retention times, remove of backup media to external locations, single servers with 5TB of data
• Integrated Bare System Recovery for all Servers – Linux and Windows
• Variety of Linux Distributions - “old” Linux Distributions (RH 7.1)• Each backup has to be available 2 times – at least • Backup to Disk and Tape• Wide range of Databases – mySQL, MS SQL, Sybase,
PostgreSQL• Upredictable data growth – 100 GB to 500 GB per month
![Page 14: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/14.jpg)
Data Growth
06.01.07
03.02.07
05.03.07
10.04.07
06.05.07
02.06.07
17.07.07
06.08.07
01.09.07
06.10.07
03.11.07
01.12.07
06.01.08
02.02.08
05.03.08
08.04.08
03.05.08
07.06.08
05.07.08
02.08.08
06.09.08
04.10.08
03.11.08
08.12.08
03.01.09
09.02.09
07.03.09
04.04.09
02.05.09
06.06.09
13.07.09
01.08.09
05.09.09
04.10.09
07.11.09
05.12.09
02.01.10
06.02.10
06.03.10
03.04.10
01.05.10
05.06.10
03.07.10
07.08.10
04.09.10
02.10.10
06.11.10
04.12.10
01.01.11
05.02.11
05.03.11
02.04.11
07.05.11
04.06.11
02.07.11
06.08.11
03.09.11
01.10.11
05.11.11
03.12.11
07.01.12
11.02.12
10.03.12
14.04.12
12.05.12
09.06.12
14.07.12
11.08.12
08.09.12
06.10.12
10.11.12
08.12.12
12.01.13
09.02.13
09.03.13
06.04.13
11.05.13
08.06.13
13.07.13
10.08.13
07.09.13
12.10.13
09.11.13
0
2.000
4.000
6.000
8.000
10.000
12.000
14.000
16.000
Jan 2007 Nov 2013
![Page 15: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/15.jpg)
Actual Implementation
• Cluster FS Storage Cluster with Replication – 50TB of Backup Data ==> 100 TB soon
• SEP sesam Server on Linux• File, Database and Bare System Recovery Backup
of Linux and Windows Servers to Cluster FS (Storage Cluster)• Automated replication of the backup data via Cluster FS• Migration of dedicated backups to tape• Automated restore possible from all Nodes and from tape
![Page 16: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/16.jpg)
Ongoing Projects
• Enlarge the storage capacity• Deduplication of Backup Data by SEP Si3T Technology
• Conflict of interest - performance vs. invest for storage
• New Storage HW – Standard Server with 130 TB net capacity
• Slow disks slow down the backup - „smart“ backup tasks speeds up to 2,5 TB / hour
![Page 17: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/17.jpg)
Session title
Red Hat Storage & SEP Sesam
![Page 18: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/18.jpg)
Session title
Free technical Workshop
Free technical Workshop
• SEP sesam
& Red Hat Storage
• 1 Day @ Dupaco Leusden
• 18th of March 2014
• www.dupaco.de
![Page 19: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/19.jpg)
Session title
88% Capability related challanges
84% Complexity
87% CostVeeam,Annual Data Protection Report 2013
Backup issues
![Page 20: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/20.jpg)
Backup is not important
All backup is done to ensure a fast and reliable restore!
The restore and disaster recovery requirements define the backup strategy – not the other way around!
![Page 21: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/21.jpg)
SEP sesam can do it
![Page 22: Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments](https://reader034.fdocuments.us/reader034/viewer/2022042816/5591d37d1a28abbe658b46c6/html5/thumbnails/22.jpg)
• Textmasterformate durch Klicken bearbeitenZweite EbeneDritte EbeneVierte EbeneFünfte Ebene
Q & A
Hubert [email protected]