YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software...
Transcript of YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software...
![Page 1: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/1.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
YOUR INFORMATION IS OUR BUSINESS
itiso GmbH
Flughafenstraße 52a
22335 Hamburg
www.itiso.de
Software-defined Scale Out Storage – neues
Universalgenie für das Datenmanagement?
storage2day, Heidelberg, 18.09.19
Dr. Wolfgang Obelöer
Technischer Leiter
![Page 2: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/2.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Inhalt• Software Defined Scale Out Storage
– Software Defined
– Scale Out
– Skalierung
– Protokolle & Netzwerke
– Vergleich Scale Up vs. Scale Out Protokolle
• Beispielprodukte
• Zusammenfassung
![Page 3: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/3.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Software Defined Scale Out Storage
![Page 4: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/4.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Software Defined Storage
![Page 5: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/5.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Software Defined Storage• Software, die die Datenservices bereitstellt und unabhängig
von der unterliegenden HW ist
• Hardware, die den SDS-Code ausführt
• Hardware, die die Daten speichert
• Hardware spielt immer noch eine Rolle, sie bestimmt auch:
– Performance
– Kapazität
![Page 6: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/6.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Prinzipieller Aufbau Scale Out
Storage
Software
Storage
Software
Storage
Software
Storage
Software
![Page 7: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/7.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Datensicherheit Replika
Storage
Software
Storage
Software
Storage
Software
Storage
Software
O
Original
R
1
Replika 1
R
2
Replika 2
R
2
Replika 2‘
![Page 8: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/8.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Datensicherheit Erasure Coding• - Basiert auf Vandermonde-Reed-Solomon Error Correction
![Page 9: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/9.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Erasure Coding (einfaches Beispiel)
Coding
Value Split Code
A1=1
A2=2
A3=3
A4=5
X1=1
X2=2
A=12Example
Mirror
A1=1
A2=1
A3=2
A4=2
![Page 10: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/10.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Skalierung
Storage
Software
Storage
Software
Storage
Software
Storage
Software
Storage
Software
Performance steigt
Kapazität steigt
![Page 11: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/11.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Storage
Software
Erneuerung
Storage
Software
Storage
Software
Storage
Software
Storage
SoftwareStorage
Software
![Page 12: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/12.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Protokolle & Netzwerke
![Page 13: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/13.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Protokollbeispiele• Object Store/S3
– Globaler Namensraum
– Kein Locking nötig
• NAS: NFS/CIFS– Globaler Namensraum
– Locking
– Hohe Bandbreiten
• Block: iSCSI/iSER– Kein Locking nötig
– Niedrigste Latenzen
![Page 14: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/14.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Scale Up vs. Scale Out
Scale Up Scale Out
BauartHomogene, spezialisierte
Umgebungen
Software auf Servern, heterogene
Hardware (All-Flash, Hybrid, Multi-
Vendor)
Skalierbarkeit Forklift-Upgrades für LeistungHinzufügen von Knoten für
Kapazität und Leistung
Verfügbarkeit Redundante Komponenten
Datenverteilung im gesamten
System, Verbessert sich mit der
Skalierung.
ModernisierungForklift-Upgrades
(Softwarekosten?)
Neuen Knoten hinzufügen, alten
löschen
DatenlebenszyklusExterne Datenmigration bei
UpgradeKeine externe Datenmigration
![Page 15: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/15.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Beispiele
Software Defined Scale Out Storage
![Page 16: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/16.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Beispiele
![Page 17: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/17.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Architektur
Node 1 Node 2 Node n
Direct-on-Drive
Log-structured
Key/Value store
NVDIMM
NVMe Flash
HDD
NVDIMM
Optane
NVDIMM
SSD/NMVe
Control Plane
Policy PolicyPolicyCompute
Data Plane
REST
iSCSI
S3
Bare
Metal
und mehr
![Page 18: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/18.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
PerformanceDesigned for Scale-Out
• Benutzerdefiniertes
Dateisystem im Kernel
Native IO Performance
• Read von Media Speed
• Write zu Persistent Memory
Adaptive
• Kompression/Deduplizierung
Enterprise Feature Set
• Datenintegritätsprüfungen
37µs
60µs
10µs
107µsRead Latency
DateraStorage Software
ConnectivityTCP+iSCSI
Multipathing
MediaIntel Optane
Gemessene Latenz am Client (4kB Random I/O)
![Page 19: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/19.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Use CasesWorkloads &
Requirements
Datera
Data ExchangeCloud
Endpoints
Automation ● Policies Simplicity ● Performance ● Predictive Ops
Traditional Big Data / IOT Microservices VMs Containers / λ
Ein Produkt, viele Anwendungsfälle
SLO-getrieben
Flexible HW / Medien
![Page 20: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/20.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Wesentliche EigenschaftenData
Orchestration
Anwendungsorientiert
Self-Service-Benutzermodell
Richtlinienbasiert
Live-Datenmigration
Live-Einfügen von Knoten
Anwendungstemplates
Erweitertes Tiering
API first
Enterprise
Performance
< 200uS Latenzzeit
180K IOPS pro Knoten
3.3GB/s pro Knoten
Scale-Out auf mehrerePBs
Quality of Service
ErweiterteDatenfunktionen
Future-Ready
Choice
100% Software-Defined
Beliebige Speichermedien
Heterogene Knoten
Keine Lieferantenbindung
iSCSI-Block
S3 Objekt
VMware & KVM
OpenStack, CloudStack
Data Center
Awareness
Mandantenfähigkeit
Bare Metal, VMs und Container
No Silos
EinstellbareVerfügbarkeit
Fehlerdomänen
Metro/ Stretch Cluster
Natives L3-Netzwerk
Predictive
Operations
Cloud-basiertes Management
Kontinuierliche Optimierung
Maschinelles Lernen
Erkennung von Anomalien
Voraussagen
![Page 21: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/21.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Beispiele
![Page 22: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/22.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Universal Scale NASDie Vorteile:
● Performance linear zur Clustergröße
● Performance unabhängig von Dateigröße
● Performance unabhängig von Dateianzahl
● keine Limitierungen der Dateigröße
● keine Limitierung von Dateianzahl
● On Prem auf x86 Hardware
● Cloud AWS und GCP
● All Flash, Hybrid, Archive
![Page 23: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/23.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Features Flash-first hybrid• Flash für schnellen Zugriff
• HDD für Kapazität und Kosten
• Alle HDD Zugriffe sind sequentiell
• Block-based data protection
• Erasure Coding
Real-time Analytics integriert• Effektives User Management
• Real-time updates des FS: keine Jobs oder Treewalks notwendig
• Intelligente Quotas und Snapshots (inkl. VSS)
• API First Architektur, komplett administrierbar und erweiterbar über REST API
![Page 24: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/24.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Use Cases• Medien & Unterhaltung
• Videoüberwachung
• Telekommunikation
• Digitale Archive
• Biowissenschaften und medizinische Forschung
• Umgebungs-Echtzeit-Sensordaten (IoT)
• Wissenschaftliches rechnen
Also überall dort, wo:
• große Mengen an
unstrukturierten Daten
anfallen und/oder
• Hohe Bandbreiten
erforderlich sind.
Leistungsbeispiel: 4 Knoten
Cluster erreicht ca. 16-18
GB/s
![Page 25: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/25.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Beispiele
![Page 26: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/26.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Secondary Storage
![Page 27: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/27.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Cohesity Secondary Storage
![Page 28: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/28.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Eigenschaften
![Page 29: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/29.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Use Cases
![Page 30: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/30.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Zusammenfassung
![Page 31: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/31.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Software Defined Scale Out Storage• Einfache Skalierung
• Aktuellste HW (x86) oder Cloud einsetzbar
• Leichte Anpassung an geänderte Last- und Kapazitätsanforderungen
• Keine externe Datenmigration bei HW-Erneuerung
• Definierbarer und effizienterer Datenschutz
• Verschiedene Einsatzgebiete: Höchste Leistung bis Archivstorage
![Page 32: YOUR INFORMATION IS OUR BUSINESS · YOUR INFORMATION IS OUR BUSINESS © itiso GmbH, 2019 Software Defined Scale Out Storage](https://reader034.fdocuments.us/reader034/viewer/2022042323/5f0d05f97e708231d4384be6/html5/thumbnails/32.jpg)
YOUR INFORMATION IS OUR BUSINESS
© itiso GmbH, 2019
Dr. Wolfgang Obelöer
www.itiso.de
Danke für ihre Aufmerksamkeit
YOUR INFORMATION IS OUR BUSINESS