Download - Introducing DS3 - a RESTful Interface to Deep Storage

Transcript
Page 1: Introducing DS3 - a RESTful Interface to Deep Storage

Interfaces  to  Deep  Storage  

Page 2: Introducing DS3 - a RESTful Interface to Deep Storage

REST  (Representa4onal  State  Transfer)      

•   REST  is  the  primary  set  of  principles  used  on  the  Web  •   Cloud  architectures  are  RESTful  •   A  REST  architecture  uses  a  client  and  server  model  •   REST  architectures  use  simple  commands  to  offer  high  value  services  

Page 3: Introducing DS3 - a RESTful Interface to Deep Storage

REST  Behind  the  Scene  S3  REST  Command:  PUT  

S3  REST  Command:  GET  

Page 4: Introducing DS3 - a RESTful Interface to Deep Storage

REST  Behind  the  Scene  S3  REST  Command:  PUT  

S3  REST  Command:  GET  

Page 5: Introducing DS3 - a RESTful Interface to Deep Storage

Example  REST  Interfaces  

• Simple  Storage  Services  (S3)  • OpenStack    • Atmos  • Cloud  Data  Management  Interface  (CDMI)  

Page 6: Introducing DS3 - a RESTful Interface to Deep Storage

S3  (Simple  Storage  Service)    

Created  by  Amazon,  S3  simplifies  web-­‐scale  storage  and  compu4ng  development.    –  Defines  a  cloud  storage  web  service  –  Proven  technology  and  wide  adop4on  (2+  trillion  objects)  – Many  clients  and  client  developers  

Page 7: Introducing DS3 - a RESTful Interface to Deep Storage

S3  +   +  Sequen4al  Media  Support  

Removable  Media  Support   =  

Page 8: Introducing DS3 - a RESTful Interface to Deep Storage

A  REST/S3  interface  

David  Trachy  Senior  Director  Emerging  Markets  

Page 9: Introducing DS3 - a RESTful Interface to Deep Storage

What  is  DS3?  

• A  Defined  Web  Service  • Uses  HTTP(s)  • RESTful  (the  way  the  web  works)  • Inherently  WAN  compa4ble  • Modeled  a\er  Amazon  S3  

Page 10: Introducing DS3 - a RESTful Interface to Deep Storage

Why  Amazon  Simple  Storage  Service?  

• Defines  a    cloud  storage  web  service  • Most  popular  cloud  storage  interface  – Proven  technology  (2+  trillion  objects)  – Many  clients  and  client  developers    

Page 11: Introducing DS3 - a RESTful Interface to Deep Storage

Why  We  Like  about  S3    

 • Security  model  • Data  integrity  • Encryp4on  support  • Par4al  data  object  restore  • Meta-­‐data  per  data  object  • Infinite  scale-­‐out    

Page 12: Introducing DS3 - a RESTful Interface to Deep Storage

S3  Concepts    

• Object  – A  hunk  of  data  (ex:  file,  medical  image)  – “Put”  or  “Get”  object  from  S3  – Objects  are  typically  files  from  a  file  system  – Small  or  large  objects  are  supported  

• Bucket  – A  large  collec4on  of  objects  

Page 13: Introducing DS3 - a RESTful Interface to Deep Storage

What  did  we  add  to  get  DS3?  

• For  sequen4al  storage  medium  – Bulk  Put,  write  a  large  number  of  objects  – Bulk  Get,  read  a  large  number  of  objects    

• For  removal  storage  medium  – Export  Bucket,  Eject  all  pieces  of  media  associated  with  a  bucket  

Page 14: Introducing DS3 - a RESTful Interface to Deep Storage

DS3  Availability      

•   Public  announcement    – Today,  October  8,  2013  @  12:30  pm  MST  – No  embargo  on  DS3  or  Vision  informa4on  

• Availability  –  Immediately  to  development  community