MooseFS- Stogare for Big Data
-
Upload
moosefs -
Category
Technology
-
view
917 -
download
3
Transcript of MooseFS- Stogare for Big Data
![Page 1: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/1.jpg)
HIGHLY RELIABLE PETABYTE S TORAGE
Enterprise LevelS afe S torage S olution
by Peter aNeutrino
24.04.201 2 d la Ge m ius
![Page 2: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/2.jpg)
Classic storage is expensive
2/36
![Page 3: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/3.jpg)
MooseFS
3/36
![Page 4: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/4.jpg)
C o m p a r i s o n o f B a s i c , A d v a n c e d a n d
E n t e r p r i s e s u p p o r t c o n t r a c t s t y p e s
s u p p o r t r i g h t s b a s i c a d v a n c e d e n t e r p r i s e
p o s s i b i l i t y t o c o m e o n y o u r s i t e
p r o a c t i v e m o n i t o r i n g
r e q u e s t r e m o t e a s s i s t a n c e
c a ll u s - + 4 8 2 2 3 7 8 3 0 8 2
e - m a i l u s - h e lp @ m o o s e f s . c o m
c u s t o m e r p o r t a l
d e d i c a t e d t e c h n i c a l a d v i s o r
Levels of Technical Support
4/36
![Page 5: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/5.jpg)
MooseFS
S a f e t y K n o w le d g e P e r f o r ma n c e
5/36
![Page 6: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/6.jpg)
Table of Savings in AdOcean
6/36
90 TB +90TB (total 180TB) +220TB (total 400TB)
630 000 580 000 1 100 000
220 000 150 000 290 000
80 000 140 000 210 000
330 000 290 000 600 000
1 220 000
2 0 10 2 0 11 2 0 12
T h e s iz e o f s t o r a g e
2 0 11
A lt e r n a t iv e s t o r a g e
MooseFS equipmentIntel Storage Servers + disks
MooseFS support
S a v in g s
Sums in PLN
Recapitulation of gained profits (expenses in particular years):
![Page 7: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/7.jpg)
M o o s e in N u m b e r s
L e n g t h : t o 2 m
H e ig h t : t o 3 m
W e ig h t : t o 7 0 0 k g
Creative Commons, Ryan Hagerty http://www.flickr.com/photos/usfwshq/6862339335/7/36
![Page 8: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/8.jpg)
MooseFS in numbers:
M a x im u m s iz e o f in s t a n c e :
16 EiBM a x im u m f i le s iz e :
128 PiBM a x im u m n u m b e r o f f i le s :
536 millions
8/36
![Page 9: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/9.jpg)
MooseFS in numbers,P R O D U C T IO N :
T h e la r g e s t in s t a n c e :
More than 6PB (for 2 years)
T h e la r g e s t f i le :
More than 8TB (from 2011)
T h e la r g e s t n u m b e r o f f i le s :
More than 100 million (for 4 years)(backup for 400 for linux)
9/36
![Page 10: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/10.jpg)
B lo c k s t o r a g eDivision of space into memory blocks “vrtiual hard drives”
A d v a n t a g e s o f s u c h s t o r a g e s o lu t io n :
- availability on the market,
- ease of installation (“turning on with pushing the button”),
- standardisation,
- allows to install any file system.
10/36
![Page 11: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/11.jpg)
B lo c k s t o r a g eDivision of space into memory blocks “virtual hard drives”
D is a d v a n t a g e s o f s u c h s t o r a g e s o lu t io n :
- limit of the scalability,
- drives that are certified by manufacturer of the matrix,,
- the necessity of all the drives to be the same sized,
- negative influence of the breakdowns at the efficiency of the system.
11/36
![Page 12: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/12.jpg)
F i le s t o r a g eManagement of the files on any disk space (for example 15 0 0 h a r d
d r iv e s )
A d v a n t a g e s o f s u c h s o lu t io n :
- effective space management,
- utilization of processing power of the cluster for business applications,
- repairs are up to 1000 times faster,
- possibility to use it with cheap equipment.
12/36
![Page 13: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/13.jpg)
F i le s t o r a g eManagement of the files on any disk space (for example 15 0 0 h a r d
d r iv e s )
D is a d v a n t a g e s o f s u c h s o lu t io n :
- less efficient with small size data,
- sometimes dedicated software is needed in order to connect given server to file storage resources..
13/36
![Page 14: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/14.jpg)
Unrecoverable Read Error
Total Disk Faliure
Annual Fail Rate
Mean Time Before Failure
RAID 5RAID 6
R E P A IR T IM Erecovering of 1TB+ disk
is from 2 to 20h
14/36
![Page 15: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/15.jpg)
In M o o s e F S The larger the storage The faster the recovery
15/36
![Page 16: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/16.jpg)
Machanism of r e p l ic a t io n solves the problems of: AFR, MTBF, TDF
16/36
![Page 17: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/17.jpg)
M o o s e F S has built-in fast and transparent c o n t r o l s u m s , that solve the URE problem
17/36
![Page 18: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/18.jpg)
M o o s e F S has built-in fast and transparent c o n t r o l s u m s
18/36
![Page 19: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/19.jpg)
M o o s e F S has built-in fast and transparent c o n t r o l s u m s
19/36
![Page 20: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/20.jpg)
M o o s e F S has built-in fast and transparent c o n t r o l s u m s
20/36
![Page 21: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/21.jpg)
WITH MooseFS IT IS WORTH TO USE DISKS 1TB+
21/36
ceny z serwisu CENEO
![Page 22: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/22.jpg)
MooseFS is used by interactive internet television “IPLA” since 2008.
Tanks to MooseFS they have storage with the best ratio of price and GigaByte on the market.
22/36
![Page 23: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/23.jpg)
R O I for block storage
23/36
![Page 24: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/24.jpg)
R O I is higher with M o o s e F S
24/36
![Page 25: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/25.jpg)
“We have chosen to use MooseFS because of the great opportunity of developing the infrastructure
(you can add any disks of any size)(...). ”
Giovanni Toraldo,http://blog.opennebula.org/?p=1512
25/36
![Page 26: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/26.jpg)
Extra functions with MooseFS
26/36
![Page 27: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/27.jpg)
S n a p s h o t s - fast and always possible
27/36
![Page 28: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/28.jpg)
S n a p s h o t s - fast and always possible
28/36
![Page 29: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/29.jpg)
S n a p s h o t s - fast and always possible
29/36
![Page 30: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/30.jpg)
Admins and users adore t r a n s p a r e n t t r a s h function
30/36
![Page 31: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/31.jpg)
M o o s e F S is free — G P L v 3
31/36
![Page 32: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/32.jpg)
S a f e , e f f ic ie n t and t e s t e d storage solution
with e n t e r p r is e s u p p o r t
32/36
![Page 33: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/33.jpg)
Since 2005, we work on the development and continuous improvementof M o o s e F S - foolproof distributed file system.
![Page 34: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/34.jpg)
We provide professional servicesrelated to the use MooseFS:
- creation of client-specific solutions,
- technical support,
- providing trainings,
- verification and audit,
- providing consultations and advices.
34/36
![Page 35: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/35.jpg)
35/36
![Page 36: MooseFS- Stogare for Big Data](https://reader030.fdocuments.us/reader030/viewer/2022032616/55a4df5b1a28abad0e8b463c/html5/thumbnails/36.jpg)
Customer Driven Development
CDD
36/36