Boris Mattijssen Follow Nerdalize - Deltares
Transcript of Boris Mattijssen Follow Nerdalize - Deltares
![Page 1: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/1.jpg)
Building the cloud, one house at a time
Boris Mattijssen
+316 57889845
Follow Nerdalize
![Page 2: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/2.jpg)
Outline
● Who is Nerdalize?
● How to benefit from the cloud
● Hands-on: Using Docker and Nerdalize
![Page 3: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/3.jpg)
A short introduction of Nerdalize
![Page 5: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/5.jpg)
Cloud is the steam engine of the 21st century
![Page 6: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/6.jpg)
Cloud is the steam engine of the 21st century
![Page 7: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/7.jpg)
The Nerdalize benefits
The World
saves on energy
3t CO2/yr per household
Home Owner
saves on heating
€300/yr
Cloud User
reduces cloud costs
30% - 50%
![Page 8: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/8.jpg)
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at great price / performance;
3. without vendor lock-in;
4. and being easy to use.
![Page 9: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/9.jpg)
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
50 CloudBoxes
![Page 10: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/10.jpg)
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
Delft3D 1000 vCPU
![Page 11: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/11.jpg)
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
![Page 12: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/12.jpg)
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
![Page 13: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/13.jpg)
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
![Page 14: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/14.jpg)
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
> nerd upload dataset ~/my-dataset
> nerd workload start quay.io/nerdalize/delft3d --input-dataset 308c7bf29
> nerd task create 07bb2204534256f48a66
> nerd dataset download 81b8365bd1a6b3d36e7b ~/simulation-output
![Page 15: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/15.jpg)
Workshop
![Page 16: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/16.jpg)
Interactive workshop
1. Getting to know each other
2. Setup
3. Running Delft3D in Docker
4. Running Delft3D (in Docker) on Nerdalize
![Page 17: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/17.jpg)
Getting to know each other
● Who is running Windows / macOS / linux?
● Who works with Delft3D?
● Who has ever worked with Docker?
![Page 18: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/18.jpg)
Setup
1. Install Docker
2. Download Delft3D example dataset
![Page 19: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/19.jpg)
Running Delft3D in Docker
![Page 20: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/20.jpg)
What is Docker?
“Docker containers wrap up a piece of software in
a complete filesystem that contains everything it
needs to run: code, runtime, system tools, system
libraries – anything you can install on a server. This
guarantees that it will always run the same,
regardless of the environment it is running in.”
![Page 21: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/21.jpg)
What is Docker?
File
System Runtime
System
Tools
System
Libs
![Page 22: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/22.jpg)
What is Docker?
![Page 23: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/23.jpg)
What is Docker?
![Page 24: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/24.jpg)
Why use Docker?
1. Deterministic software configuration
2. Portable (Across computers and to the Cloud)
3. Easy to share and collaborate on
4. Quick to start and extend
![Page 25: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/25.jpg)
Simple as that
docker run \
-v ~/my-dataset:/input \
-v ~/simulation-output:/output \
quay.io/nerdalize/delft3d
![Page 26: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/26.jpg)
Running Delft3D on Nerdalize
![Page 27: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/27.jpg)
Running Delft3D on Nerdalize
1. Upload your input dataset
2. Run the Docker container on Nerdalize
○ Scale up to 8 vCPU for demo
○ Could scale up to hundreds of vCPUs in real-world cases
3. Download your output dataset
![Page 28: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/28.jpg)
Running Delft3D on Nerdalize
nerdalize.com/beta
promo code dsd17
![Page 29: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/29.jpg)
What did we do?
Workload - Image
- Dataset
Worker Task
(Delft3D)
Input
Dataset
Output
Dataset
Upload
Start
Workload
Create Execute Upload
Create
Task
View logs Download
Results
Worker
Worker
![Page 30: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/30.jpg)
Evaluation
![Page 31: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/31.jpg)
Building the cloud, one house at a time
Boris Mattijssen
+316 57889845
Follow Nerdalize
nerdalize.com/dsd17
![Page 32: Boris Mattijssen Follow Nerdalize - Deltares](https://reader030.fdocuments.us/reader030/viewer/2022020917/61c148467ee2d559580f1274/html5/thumbnails/32.jpg)
Docker pointers (also see speaker notes)
1. Nerdalize documentation: www.nerdalize.com/docs
2. Nerdalize Delft3D application page: www.nerdalize.com/applications/delft3d
3. Docker short intro video (12 min): https://www.youtube.com/watch?v=YFl2mCHdv24
4. Docker long intro (45 min): https://www.youtube.com/watch?v=Vyp5_F42NGs&list=PLX0Ak4vUBQfC6S8egys9kx6uy6tpw5yDX
a. Also his video on Dockerfiles is intersting (45 min):
https://www.youtube.com/watch?v=6Er8MAvTWlI&index=4&list=PLX0Ak4vUBQfC6S8egys9kx6uy6tpw5yDX
5. Short videos about a lot of Docker concepts:
https://www.youtube.com/watch?v=kWkIMMYn6d4&index=1&list=PL7hgvWUGJtUtm-ZudXLKrqAnhkiRi0TtH
6. Docker official documentation (has some nice examples): docs.docker.com