Monitoring your DPDK application with collectd/snap...to showcase the performance of your...
Transcript of Monitoring your DPDK application with collectd/snap...to showcase the performance of your...
![Page 1: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/1.jpg)
Monitoring your DPDK application withcollectd/snap
Maryam Tahhan , Emma Foley and Daniel Parker
DPDK Summit Userspace - Dublin- 2016
![Page 2: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/2.jpg)
Agenda
Why would you want to monitor your application?How can you monitor your application?DemoHow can you get metrics and events to OpenStack? Summary
![Page 3: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/3.jpg)
Agenda
Why would you want to monitor your application?How can you monitor your application?DemoHow can you get metrics and events to OpenStack? Summary
![Page 4: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/4.jpg)
4
Why would you want to monitor your application?
“Data Centres are powering our everyday lives. Organizations can lose an average of $138,000 for one hour of downtime.” [1].
Telco and Enterprise alike are asking how they get and provide Service Assurance, QoS and provide SLA’s on the
platform and services when deploying NFV.
It is vital to monitor systems for malfunctions or misbehaviours that could lead to service disruption and promptly react to
these faults/events to minimize service disruption/downtime.
![Page 5: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/5.jpg)
![Page 6: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/6.jpg)
Agenda
Why would you want to monitor your application?How can you monitor your application?DemoHow can you get metrics and events to OpenStack? Summary
![Page 7: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/7.jpg)
How Can you monitor your application?
Collectd
A systems statics collection daemon.
Plugin Architecture
Supports 90+ plugins
collectd also provides some simple thresholding and event notification capabilities
Snap
An open telemetry framework designed to simplify the collection, processing and publishing of system data through a single API.
Plugin Architecture
Tribe
Dynamic updates
![Page 8: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/8.jpg)
8
Collectd architecture
![Page 9: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/9.jpg)
Snap Architecture
![Page 10: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/10.jpg)
At this point you’re thinking…
![Page 11: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/11.jpg)
DPDK Plugins
DPDK stats Runs as a DPDK secondary process. Use DPDK xstats API to retrieve stats for each DPDK interface. Available in upstream collectd Will be upstreamed to snap shortly.
DPDK Events Uses DPDK Keep Alive to report packet processing core status. Reports DPDK interface Link status. Will be upstreamed to both collectd and snap shortly.
![Page 12: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/12.jpg)
Agenda
Why would you want to monitor your application?How can you monitor your application?DemoHow can you get metrics and events to OpenStack? Summary
![Page 13: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/13.jpg)
Demo
Testpmd
Testpmd
![Page 14: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/14.jpg)
Demo
Add Demo youtube here
![Page 15: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/15.jpg)
![Page 16: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/16.jpg)
Agenda
Why would you want to monitor your application?How can you monitor your application?DemoHow can you get metrics and events to OpenStack? Summary
![Page 17: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/17.jpg)
How to get metrics and stats to OpenStack
![Page 18: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/18.jpg)
Agenda
Why would you want to monitor your application?How can you monitor your application?DemoHow can you get metrics and events to OpenStack? Summary
![Page 19: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/19.jpg)
Summary
“Trying to manage a complex cloud solution without a proper telemetry infrastructure in place is like trying to walk across a busy highway with blind eyes and deft ears. You have little to no idea of where the issues can come from, and no chances to take any smart move without getting in trouble”. [1]
You can now monitor your DPDK application by leveraging the DPDK plugins for snap and collectd and you can also leverage visualization tools to showcase the performance of your application in action.
The metrics and stats collectd by the dpdk plugins fit into a bigger service assurance picture if you are deploying a DPDK application in the cloud.
![Page 20: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/20.jpg)
Questions?Maryam Tahhan [email protected]
Emma Foley [email protected]
Daniel Parker [email protected]
![Page 21: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/21.jpg)
![Page 22: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/22.jpg)
References
[1] https://azure.microsoft.com/en-us/blog/cloud-service-fundamentals-telemetry-basics-and-troubleshooting/
![Page 23: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/23.jpg)
Backup
![Page 24: Monitoring your DPDK application with collectd/snap...to showcase the performance of your application in action. The metrics and stats collectd by the dpdk plugins fit into a bigger](https://reader034.fdocuments.us/reader034/viewer/2022050307/5f6f237ca1b6f90de257fbff/html5/thumbnails/24.jpg)