Statistics for Engineers @ SRECon EMEA 2023¶
Gathering all kinds of telemetry data is key to operating reliable distributed systems at scale. Once you have set-up your telemetry systems and recorded all relevant data, the challenge becomes to make sense of it and extract valuable information. Statistics is the art of extracting information from data. In this talk we will discuss mathematical methods, that will help you in your daily work as SRE. Specifically we will cover the following subjects:
- Visualization of telemetry data with chats, scatter plots and heatmaps
- Summarizing and Data with means, medians and percentiles
- Sampling telemetry data and the impact on RED (Rate, Error, Duration) metrics
In the talk we will cover the topics from both the theoretical and the practical side, providing examples for the most relevant use cases and technologies on production data.
# !pip install ipynbname import ipynbname nb_name = ipynbname.path().name
%%script bash -s "$nb_name" # # Export Notebook as Blogpost # # WARNING: This will operate on the last saved version! # ./render.sh "./$1" ./nb.html cat <<EOF > fm.html --- title: Statistics for Engineers @ SRECon EMEA 2023 date: 2023-10-15 tags: talk, post url: /srecon-emea-2023 outputs: - RawHTML --- EOF cat fm.html nb.html > out.html cp out.html "/host/root/home/hhartmann/src/HeinrichHartmann.github.io/hugo/content/posts/raw/srecon-emea-2023.html"
[NbConvertApp] Converting notebook ./2023-10-15 SREConEMEA 2023.ipynb to HTML [NbConvertApp] Writing 1036297 bytes to nb.html