Running eBPF Tools in Minikube

Running eBPF Tools in Minikube

Overview

eBPF tools are performance tools used for observing the Linux kernel. These tools can be used to monitor your Kubernetes application in minikube. This tutorial will cover how to set up your minikube cluster so that you can run eBPF tools from a Docker container within minikube.

Prerequisites

  • Latest minikube binary

Tutorial

First, start minikube:

  1. $ minikube start --iso-url https://storage.googleapis.com/minikube-performance/minikube.iso

You will need to download and extract necessary kernel headers within minikube:

  1. minikube ssh -- curl -Lo /tmp/kernel-headers-linux-4.19.94.tar.lz4 https://storage.googleapis.com/minikube-kernel-headers/kernel-headers-linux-4.19.94.tar.lz4
  3. minikube ssh -- sudo mkdir -p /lib/modules/4.19.94/build
  5. minikube ssh -- sudo tar -I lz4 -C /lib/modules/4.19.94/build -xvf /tmp/kernel-headers-linux-4.19.94.tar.lz4
  7. minikube ssh -- rm /tmp/kernel-headers-linux-4.19.94.tar.lz4

You can now run BCC tools as a Docker container in minikube:

  1. $ minikube ssh -- docker run --rm   --privileged   -v /lib/modules:/lib/modules:ro   -v /usr/src:/usr/src:ro   -v /etc/localtime:/etc/localtime:ro   --workdir /usr/share/bcc/tools   zlim/bcc ./execsnoop
  4. Unable to find image 'zlim/bcc:latest' locally
  5. latest: Pulling from zlim/bcc
  6. 6cf436f81810: Pull complete
  7. 987088a85b96: Pull complete
  8. b4624b3efe06: Pull complete
  9. d42beb8ded59: Pull complete
  10. 90970d1ebfd9: Pull complete
  11. 29c3815350eb: Pull complete
  12. e21dfbd8fcfc: Pull complete
  13. Digest: sha256:914bea8970535cd6b0d5dee13f99569c5f0d597942c8333c0aa92443473aff27
  14. Status: Downloaded newer image for zlim/bcc:latest
  15. PCOMM            PID    PPID   RET ARGS
  16. runc             5059   2011     0 /usr/bin/runc --version
  17. docker-init      5065   2011     0 /usr/bin/docker-init --version
  18. nice             5066   4012     0 /usr/bin/nice -n 19 du -x -s -B 1 /var/lib/kubelet/pods/1cf22976-f3e0-498b-bc04-8c7068e6e545/volumes/kubernetes.io~secret/storage-provisioner-token-cvk4x

Last modified November 14, 2020: Fix whitespace issues in the site content markdown (ebf37ad15)