Building Pipelines with the SDK

Use the Kubeflow Pipelines SDK to build components and pipelines

Kubeflow Pipelines SDK v2

Learn how to get started with Kubeflow Pipelines SDK v2

Introduction to the Pipelines SDK

Overview of using the SDK to build components and pipelines

Install the Kubeflow Pipelines SDK

Setting up your Kubeflow Pipelines development environment

Connecting to Kubeflow Pipelines using the SDK client

How to connect to Kubeflow Pipelines using the SDK client and configure the SDK client using environment variables

Build a Pipeline

A tutorial on building pipelines to orchestrate your ML workflow

Building Components

A tutorial on how to create components and use them in a pipeline

Building Python function-based components

Building your own lightweight pipelines components using Python

Best Practices for Designing Components

Designing and writing components for Kubeflow Pipelines

Pipeline Parameters

Passing data between pipeline components

Visualize Results in the Pipelines UI

Visualizing the results of your pipelines component

Pipeline Metrics

Export and visualize pipeline metrics

DSL Static Type Checking

Statically check the component I/O types

DSL Recursion

Author a recursive function in DSL

Using environment variables in pipelines

How to set and use environment variables in Kubeflow pipelines

GCP-specific Uses of the SDK

SDK features that are available on Google Cloud Platform (GCP) only

Kubeflow Pipelines SDK for Tekton

How to run Kubeflow Pipelines with Tekton

Manipulate Kubernetes Resources as Part of a Pipeline

Overview of using the SDK to manipulate Kubernetes resources dynamically as steps of the pipeline

Python Based Visualizations (Deprecated)

Predefined and custom visualizations of pipeline outputs

Last modified 03.03.2021: Move Kubeflow Pipelines under /components (#2505) (c34470b8)