Skip to content

kubeflow/pipelines

This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.

Folders and files

NameName
Last commit message
Last commit date
Sep 6, 2024
Aug 6, 2024
Sep 6, 2024
Aug 28, 2024
Jun 22, 2024
Sep 6, 2024
Sep 21, 2023
Aug 23, 2024
Sep 3, 2024
May 4, 2023
Aug 2, 2024
Sep 3, 2024
Sep 6, 2024
Sep 6, 2024
Aug 14, 2024
Jun 8, 2021
Aug 14, 2024
Jul 13, 2021
Jan 11, 2019
Jan 23, 2024
May 17, 2023
Jul 19, 2022
May 17, 2023
Mar 18, 2022
Jun 22, 2024
Aug 14, 2024
Nov 30, 2021
Jun 1, 2021
Apr 30, 2024
Mar 5, 2024
Nov 2, 2018
Sep 6, 2024
Aug 23, 2024
Sep 6, 2024
May 18, 2022
Dec 2, 2023
Apr 30, 2024
Jul 16, 2021
Aug 23, 2024
Aug 23, 2024
Apr 20, 2022
Jun 23, 2020
Jun 23, 2020
Oct 26, 2023
Nov 30, 2020
Aug 18, 2021
Feb 1, 2021
Feb 1, 2021

Repository files navigation

Coverage Status SDK Documentation Status SDK Package version SDK Supported Python versions

Overview of the Kubeflow pipelines service

Kubeflow is a machine learning (ML) toolkit that is dedicated to making deployments of ML workflows on Kubernetes simple, portable, and scalable.

Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.

The Kubeflow pipelines service has the following goals:

  • End to end orchestration: enabling and simplifying the orchestration of end to end machine learning pipelines
  • Easy experimentation: making it easy for you to try numerous ideas and techniques, and manage your various trials/experiments.
  • Easy re-use: enabling you to re-use components and pipelines to quickly cobble together end to end solutions, without having to re-build each time.

Installation

  • Kubeflow Pipelines can be installed as part of the Kubeflow Platform. Alternatively you can deploy Kubeflow Pipelines as a standalone service.

  • The Docker container runtime has been deprecated on Kubernetes 1.20+. Kubeflow Pipelines has switched to use Emissary Executor by default from Kubeflow Pipelines 1.8. Emissary executor is Container runtime agnostic, meaning you are able to run Kubeflow Pipelines on Kubernetes cluster with any Container runtimes.

Documentation

Get started with your first pipeline and read further information in the Kubeflow Pipelines overview.

See the various ways you can use the Kubeflow Pipelines SDK.

See the Kubeflow Pipelines API doc for API specification.

Consult the Python SDK reference docs when writing pipelines using the Python SDK.

Contributing to Kubeflow Pipelines

Before you start contributing to Kubeflow Pipelines, read the guidelines in How to Contribute. To learn how to build and deploy Kubeflow Pipelines from source code, read the developer guide.

Kubeflow Pipelines Community Meeting

The meeting is happening every other Wed 10-11AM (PST) Calendar Invite or Join Meeting Directly

Meeting notes

Kubeflow Pipelines Slack Channel

#kubeflow-pipelines

Blog posts

Acknowledgments

Kubeflow pipelines uses Argo Workflows by default under the hood to orchestrate Kubernetes resources. The Argo community has been very supportive and we are very grateful. Additionally there is Tekton backend available as well. To access it, please refer to Kubeflow Pipelines with Tekton repository.