Skip to content

Commit

Permalink
Revert "Added Pipelines v2 installation pages (#3782)"
Browse files Browse the repository at this point in the history
This reverts commit 5765bfa

Signed-off-by: Mathew Wicks <5735406+thesuperzapper@users.noreply.github.com>.
  • Loading branch information
thesuperzapper committed Jul 5, 2024
1 parent ca65827 commit 2bd812b
Show file tree
Hide file tree
Showing 7 changed files with 97 additions and 63 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -15,11 +15,11 @@ Kubeflow Pipelines runs on [Argo Workflows](https://argoproj.github.io/workflows

## Choosing the Workflow Executor

1. [Emissary executor](#emissary-executor) has been Kubeflow Pipelines' default executor since February 2022 when KFP 1.8 went GA.
1. [Emissary executor](#emissary-executor) has been Kubeflow Pipelines' default executor since Feburay 2022 when KFP 1.8 went GA.
We recommend Emissary executor unless you have known compatibility issues with Emissary, in which case please submit your
feedback in [the Emissary Executor feedback GitHub issue](https://github.com/kubeflow/pipelines/issues/6249).
feedback in [the Emissary Executor feedback Github issue](https://github.com/kubeflow/pipelines/issues/6249).

1. [Docker executor](#docker-executor) is available as a legacy choice. In case you do have compatibility issues with Emissary executor,
1. [Docker executor](#docker-executor) is available as a legacy choice. In case you do have compatibilty issues with Emissary executor,
and your cluster is running on an older version of Kubernetes (<1.20), you can configure to use Docker executor.

Note that Argo Workflows support other workflow executors, but the Kubeflow Pipelines
Expand All @@ -39,13 +39,13 @@ improvements can make it the default executor that most people should use going
* Cannot escape the privileges of the pod's service account.
* Migration: `command` must be specified in [Kubeflow Pipelines component specification](/docs/components/pipelines/reference/component-spec/).

Note, the same migration requirement is required by [Kubeflow Pipelines v2 compatible mode](/docs/components/pipelines/reference/version-compatibility/), refer to
Note, the same migration requirement is required by [Kubeflow Pipelines v2 compatible mode](/docs/components/pipelines/legacy-v1/sdk/v2-compatibility/), refer to
[known caveats & breaking changes](https://github.com/kubeflow/pipelines/issues/6133).

#### Migrate to Emissary Executor

Prerequisite: emissary executor is only available in Kubeflow Pipelines backend version 1.7+.
To upgrade, refer to [upgrading Kubeflow Pipelines](/docs/components/pipelines/operator-guides/installation/upgrade/).
To upgrade, refer to [upgrading Kubeflow Pipelines](/docs/components/pipelines/legacy-v1/installation/upgrade//).

##### Configure an existing Kubeflow Pipelines cluster to use emissary executor

Expand Down Expand Up @@ -97,7 +97,7 @@ To upgrade, refer to [upgrading Kubeflow Pipelines](/docs/components/pipelines/o
For [AI Platform Pipelines](https://cloud.google.com/ai-platform/pipelines/docs), check the "Use emissary executor" checkbox during installation.
For [Kubeflow Pipelines Standalone](/docs/components/pipelines/operator-guides/installation/standalone-deployment/), install `env/platform-agnostic-emissary`:
For [Kubeflow Pipelines Standalone](/docs/components/pipelines/legacy-v1/installation/standalone-deployment/), install `env/platform-agnostic-emissary`:
```bash
kubectl apply -k "github.com/kubeflow/pipelines/manifests/kustomize/env/platform-agnostic-emissary?ref=$PIPELINE_VERSION"
Expand Down Expand Up @@ -157,7 +157,7 @@ Step by step component migration tutorial:
1. The updated component can run on emissary executor now.
Note: Kubeflow Pipelines SDK compiler always specifies a command for
[python function based components](https://kubeflow-pipelines.readthedocs.io/en/stable/source/components.html#kfp.components.PythonComponent).
[python function based components](/docs/components/pipelines/legacy-v1/sdk/python-function-components/).
Therefore, these components will continue to work on emissary executor without
modifications.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -16,11 +16,11 @@ Pipelines written in any version of [TensorFlow Extended (TFX)](https://www.tens
The following table shows UI feature compatibility for TFX and Kubeflow Pipelines Backend versions:

| [TFX] \ [KFP Backend] | [KFP Backend] <= 1.5 | [KFP Backend] >= 1.7 |
|-----------------------|---------------------------------------------------|------------------------------------------------|
| [TFX] <= 0.28.0 | Fully Compatible ✅ | Metadata UI not compatible<sup>[2](#fn2)</sup> |
| --------------------- | ------------------------------------------------- | ---------------------------------------------- |
| [TFX] <= 0.28.0 | Fully Compatible ✅ | Metadata UI not compatible<sup>[2](#fn2)</sup> |
| [TFX] 0.29.0, 0.30.0 | Visualizations not compatible<sup>[1](#fn1)</sup> | Metadata UI not compatible<sup>[2](#fn2)</sup> |
| [TFX] 1.0.0 | Metadata UI not compatible<sup>[2](#fn2)</sup> | Metadata UI not compatible<sup>[2](#fn2)</sup> |
| [TFX] >= 1.2.0 | Metadata UI not compatible<sup>[2](#fn2)</sup> | Fully Compatible ✅ |
| [TFX] >= 1.2.0 | Metadata UI not compatible<sup>[2](#fn2)</sup> | Fully Compatible ✅ |

Detailed explanations:

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ Such deployment methods can be part of your local environment using the supplied
kustomize manifests for test purposes. This guide is an alternative to

[Deploying Kubeflow Pipelines
(KFP)](/docs/started/installing-kubeflow).
(KFP)](/docs/started/#installing-kubeflow).

## Before you get started

Expand Down Expand Up @@ -164,7 +164,7 @@ enhancements:
* Embedded service loadbalancer
* Embedded network policy controller

You can find the official K3s installation script to install it as a service
You can find the the official K3s installation script to install it as a service
on systemd- or openrc-based systems on the official
[K3s website](https://get.k3s.io).

Expand Down Expand Up @@ -216,7 +216,7 @@ curl -sfL https://get.k3s.io | sh -
The Windows Subsystem for Linux (WSL) lets developers run a GNU/Linux
environment—including most command-line tools, utilities, and applications—
directly on Windows, unmodified, without the overhead of a traditional virtual
machine or dual-boot setup.
machine or dualboot setup.

The full instructions for installing WSL can be found on the
[official Windows site](https://docs.microsoft.com/en-us/windows/wsl/install-win10).
Expand All @@ -227,7 +227,7 @@ WSL.
1. Install [WSL] by following the official [docs](https://docs.microsoft.com/en-us/windows/wsl/install-win10).
2. As per the official instructions, update WSL and download your preferred
distribution:
distibution:
- [SUSE Linux Enterprise Server 15
SP1](https://www.microsoft.com/store/apps/9PN498VPMF3Z)
Expand All @@ -249,7 +249,7 @@ Below are the steps to create a cluster on K3s in WSL
sudo ./k3s server
```
This will bootstrap a Kubernetes cluster, but you will cannot yet access from
This will bootstrap a Kubernetes cluster but you will cannot yet access from
your Windows machine to the cluster itself.
**Note:** You can't install K3s using the curl script because there is no
Expand All @@ -276,7 +276,7 @@ To set up access to your WSL instance:
1. Copy `/etc/rancher/k3s/k3s.yaml` from WSL to `$HOME/.kube/config`.

2. Edit the copied file by changing the server URL from `https://localhost:6443`
to the IP of your WSL instance (`ip addr show dev eth0`) (For example,
to the IP of the your WSL instance (`ip addr show dev eth0`) (For example,
`https://192.168.170.170:6443`.)

3. Run kubectl in a Windows terminal. If you don't kubectl installed, follow the
Expand All @@ -286,7 +286,7 @@ To set up access to your WSL instance:
K3ai is a lightweight "infrastructure in a box" designed specifically to install
and configure AI tools and platforms on portable hardware, such as laptops and
edge devices. This enables users to perform quick experiments with Kubeflow
edge devices. This enables users to perform quick experimentations with Kubeflow
on a local cluster.
K3ai's main goal is to provide a quick way to install Kubernetes (K3s-based) and
Expand Down Expand Up @@ -361,7 +361,7 @@ Below are the steps to remove Kubeflow Pipelines on kind, K3s, or K3ai:
kubectl delete -k {YOUR_MANIFEST_FILE}`
```
- To uninstall Kubeflow Pipelines using manifests from Kubeflow Pipelines'
- To uninstall Kubeflow Pipelines using manifests from Kubeflow Pipelines's
GitHub repository, run these commands:

```shell
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ portable installation that only includes Kubeflow Pipelines.
* Kubeflow Pipelines as [part of a full Kubeflow deployment](#full-kubeflow-deployment) provides
all Kubeflow components and more integration with each platform.
* **Beta**: [Google Cloud AI Platform Pipelines](#google-cloud-ai-platform-pipelines) makes it easier to install and use Kubeflow Pipelines on Google Cloud by providing a management UI on [Google Cloud Console](https://console.cloud.google.com/ai-platform/pipelines/clusters).
* A [local](/docs/components/pipelines/operator-guides/installation/localcluster-deployment) Kubeflow Pipelines deployment for testing purposes.
* A [local](/docs/components/pipelines/legacy-v1/installation/localcluster-deployment) Kubeflow Pipelines deployment for testing purposes.

## Choosing an installation option

Expand All @@ -28,7 +28,7 @@ all Kubeflow components and more integration with each platform.
If yes, choose the [full Kubeflow deployment](#full-kubeflow-deployment).
1. Can you use a cloud/on-prem Kubernetes cluster?

If you can't, you should try using Kubeflow Pipelines on a local Kubernetes cluster for learning and testing purposes by following the steps in [Deploying Kubeflow Pipelines on a local cluster](/docs/components/pipelines/operator-guides/installation/localcluster-deployment).
If you can't, you should try using Kubeflow Pipelines on a local Kubernetes cluster for learning and testing purposes by following the steps in [Deploying Kubeflow Pipelines on a local cluster](/docs/components/pipelines/legacy-v1/installation/localcluster-deployment).
1. Do you want to use Kubeflow Pipelines with [multi-user support](https://github.com/kubeflow/pipelines/issues/1223)?

If yes, choose the [full Kubeflow deployment](#full-kubeflow-deployment) with version >= v1.1.
Expand Down Expand Up @@ -59,32 +59,38 @@ To deploy Kubeflow Pipelines Standalone, you use kustomize manifests only.
This process makes it simpler to customize your deployment and to integrate
Kubeflow Pipelines into an existing Kubernetes cluster.

Installation guide: [Kubeflow Pipelines Standalone deployment
guide](/docs/components/pipelines/operator-guides/installation/standalone-deployment/)
Installation guide
: [Kubeflow Pipelines Standalone deployment
guide](/docs/components/pipelines/legacy-v1/installation/standalone-deployment/)

Interfaces:
Interfaces
:
* Kubeflow Pipelines UI
* Kubeflow Pipelines SDK
* Kubeflow Pipelines API
* Kubeflow Pipelines endpoint is **only autoconfigured** for Google Cloud.
* Kubeflow Pipelines endpoint is **only auto-configured** for Google Cloud.

If you wish to deploy Kubeflow Pipelines on other platforms, you can either access it through
`kubectl port-forward` or configure your own platform specific auth-enabled
endpoint by yourself.

Release Schedule: Kubeflow Pipelines Standalone is available for every Kubeflow Pipelines release.
Release Schedule
: Kubeflow Pipelines Standalone is available for every Kubeflow Pipelines release.
You will have access to the latest features.

Upgrade Support (**Beta**): [Upgrading Kubeflow Pipelines Standalone](/docs/components/pipelines/operator-guides/installation/standalone-deployment/#upgrading-kubeflow-pipelines) introduces how to upgrade
Upgrade Support (**Beta**)
: [Upgrading Kubeflow Pipelines Standalone](/docs/components/pipelines/legacy-v1/installation/standalone-deployment/#upgrading-kubeflow-pipelines) introduces how to upgrade
in place.

Google Cloud Integrations:
* A Kubeflow Pipelines public endpoint with auth support is **autoconfigured** for you.
Google Cloud Integrations
:
* A Kubeflow Pipelines public endpoint with auth support is **auto-configured** for you.
* Open the Kubeflow Pipelines UI via the **Open Pipelines Dashboard** link in [the AI Platform Pipelines dashboard of Cloud Console](https://console.cloud.google.com/ai-platform/pipelines/clusters).
* (Optional) You can choose to persist your data in Google Cloud managed storage (Cloud SQL and Cloud Storage).
* All options to authenticate to Google Cloud are supported.
* [All options to authenticate to Google Cloud](/docs/gke/pipelines/authentication-pipelines/) are supported.

Notes on specific features:
Notes on specific features
:
* After deployment, your Kubernetes cluster contains Kubeflow Pipelines only.
It does not include the other Kubeflow components.
For example, to use a Jupyter Notebook, you must use a local notebook or a
Expand All @@ -99,17 +105,20 @@ Notes on specific features:
Use this option to deploy Kubeflow Pipelines to your local machine, on-premises,
or to a cloud, as part of a full Kubeflow installation.

Installation guide: [Kubeflow installation guide](/docs/started/)
Installation guide
: [Kubeflow installation guide](/docs/started/)

Interfaces:
Interfaces
:
* Kubeflow UI
* Kubeflow Pipelines UI within or outside the Kubeflow UI
* Kubeflow Pipelines SDK
* Kubeflow Pipelines API
* Other Kubeflow APIs
* Kubeflow Pipelines endpoint is autoconfigured with auth support for each platform
* Kubeflow Pipelines endpoint is auto-configured with auth support for each platform

Release Schedule: The full Kubeflow is released quarterly. It has significant delay in receiving
Release Schedule
: The full Kubeflow is released quarterly. It has significant delay in receiving
Kubeflow Pipelines updates.

| Kubeflow Version | Kubeflow Pipelines Version |
Expand All @@ -124,15 +133,18 @@ Kubeflow Pipelines updates.

Note: Google Cloud, AWS, and IBM Cloud have supported Kubeflow Pipelines 1.0.0 with multi-user separation. Other platforms might not be up-to-date for now, refer to [this GitHub issue](https://github.com/kubeflow/manifests/issues/1364#issuecomment-668415871) for status.

Upgrade Support:
Refer to [the full Kubeflow section of upgrading Kubeflow Pipelines on Google Cloud](/docs/components/pipelines/operator-guides/installation/upgrade) guide.
Upgrade Support
:
Refer to [the full Kubeflow section of upgrading Kubeflow Pipelines on Google Cloud](/docs/gke/pipelines/upgrade/#full-kubeflow) guide.

Google Cloud Integrations:
* A Kubeflow Pipelines public endpoint with auth support is **autoconfigured** for you using [Cloud Identity-Aware Proxy](https://cloud.google.com/iap).
Google Cloud Integrations
:
* A Kubeflow Pipelines public endpoint with auth support is **auto-configured** for you using [Cloud Identity-Aware Proxy](https://cloud.google.com/iap).
* There's no current support for persisting your data in Google Cloud managed storage (Cloud SQL and Cloud Storage). Refer to [this GitHub issue](https://github.com/kubeflow/pipelines/issues/4356) for the latest status.
* You can authenticate to Google Cloud with Workload Identity.
* You can [authenticate to Google Cloud with Workload Identity](/docs/gke/pipelines/authentication-pipelines/#workload-identity).

Notes on specific features:
Notes on specific features
:
* After deployment, your Kubernetes cluster includes all the
[Kubeflow components](/docs/components/).
For example, you can use the Jupyter notebook services
Expand Down Expand Up @@ -161,30 +173,38 @@ Use this option to deploy Kubeflow Pipelines to Google Kubernetes Engine (GKE)
from Google Cloud Marketplace. You can deploy Kubeflow Pipelines to an existing or new
GKE cluster and manage your cluster within Google Cloud.

Installation guide: [Google Cloud AI Platform Pipelines documentation](https://cloud.google.com/ai-platform/pipelines/docs)
Installation guide
: [Google Cloud AI Platform Pipelines documentation](https://cloud.google.com/ai-platform/pipelines/docs)

Interfaces:
Interfaces
:
* Google Cloud Console for managing the Kubeflow Pipelines cluster and other Google Cloud
services
* Kubeflow Pipelines UI via the **Open Pipelines Dashboard** link in the
Google Cloud Console
* Kubeflow Pipelines SDK in Cloud Notebooks
* Kubeflow Pipelines endpoint of your instance is autoconfigured for you
* Kubeflow Pipelines endpoint of your instance is auto-configured for you

Release Schedule: AI Platform Pipelines is available for a chosen set of stable Kubeflow
Release Schedule
: AI Platform Pipelines is available for a chosen set of stable Kubeflow
Pipelines releases. You will receive updates slightly slower than Kubeflow
Pipelines Standalone.

Upgrade Support (**Alpha**): An in-place upgrade is not supported.
Upgrade Support (**Alpha**)
: An in-place upgrade is not supported.

Google Cloud Integrations:
To upgrade AI Platform Pipelines by reinstalling it (with existing data), refer to the [Upgrading AI Platform Pipelines](/docs/gke/pipelines/upgrade/#ai-platform-pipelines) guide.

Google Cloud Integrations
:
* You can deploy AI Platform Pipelines on [Cloud Console UI](https://console.cloud.google.com/marketplace/details/google-cloud-ai-platform/kubeflow-pipelines).
* A Kubeflow Pipelines public endpoint with auth support is **autoconfigured** for you.
* A Kubeflow Pipelines public endpoint with auth support is **auto-configured** for you.
* (Optional) You can choose to persist your data in Google Cloud managed storage services (Cloud SQL and Cloud Storage).
* You can authenticate to Google Cloud with the Compute Engine default service account. However, this method may not be suitable if you need workload permission separation.
* You can [authenticate to Google Cloud with the Compute Engine default service account](/docs/gke/pipelines/authentication-pipelines/#compute-engine-default-service-account). However, this method may not be suitable if you need workload permission separation.
* You can deploy AI Platform Pipelines on both public and private GKE clusters as long as the cluster [has sufficient resources for AI Platform Pipelines](https://cloud.google.com/ai-platform/pipelines/docs/configure-gke-cluster#ensure).

Notes on specific features:
Notes on specific features
:
* After deployment, your Kubernetes cluster contains Kubeflow Pipelines only.
It does not include the other Kubeflow components.
For example, to use a Jupyter Notebook, you can use [AI Platform
Expand Down
Loading

0 comments on commit 2bd812b

Please sign in to comment.