Skip to content

Commit

Permalink
Copy documentation over from kuttl.dev repo to kuttl (#490)
Browse files Browse the repository at this point in the history
* Docs copied verbatim from kudo.dev repo.
* Point to docs in the repo rather than the website.
* Point to CONTRIBUTING.md using a relative path.
* Re-style warnings.
* Re-style flags
* Document label-constrained lists.
* Drop [[toc]] until we find a better way.
GitHub automatically generates a ToC that seems to be hidden by default, but is
accessible using the "dotted hamburger" icon in upper right-hand corner. See
https://docs.github.com/en/get-started/writing-on-github/getting-started-with-writing-and-formatting-on-github/basic-writing-and-formatting-syntax#headings

These additionally contain the changes from
kudobuilder/kuttl.dev@e1979f4
which document a feature already merged in kuttl `main`.

Signed-off-by: Marcin Owsiany <porridge@redhat.com>
  • Loading branch information
porridge authored Feb 8, 2024
1 parent c735bec commit 6ca6a62
Show file tree
Hide file tree
Showing 12 changed files with 1,163 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ KUTTL is designed for testing operators, however it can declaratively test any k

## Getting Started

Please refer to the [getting started guide](https://kuttl.dev/docs/) documentation.
Please refer to the [getting started guide](docs/README.md) documentation.

## Resources

Expand All @@ -36,7 +36,7 @@ Learn more on how to engage with the KUDO community on the [community page](http

## Contributions

Please read the [contributing guide](https://github.com/kudobuilder/kuttl/blob/main/CONTRIBUTING.md) for details around:
Please read the [contributing guide](CONTRIBUTING.md) for details around:

1. Code of Conduct
1. Code Culture
Expand Down
24 changes: 24 additions & 0 deletions docs/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
# Getting Started

## Pre-requisites

Before you get started using KUTTL, you need to have a running Kubernetes cluster setup. If you already have a cluster there are no prerequisites. If you want to use the mocked control plane or Kind, you will need [Kind](https://github.com/kubernetes-sigs/kind).

- Setup a Kubernetes Cluster in version `1.13` or later
- Install [kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl/) in version `1.13` or later.

## Install KUTTL CLI

Install the `kubectl kuttl` plugin. To do so, please follow the [CLI plugin installation instructions](cli.md).

The KUTTL CLI leverages the kubectl plugin system, which gives you all its functionality under `kubectl kuttl`.

## Using KUTTL

Once you have a running cluster with `kubectl` installed along with the KUTTL CLI plugin, you can run tests with KUTTL like so:

```bash
$ kubectl kuttl test path/to/test-suite
```

[Learn more](what-is-kuttl.md) about KUTTL and check out how to get started with the [KUTTL test harness](kuttl-test-harness.md).
53 changes: 53 additions & 0 deletions docs/api-integration.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
# API Integration

It is possible to integrate KUTTL into your own Go test infrastructure. KUDO provides as an example `kubectl kudo test` using the KUTTL test harness. The following are the necessary steps.

## Add KUTTL to Go.mod

`go get github.com/kudobuilder/kuttl`

or get a specific version

`go get github.com/kudobuilder/kuttl@v0.1.0`

## Common Imports to Use

The test harness type is defined in an `apis` package similar to a Kubernetes type along with a version package. The test harness is currently `v1beta1` and provides the main configuration for a test suite.

The `test` package contains the `test.Harness` implementation (given the configuration of the test harness configuration type previously mentioned). The `test.Harness` provides the "run" of the test run and needs a Go `t *testing.T`.

The `testutils` package contains utilities for docker, kubernetes, loggers and testing.

```go
import (
harness "github.com/kudobuilder/kuttl/pkg/apis/testharness/v1beta1"
"github.com/kudobuilder/kuttl/pkg/test"
testutils "github.com/kudobuilder/kuttl/pkg/test/utils"
)
```

## Test Harness

The `harness.TestSuite` is the structure that controls how the test harness will run.

```go
options := harness.TestSuite{}
```

The Go `t *testing.T` and `harness.TestSuite` are provided to `test.Harness` which provides the implementation for testing.

```go
Run: func(cmd *cobra.Command, args []string) {
testutils.RunTests("kudo", testToRun, options.Parallel, func(t *testing.T) {
harness := test.Harness{
TestSuite: options,
T: t,
}

harness.Run()
})
},

```

A more complete example is provided in KUDOs [cmd/test.go](https://github.com/kudobuilder/kudo/blob/master/pkg/kudoctl/cmd/test.go)
151 changes: 151 additions & 0 deletions docs/cli.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,151 @@
# CLI Usage

This document demonstrates how to use the KUTTL CLI

## Setup the KUTTL Kubectl Plugin

### Requirements

- `kubectl` version `1.13.0` or newer

### Installation

You can either download CLI binaries for linux or MacOS from our [release page](https://github.com/kudobuilder/kuttl/releases), or install the CLI plugin using `brew`:

```bash
brew tap kudobuilder/tap
brew install kuttl-cli
```

or you can compile and install the plugin from your `$GOPATH/src/github.com/kudobuilder/kuttl` root folder via:

```bash
make cli-install
```

Another alternative is [`krew`](https://github.com/kubernetes-sigs/krew), the package manager for kubectl plugins.

```bash
kubectl krew install kuttl
```

## Commands

* **`kubectl kuttl help [command] [flags]`**

Provide general help or help on a specific command

* **`kubectl kuttl version`**

Print the current KUTTL version.

* **`kubectl kuttl test`**

Run KUTTL test harness.


## Flags

> [!NOTE]
> **Usage**
>
> `kubectl kuttl test <name> [flags]`
Flags are:

* **`-h, --help`**

Help for test

* **`--artifacts-dir (string)`**

Directory to output kind logs to (if not specified, the current working directory).

* **`--config (string)`**

Path to file to load test settings from. This is usually the `kuttl-test.yaml` file.

* **`--crd-dir (string)`**

Directory to load CustomResourceDefinitions from prior to running the tests.

* **`--kind-config (string)`**

Specify the KIND configuration file path (implies `--start-kind`, cannot be used with `--start-control-plane`).

* **`--kind-context (string)`**

Specify the KIND context name to use (default: `kind`).

* **`--manifest-dir (stringArray)`**

One or more directories containing manifests to apply before running the tests.

* **`--parallel (int)`**

The maximum number of tests to run at once. (default `8`)

* **`--skip-cluster-delete (bool)`**

If set, do not delete the mocked control plane or kind cluster.

* **`--skip-delete (bool)`**

If set, do not delete resources created during tests (helpful for debugging test failures, implies `--skip-cluster-delete`).

* **`--start-control-plane (bool)`**

Start a local Kubernetes control plane for the tests (requires `etcd` and `kube-apiserver` binaries, cannot be used with `--start-kind`).

* **`--start-kind (bool)`**

Start a KIND cluster for the tests (cannot be used with `--start-control-plane`).

* **`--test (string)`**

If set, the specific test case to run.

* **`--test-run-labels (string)`**

Optional label set to associate with this test run.
This label set can then be matched against by the `testRunSelector` in `TestFile` objects to optionally exclude selected files.
The syntax is comma-separated list of `key=value` assignments.

* **`-v or -vv (int)`**
Logging verbosity level. 0=normal, 1=verbose, 2=detailed, 3 or more =trace.



## Examples

### KUTTL Test

KUTTL test command is the heart of the test harness. It requires a `kuttl-test.yaml` which defines the test setup.

```yaml
apiVersion: kuttl.dev/v1beta1
kind: TestSuite
testDirs:
- ./test/integration
parallel: 4
```
The default can be run as follows:
```bash
kubectl kuttl test pkg/test/test_data/
```

When running with no defined [test environment](testing/test-environments.md), the default is a preconfigured cluster defined in `$KUBECONFIG`.

To run with the mocked control plane run:

```bash
kubectl kuttl test --start-control-plane pkg/test/test_data/
```

In order to run with the full kind cluster stack, run:

```bash
kubectl kuttl test --start-kind pkg/test/test_data/
```
38 changes: 38 additions & 0 deletions docs/contributing.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
---
title: Contributing
type: docs
menu: docs
---

# Contributing

The source code for [KUTTL](https://github.com/kudobuilder/kuttl) lives on GitHub. We welcome feature requests and bug reports in the form of [issues](https://help.github.com/en/articles/about-issues), and of course code - which includes documentation! - in the form of [pull requests](https://help.github.com/en/articles/about-pull-requests) (PRs).

There's a ton of stuff to do and there's opportunities to contribute in a variety of ways. We'd suggest that newcomers look at issues tagged with ['good first issue'](https://github.com/kudobuilder/kuttl/issues?q=is%3Aissue+is%3Aopen+label%3A%22good+first+issue%22) and ['help wanted'](https://github.com/kudobuilder/kuttl/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) and then then jump into [#kudo on the Kubernetes Slack](https://kubernetes.slack.com/messages/kudo/) to discuss (join Kubernetes slack via [self-invitation link](https://slack.k8s.io/) if you don't have an account yet). KUTTL is now separate from KUDO, however we currently plan to use the same communication channels.

Please also take some time to read our [Contributing Guidelines](https://github.com/kudobuilder/kuttl/blob/master/CONTRIBUTING.md).

## Raising an Issue

If you've hit a bug, have an idea for a new feature, or want to suggest some other kind of change then we welcome an issue detailing your problem or your suggestion. Ideally we'd ask that people reach out in the Slack channel and join one of our weekly meetings so that other developers and users can help iterate.

## Creating a Pull Request

Yes please! Bring us your code! There's a whole lot of work to do, and we're committed to building an active community around KUTTL in order to ensure its longevity.

PRs raised against either repo have a default template which help guide contributors to focus on the details necessary for a speedy review. Again, please follow-up with discussion in the Slack channel. We're also happy for people to submit draft PRs which can then be worked through with other members of the KUDO/KUTTL community.

## Reviewing a Pull Request

This process is adapted from the one defined for [contributing to Kubernetes](https://kubernetes.io/docs/contribute/intermediate/#review-a-pr) itself, so should be familiar.

* Examine the PR description and read any associated issues or links for context;
* Look over all changed files, and if you have a comment or a question on any highlighted section then start a review;
* Continue to add comments using this review process and when you've finished, choose either 'comment' for general commentary or 'request changes' for anything you deem important enough to warrant further work;
* If you spot a relatively trivial error such as a typo or something that's not directly related to the stated purpose of the PR then you can let the submitter know by prefixing your review comment with `nit:`. These are not necessarily blockers to the PR itself but it gives the author an opportunity to make amendments;
* If you think the PR is ready to be merged, then you can add the command `/approve` to your summary comment. Note that only those listed in the approvers section of the [OWNERS](https://github.com/kudobuilder/kudo/blob/master/OWNERS) file can use this command;
* PRs can be assigned to an individual with the `/assign` command. If you think a proposed change needs a specific person's input, use this command along with their GitHub username to get their attention;
* If a PR has the `lgtm` and / or the `approve` label then it will be merged automatically;
* You can apply the `do-not-merge/hold` label in order to stop PRs from being merged automatically.

Typically, a PR needs a review and an approval from two [core developers](https://github.com/orgs/kudobuilder/people) in order to be merged.
Loading

0 comments on commit 6ca6a62

Please sign in to comment.