Skip to content

Commit

Permalink
Build docker images for fixing jindo cache performance issue, To #542…
Browse files Browse the repository at this point in the history
…50932 (fluid-cloudnative#4154)

Signed-off-by: cheyang <cheyang@163.com>

Bump up the vineyard to v0.22.2 (fluid-cloudnative#4153)

Signed-off-by: Ye Cao <caoye.cao@alibaba-inc.com>

Bump github.com/agiledragon/gomonkey/v2 from 2.10.1 to 2.11.0 (fluid-cloudnative#4151)

Bumps [github.com/agiledragon/gomonkey/v2](https://github.com/agiledragon/gomonkey) from 2.10.1 to 2.11.0.
- [Release notes](https://github.com/agiledragon/gomonkey/releases)
- [Commits](agiledragon/gomonkey@v2.10.1...v2.11.0)

---
updated-dependencies:
- dependency-name: github.com/agiledragon/gomonkey/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

date (fluid-cloudnative#4110)

Signed-off-by: Lumen002 <1277683286@qq.com>

Add apache license_format in fluid_ufs_scheme_test.go (fluid-cloudnative#4120)

* Format Apache License to webhook.go

Signed-off-by: mave <211220097@smail.nju.edu.cn>

* Your commit message

Signed-off-by: mave <211220097@smail.nju.edu.cn>

* format

Signed-off-by: mave <211220097@smail.nju.edu.cn>

* format_test

Signed-off-by: mave <211220097@smail.nju.edu.cn>

* format apache license

Signed-off-by: mave <211220097@smail.nju.edu.cn>

---------

Signed-off-by: mave <211220097@smail.nju.edu.cn>

111 (fluid-cloudnative#4121)

Signed-off-by: lianwg <1494923285@qq.com>

Bump golang.org/x/net from 0.25.0 to 0.26.0 (fluid-cloudnative#4156)

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.25.0 to 0.26.0.
- [Commits](golang/net@v0.25.0...v0.26.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

modified the incorrect copyright time in file pkg/ddc/efc/cache.go (fluid-cloudnative#4125)

Signed-off-by: hadoop <scanocdii@gmail.com>

--- (fluid-cloudnative#4123)

updated-dependencies:
- dependency-name: k8s.io/klog/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Build docker images for vineyard 0.22, To #54250932 (fluid-cloudnative#4159)

Signed-off-by: cheyang <cheyang@163.com>

Bump sigs.k8s.io/yaml from 1.3.0 to 1.4.0 (fluid-cloudnative#4157)

Bumps [sigs.k8s.io/yaml](https://github.com/kubernetes-sigs/yaml) from 1.3.0 to 1.4.0.
- [Release notes](https://github.com/kubernetes-sigs/yaml/releases)
- [Changelog](https://github.com/kubernetes-sigs/yaml/blob/master/RELEASE.md)
- [Commits](kubernetes-sigs/yaml@v1.3.0...v1.4.0)

---
updated-dependencies:
- dependency-name: sigs.k8s.io/yaml
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Fix typo of transformer, To #54583165 (fluid-cloudnative#4150)

Signed-off-by: cheyang <cheyang@163.com>

Build docker images for fixing transformers, To #54583162 (fluid-cloudnative#4161)

Signed-off-by: cheyang <cheyang@163.com>

change transfromer to transformers in load_data.go (fluid-cloudnative#4118)

* change transfromer to transformers

Signed-off-by: yayaaaaaaaaa <1435114933@qq.com>

* Update load_data.go

---------

Signed-off-by: yayaaaaaaaaa <1435114933@qq.com>
Co-authored-by: cheyang <cheyang@163.com>

addons: add dynamic mount examples (fluid-cloudnative#4148)

* Add base image for fluid dynamic mount feature

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Add juicefs examples for fluid dynamic mount feature

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* clean up mount point unconditionally

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Dump mount point logs to /var/log/fluid

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Anchor base image for dynamic mount example

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

change copyright year from 2022 to 2020 (fluid-cloudnative#4132)

Signed-off-by: FluorescenceLight <1219804366@qq.com>

bugfix: check corrupted mount point in utils.RemoveSymlink (fluid-cloudnative#4163)

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 (fluid-cloudnative#4158)

Bumps [github.com/spf13/cobra](https://github.com/spf13/cobra) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/spf13/cobra/releases)
- [Commits](spf13/cobra@v1.7.0...v1.8.0)

---
updated-dependencies:
- dependency-name: github.com/spf13/cobra
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

modify copyright time (fluid-cloudnative#4128)

Signed-off-by: liuyun-0002 <2695993128@qq.com>

change time from 2022 to 2020 (fluid-cloudnative#4134)

Signed-off-by: chxwindows <2216940643@qq.com>

changed the time of Copyright in the operation.go file to 2023 (fluid-cloudnative#4145)

Signed-off-by: sishijiang <2524798309@qq.com>

Bump go.uber.org/zap from 1.24.0 to 1.27.0 (fluid-cloudnative#3727)

Bumps [go.uber.org/zap](https://github.com/uber-go/zap) from 1.24.0 to 1.27.0.
- [Release notes](https://github.com/uber-go/zap/releases)
- [Changelog](https://github.com/uber-go/zap/blob/master/CHANGELOG.md)
- [Commits](uber-go/zap@v1.24.0...v1.27.0)

---
updated-dependencies:
- dependency-name: go.uber.org/zap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

refactor: rename `CreateUpdatePodForSchedulingHandler` to `FluidMutatingHandler` (fluid-cloudnative#4168)

* Refactor fluid mutating handler

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Refactor fluid mutating handler

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Refactor fluid mutating handler

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

minorfix: pin libfuse version in dynamic mount example (fluid-cloudnative#4167)

* pin libfuse version to fuse-3.16.2

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* minorfix: add return of line

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

Refactor admission webhook handler registration for better error handling and maintainability, To #57240825 (fluid-cloudnative#4170)

Signed-off-by: cheyang <cheyang@163.com>

Assign pod.namespace before mutation (fluid-cloudnative#4171)

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

minorfix: carefully handle pod.namespace to avoid side effect (fluid-cloudnative#4172)

* carefully handle pod.namespace

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* carefully handle pod.namespace

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* carefully handle pod.namespace

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

Build docker images for refactoring webhook, To #57240825 (fluid-cloudnative#4173)

Signed-off-by: cheyang <cheyang@163.com>

Bump github.com/stretchr/testify from 1.8.4 to 1.9.0 (fluid-cloudnative#4164)

Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.8.4 to 1.9.0.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](stretchr/testify@v1.8.4...v1.9.0)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

feat: support multiround sidecar injection (fluid-cloudnative#4175)

* Prune unused code

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* refactor: move func CollectRuntimeInfosFromPVCs to webhook utils package

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Support multi-round sidecar injection

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Support multi-round sidecar injection

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* fix unit tests

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* fix unit tests

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Add unit tests

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Add unit tests

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

description (简单描述你的修改) (fluid-cloudnative#4149)

Signed-off-by: bc-ace <2336474595@qq.com>

docs: Correcting the usage steps of the CONTABUTING.md document (fluid-cloudnative#4176)

Signed-off-by: wjp <wjp_199502@163.com>

move dataflow affinity logic to fluidapp controller (fluid-cloudnative#4138)

* use fluidapp to support data flow affinity

Signed-off-by: xliuqq <xlzq1992@gmail.com>

* make fluidapp dataop controller optional

Signed-off-by: xliuqq <xlzq1992@gmail.com>

* fix check

Signed-off-by: xliuqq <xlzq1992@gmail.com>

* add unit test for injectPodNodeLabelsToJob

Signed-off-by: xliuqq <xlzq1992@gmail.com>

* fix: use library.fluid.labels instead of fluid.io/managed-by

Signed-off-by: xliuqq <xlzq1992@gmail.com>

* fix comment error and reslove conflicts

Signed-off-by: xliuqq <xlzq1992@gmail.com>

* fix annotation nil error

Signed-off-by: xliuqq <xlzq1992@gmail.com>

* fix e2e test, serverless pod use serverless.fluid.io/inject and fluid.io/managed-by two labels

Signed-off-by: xliuqq <xlzq1992@gmail.com>

---------

Signed-off-by: xliuqq <xlzq1992@gmail.com>

Build docker images for refactoring dataflow controller, To #57240825 (fluid-cloudnative#4181)

Signed-off-by: cheyang <cheyang@163.com>

wjl (fluid-cloudnative#4039)

Signed-off-by: wjlwjlwjlwjlwjlwjlwjl <2931582547@qq.com>
Co-authored-by: cheyang <cheyang@163.com>

Bump github.com/spf13/cobra from 1.8.0 to 1.8.1 (fluid-cloudnative#4166)

Bumps [github.com/spf13/cobra](https://github.com/spf13/cobra) from 1.8.0 to 1.8.1.
- [Release notes](https://github.com/spf13/cobra/releases)
- [Commits](spf13/cobra@v1.8.0...v1.8.1)

---
updated-dependencies:
- dependency-name: github.com/spf13/cobra
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Update utils.go (fluid-cloudnative#4116)

addcopyright

Do not skip mutation for fluid pods (fluid-cloudnative#4184)

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

Bump github.com/felixge/fgprof from 0.9.3 to 0.9.4 (fluid-cloudnative#4169)

Bumps [github.com/felixge/fgprof](https://github.com/felixge/fgprof) from 0.9.3 to 0.9.4.
- [Release notes](https://github.com/felixge/fgprof/releases)
- [Commits](felixge/fgprof@v0.9.3...v0.9.4)

---
updated-dependencies:
- dependency-name: github.com/felixge/fgprof
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

bugfix: fix application controller manage pod lifecycle (fluid-cloudnative#4185)

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

Bump github.com/go-logr/logr from 1.4.1 to 1.4.2 (fluid-cloudnative#4174)

Bumps [github.com/go-logr/logr](https://github.com/go-logr/logr) from 1.4.1 to 1.4.2.
- [Release notes](https://github.com/go-logr/logr/releases)
- [Changelog](https://github.com/go-logr/logr/blob/master/CHANGELOG.md)
- [Commits](go-logr/logr@v1.4.1...v1.4.2)

---
updated-dependencies:
- dependency-name: github.com/go-logr/logr
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

cm1 (fluid-cloudnative#4114)

dataset add storageSize (fluid-cloudnative#4178)

Signed-off-by: wangshulei098 <850732903@qq.com>

Build docker images for specifying pvc storage size, To #54250932 (fluid-cloudnative#4187)

Signed-off-by: cheyang <cheyang@163.com>

docs: dev guide for en missing GOPATH setup (fluid-cloudnative#4188)

Signed-off-by: backspace <backspace@backblog.me>

Update operation_helm.go (fluid-cloudnative#4129)

* Update operation_helm.go

modify copyright time

* Update operation_helm.go

modify copyright time.

Signed-off-by: rodestexas <1985056713@qq.com>

---------

Signed-off-by: rodestexas <1985056713@qq.com>

Bump k8s.io/klog/v2 from 2.120.1 to 2.130.1 (fluid-cloudnative#4183)

Bumps [k8s.io/klog/v2](https://github.com/kubernetes/klog) from 2.120.1 to 2.130.1.
- [Release notes](https://github.com/kubernetes/klog/releases)
- [Changelog](https://github.com/kubernetes/klog/blob/main/RELEASE.md)
- [Commits](kubernetes/klog@v2.120.1...v2.130.1)

---
updated-dependencies:
- dependency-name: k8s.io/klog/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

bugfix: allow users to override juicefs attr-cache and entry-cache options (fluid-cloudnative#4194)

* bugfix: allow users override attr-cache and entry-cache in JuiceFS

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* go fmt

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

Bump google.golang.org/grpc from 1.64.0 to 1.65.0 (fluid-cloudnative#4191)

Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.64.0 to 1.65.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](grpc/grpc-go@v1.64.0...v1.65.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Update go.mod to comply with Go 1.21 toolchain syntax (fluid-cloudnative#4196)

* Update go mod to 1.21.10, To #57240825

Signed-off-by: cheyang <cheyang@163.com>

* Update go mod to 1.21.10, To #57240825

Signed-off-by: cheyang <cheyang@163.com>

---------

Signed-off-by: cheyang <cheyang@163.com>

Build docker images for fixing juicefs timeout, To #57240825 (fluid-cloudnative#4197)

Signed-off-by: cheyang <cheyang@163.com>

bugfix: fix early break when cleaning mount point in NodeUnpublishVolume (fluid-cloudnative#4198)

* Clean up corrupted mount points in NodeUnpublishVolume

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Clean up corrupted mount points in NodeUnpublishVolume

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

This pr is to add the translation of the Apache License notice (fluid-cloudnative#4078)

* Update thin.go

Signed-off-by: cheyang <cheyang@163.com>

* Update thin.go

Signed-off-by: cheyang <cheyang@163.com>

* Update thin.go license header, To #54250932

Signed-off-by: cheyang <cheyang@163.com>

* Update thin.go license header, To #54250932

Signed-off-by: cheyang <cheyang@163.com>

---------

Signed-off-by: cheyang <cheyang@163.com>
Co-authored-by: cheyang <cheyang@163.com>

Bump github.com/agiledragon/gomonkey/v2 from 2.11.0 to 2.12.0 (fluid-cloudnative#4199)

Bumps [github.com/agiledragon/gomonkey/v2](https://github.com/agiledragon/gomonkey) from 2.11.0 to 2.12.0.
- [Release notes](https://github.com/agiledragon/gomonkey/releases)
- [Commits](agiledragon/gomonkey@v2.11.0...v2.12.0)

---
updated-dependencies:
- dependency-name: github.com/agiledragon/gomonkey/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

bugfix: fix jindoruntime name cannot contain jindofs (fluid-cloudnative#4202)

* bugfix: JindoRuntime cannot use a name containing "jindofs"

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* todo: add todo for handling fullnameOverride

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

revert: "upgrade jindocache to 6.4.0 version (fluid-cloudnative#4126)" and downgrade JindoCache to 6.2.0 (fluid-cloudnative#4205)

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

Build docker images for reverting jindoruntime from 6.4 to 6.2, To #57978385 (fluid-cloudnative#4206)

Signed-off-by: cheyang <cheyang@163.com>

Bump golang.org/x/net from 0.26.0 to 0.27.0 (fluid-cloudnative#4200)

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.26.0 to 0.27.0.
- [Commits](golang/net@v0.26.0...v0.27.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Prepare 1.0.2, To #57978385 (fluid-cloudnative#4207)

Signed-off-by: cheyang <cheyang@163.com>

Delete the unused rbac roles for vineyard runtime. (fluid-cloudnative#4208)

Signed-off-by: Ye Cao <caoye.cao@alibaba-inc.com>

Update docker image to fluid 1.0.2, To #54250932 (fluid-cloudnative#4210)

Signed-off-by: cheyang <cheyang@163.com>

Bump github.com/golang/glog from 1.2.1 to 1.2.2 (fluid-cloudnative#4204)

Bumps [github.com/golang/glog](https://github.com/golang/glog) from 1.2.1 to 1.2.2.
- [Release notes](https://github.com/golang/glog/releases)
- [Commits](golang/glog@v1.2.1...v1.2.2)

---
updated-dependencies:
- dependency-name: github.com/golang/glog
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

bugfix: support sync ak/sk secret key-values in JindoRuntime (fluid-cloudnative#4212)

* bugfix: support sync ak/sk secret key-values in JindoRuntime

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Update CHANGELOG.md

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

del create pod role of juicefs runtime (fluid-cloudnative#4215)

Signed-off-by: zwwhdls <zww@hdls.me>

refactor: separate image and tag in helm values (fluid-cloudnative#4216)

* Separate images in values.yaml into repo, image and tag

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Separate images in values.yaml into imagePrefix, imageName and imageTag

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* refactor: transform control plane images with helper function

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* refactor: transform runtime images with helper function

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

Refactor fluid helm chart, To #54583162 (fluid-cloudnative#4218)

Signed-off-by: cheyang <cheyang@163.com>

Add no cache option to Makefile, To #54583162 (fluid-cloudnative#4217)

Signed-off-by: cheyang <cheyang@163.com>

update scorecard link (fluid-cloudnative#4220)

Signed-off-by: fsl <1171313930@qq.com>

feat: pass extra args when building fuse sidecar mutators (fluid-cloudnative#4223)

* Rename `MutatorBuildOpts` to `MutatorBuildArgs`

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Pass extraArgs when building platform-specific mutators

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Add unit tests

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Add unit tests

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

enhance: add github actions workflow e2e tests (fluid-cloudnative#4224)

* Add integration.yml

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Add github actions e2e for alluxio

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Add testcase for juicefsruntime & jindoruntime

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Gracefully clean up resources

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Dump e2e environment info with diagnose scripts and upload it to github action artifacts

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Rename github actions workflow names

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Purge out-of-date testcases

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

minorfix: set read-all permission for e2e functionality check workflow (fluid-cloudnative#4226)

* Minorfix: set read-all permission for e2e functionality check workflow

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Add empty line EOF

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

bugfix: fix kind e2e test images (fluid-cloudnative#4232)

* Fix version replace in gha-e2e

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Optimize diagnose shell scripts

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

fix Variable Naming Convention for DEFAULT_MASTER_RPC_PORT in CamelCase (fluid-cloudnative#4234)

* Change Constant Variable Naming Convention for DEFAULT_MASTER_RPC_PORT in camelCase format defined in pkg/ddc/jindo/const.go and its reference in /pkg/ddc/jindo/transform.go

Signed-off-by: SouthWest7 <1403572259@qq.com>

* Change Constant Variable Naming Convention for DEFAULT_MASTER_RPC_PORT in camelCase format defined in pkg/ddc/jindo/const.go and its reference in /pkg/ddc/jindo/transform.go

Signed-off-by: SouthWest7 <1403572259@qq.com>

* Change Constant Variable Naming Convention for DEFAULT_MASTER_RPC_PORT in camelCase format defined in pkg/ddc/jindo/const.go and its reference in /pkg/ddc/jindo/transform.go

Signed-off-by: SouthWest7 <1403572259@qq.com>

* Change Constant Variable Naming Convention for DEFAULT_MASTER_RPC_PORT in camelCase format defined in pkg/ddc/jindo/const.go and its reference in /pkg/ddc/jindo/transform.go

Signed-off-by: SouthWest7 <1403572259@qq.com>

---------

Signed-off-by: SouthWest7 <1403572259@qq.com>

Change Constant Variable Naming Convention for CSI_DRIVER in camelCase format (fluid-cloudnative#4229)

* Update const.go

* Update const.go

bugfix: fix version replace in gha-e2e (fluid-cloudnative#4235)

* Fix version replace in gha-e2e

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

* Fix version replace in gha-e2e

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

---------

Signed-off-by: trafalgarzzz <trafalgarz@outlook.com>

Update docker images for refactoring sidecar mutator (fluid-cloudnative#4230)

* Update docker images for refactoring sidecar mutator, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

* Update docker images for refactoring sidecar mutator, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

* Update docker images for refactoring sidecar mutator, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

---------

Signed-off-by: cheyang <cheyang@163.com>

juicefs: use exec in juicefs pod to avoid ignore signal (fluid-cloudnative#4236)

* feat: use exec in juicefs pod to avoid ignore signal

Signed-off-by: zwwhdls <zww@hdls.me>

* feat: use exec in juicefs pod to avoid ignore signal

Signed-off-by: zwwhdls <zww@hdls.me>

* fix unittest

Signed-off-by: zwwhdls <zww@hdls.me>

---------

Signed-off-by: zwwhdls <zww@hdls.me>

update juicefs default imaghe (fluid-cloudnative#4237)

Signed-off-by: zwwhdls <zww@hdls.me>

Bump ossf/scorecard-action from 2.3.3 to 2.4.0 (fluid-cloudnative#4239)

Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action) from 2.3.3 to 2.4.0.
- [Release notes](https://github.com/ossf/scorecard-action/releases)
- [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md)
- [Commits](ossf/scorecard-action@dc50aa9...62b2cac)

---
updated-dependencies:
- dependency-name: ossf/scorecard-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Update controller-runtime to v1.17.5, To #57240825

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #55315018

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Update controller-runtime to v1.17.5, To #57240825

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Update controller-runtime to v1.17.5, To #57240825

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Refactoring the client cache mode, To #54583162

Signed-off-by: cheyang <cheyang@163.com>

Fix compiling issue, To #57978385

Signed-off-by: cheyang <cheyang@163.com>
  • Loading branch information
cheyang committed Aug 12, 2024
1 parent bf4b56a commit 923ae4c
Show file tree
Hide file tree
Showing 512 changed files with 47,817 additions and 54,973 deletions.
2 changes: 1 addition & 1 deletion .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ jobs:
build:
docker:
# specify the version
- image: cimg/go:1.21.8
- image: cimg/go:1.21.10
working_directory: ~/project/src/github.com/fluid-cloudnative/fluid
environment:
TEST_FLAGS: '-race -coverprofile=coverage.txt -covermode=atomic'
Expand Down
54 changes: 54 additions & 0 deletions .github/scripts/build-all-images.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
#!/bin/bash
set -e

function get_image_tag() {
version=$(grep "^VERSION=" ./Makefile)
version=${version#VERSION=}

git_sha=$(git rev-parse --short HEAD || echo "HEAD")
export IMAGE_TAG=${version}-${git_sha}
}

function build_images() {
images=(
${IMG_REPO}/dataset-controller:${IMAGE_TAG}
${IMG_REPO}/application-controller:${IMAGE_TAG}
${IMG_REPO}/alluxioruntime-controller:${IMAGE_TAG}
${IMG_REPO}/jindoruntime-controller:${IMAGE_TAG}
${IMG_REPO}/goosefsruntime-controller:${IMAGE_TAG}
${IMG_REPO}/juicefsruntime-controller:${IMAGE_TAG}
${IMG_REPO}/thinruntime-controller:${IMAGE_TAG}
${IMG_REPO}/efcruntime-controller:${IMAGE_TAG}
${IMG_REPO}/vineyardruntime-controller:${IMAGE_TAG}
${IMG_REPO}/fluid-csi:${IMAGE_TAG}
${IMG_REPO}/fluid-webhook:${IMAGE_TAG}
${IMG_REPO}/fluid-crd-upgrader:${IMAGE_TAG}
)

make docker-build-all

for img in ${images[@]}; do
echo "Loading image $img to kind cluster..."
kind load docker-image $img --name ${KIND_CLUSTER}
done
}

function cleanup_docker_caches() {
echo ">>> System disk usage after building fluid images"
df -h
echo ">>> Cleaning docker caches..."
docker system df
docker ps
docker container prune -f
docker images
docker image prune -a -f
docker builder prune -a -f
docker buildx prune -a -f
echo ">>> docker caches cleaned up"
echo ">>> System disk usage after cleaning up docker caches"
df -h
}

get_image_tag
build_images
cleanup_docker_caches
29 changes: 29 additions & 0 deletions .github/scripts/deploy-fluid-to-kind.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
#!/bin/bash
set -e

function get_image_tag() {
version=$(grep "^VERSION=" ./Makefile)
version=${version#VERSION=}

git_sha=$(git rev-parse --short HEAD || echo "HEAD")
export IMAGE_TAG=${version}-${git_sha}
}

function deploy_fluid() {
echo "Replacing image tags in values.yaml with $IMAGE_TAG"
sed -i -E "s/version: &defaultVersion v[0-9]\.[0-9]\.[0-9]-[a-z0-9]+$/version: \&defaultVersion $IMAGE_TAG/g" charts/fluid/fluid/values.yaml
kubectl create ns fluid-system
helm install --create-namespace --set runtime.jindo.smartdata.imagePrefix=registry.cn-hongkong.aliyuncs.com/jindofs --set runtime.jindo.fuse.imagePrefix=registry.cn-hongkong.aliyuncs.com/jindofs fluid charts/fluid/fluid
}

function main() {
get_image_tag
if [[ -z "$IMAGE_TAG" ]];then
echo "Failed to get image tag, exiting..."
exit 1
fi

deploy_fluid
}

main
40 changes: 40 additions & 0 deletions .github/scripts/gha-e2e.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
#!/bin/bash

function syslog() {
echo ">>> $1"
}

function check_control_plane_status() {
while true; do
total_pods=$(kubectl get pod -n fluid-system --no-headers | grep -cv "Completed")
running_pods=$(kubectl get pod -n fluid-system --no-headers | grep -c "Running")

if [[ $total_pods -ne 0 ]]; then
if [[ $total_pods -eq $running_pods ]]; then
break
fi
fi
sleep 5
done
syslog "Fluid control plane is ready!"
}

function alluxio_e2e() {
set -e
bash test/gha-e2e/alluxio/test.sh
}

function jindo_e2e() {
set -e
bash test/gha-e2e/jindo/test.sh
}

function juicefs_e2e() {
set -e
bash test/gha-e2e/juicefs/test.sh
}

check_control_plane_status
alluxio_e2e
jindo_e2e
juicefs_e2e
81 changes: 81 additions & 0 deletions .github/workflows/kind-e2e.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,81 @@
name: E2E Functionality Check
on:
pull_request:
branches: [ master, release-* ]
paths-ignore:
- 'docs/**'
- 'addons/**'
- 'sdk/**'
- 'static/**'

# Declare default permissions as read only.
permissions: read-all

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true

env:
GO_VERSION: 1.21.10

jobs:
kind-e2e-test:
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
kubernetes-version: ["v1.29.2", "v1.28.7", "v1.26.15", "v1.24.17", "v1.22.17"]
env:
GOPATH: ${{ github.workspace }}
GO111MODULE: auto
KIND_CLUSTER: fluid-cluster
defaults:
run:
working-directory: ${{ env.GOPATH }}/src/github.com/fluid-cloudnative/fluid

steps:
- name: Set up Go
uses: actions/setup-go@v5
with:
go-version: ${{ env.GO_VERSION }}

- name: Set up Helm
uses: azure/setup-helm@v4.2.0

- name: Checkout code
uses: actions/checkout@v4
with:
path: ${{ env.GOPATH }}/src/github.com/fluid-cloudnative/fluid

- name: Create k8s Kind Cluster
uses: helm/kind-action@v1.10.0
with:
node_image: kindest/node:${{ matrix.kubernetes-version }}
cluster_name: ${{ env.KIND_CLUSTER }}
kubectl_version: ${{ matrix.kubernetes-version }}

- name: Build fluid docker images
env:
IMG_REPO: fluidcloudnative
run: |
echo ">>> System disk usage before build fluid images"
df -h
./.github/scripts/build-all-images.sh
- name: Deploy fluid to Kind cluster
run: |
./.github/scripts/deploy-fluid-to-kind.sh
- name: Fluid basic e2e tests
timeout-minutes: 30
run: |
./.github/scripts/gha-e2e.sh
- name: Dump environment
if: ${{ !cancelled() }}
uses: actions/upload-artifact@v4
with:
name: gha-e2e-logs-${{ github.job }}-${{ matrix.kubernetes-version }}
path: "src/github.com/fluid-cloudnative/fluid/e2e-tmp/testcase-*.tgz"
retention-days: 14

Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
name: Github Actions
name: Project Check

on:
push:
Expand All @@ -7,7 +7,7 @@ on:
branches: [ master, release-* ]

env:
GO_VERSION: 1.21
GO_VERSION: 1.21.10

# Declare default permissions as read only.
permissions: read-all
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/sonarcloud.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ jobs:
persist-credentials: false

- name: "Run analysis"
uses: ossf/scorecard-action@dc50aa9510b46c811795eb24b2f1ba02a914e534 # v2.3.3
uses: ossf/scorecard-action@62b2cac7ed8198b15735ed49ab1e5cf35480ba46 # v2.4.0
with:
results_file: results.sarif
results_format: sarif
Expand Down
2 changes: 1 addition & 1 deletion .travis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ matrix:
include:
- language: go
go:
- "1.21"
- "1.21.10"
os:
- linux
go_import_path: github.com/fluid-cloudnative/fluid
Expand Down
2 changes: 1 addition & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,13 +49,13 @@ We assume you've got a Github ID. If then, all you need to do can be summarized

3. **Set remote upstream**
```shell
cd fluid
git remote add upstream https://github.com/fluid-cloudnative/fluid.git
git remote set-url --push upstream no-pushing
```

4. **Update local working directory**
```shell
cd fluid
git fetch upstream
git checkout master
git rebase upstream/master
Expand Down
Loading

0 comments on commit 923ae4c

Please sign in to comment.