Added dockerhub build-variants. Added by.hash (we have by.branch, by.…

…tag, by.hash now) (#258)

* Added dockerhub build-variants. Added by.hash (we have by.branch, by.tag, by.hash now)

* fixes per flake linter

* Updated poetry lock

* Running on tox on PR in gh

* tox 5.0.0 and docker >= 7

* Fixed utils/tests/test_builder.py::test_commit_schema_to_stream_then_build

* Fixed utils/tests/test_builder.py:76: AssertionError

* Fixed poetry lock

* Added dockerhub E2E triggering/tests

* Running dockerhub tests by default on CI

* Ensuring we have small CPU count requests for CI

* Fixed prefetch image test

* Include a way of triggering dockerhub run

* Add airgap option to cli docker triggering

.github/workflows/tox.yml

@@ -0,0 +1,48 @@
+name: Run Tests using tox
+on:
+  pull_request:
+  push:
+    branches:
+      - master
+      - main
+
+jobs:
+  pytest:
+    strategy:
+      matrix:
+        python-version: [ '3.10', '3.11', '3.12' ]
+      fail-fast: false
+    env:
+      ACTIONS_ALLOW_UNSECURE_COMMANDS: true
+      USING_COVERAGE: "3.10"
+      USING_COVERAGE_OS: "ubuntu-latest"
+
+    runs-on: "ubuntu-latest"
+    name: os ${{ matrix.os }} python ${{ matrix.python-version }} Linting, testing, and compliance
+    steps:
+    - uses: actions/checkout@master
+
+    - name: Set up Python ${{ matrix.python-version }}
+      uses: actions/setup-python@v1
+      with:
+        python-version: ${{ matrix.python-version }}
+
+    - name: Install Poetry
+      run: |
+        curl -sSL https://install.python-poetry.org | python3 -
+
+    - name: Install Dev requirements
+      run: |
+        pip install -U setuptools wheel
+        pip install -r dev_requirements.txt
+
+    - name: Run tox
+      run: |
+        tox
+
+    - name: Upload coverage to Codecov
+      uses: codecov/codecov-action@v2
+      if: contains(env.USING_COVERAGE, matrix.python-version)
+      with:
+        token: ${{secrets.CODECOV_TOKEN}}
+        fail_ci_if_error: true

Readme.md

@@ -389,6 +389,12 @@ To run a specific test:
 $ tox -- utils/tests/test_runner.py
 ```
 
+To run a specific test with verbose logging:
+
+```sh
+$ tox -- -vv --log-cli-level=INFO utils/tests/test_runner.py
+```
+
 ## License
 
 redis-benchmarks-specification is distributed under the BSD3 license - see [LICENSE](LICENSE)

dev_requirements.txt

@@ -1,17 +1,18 @@
-click==8.0.4
-black==22.3.0
-flake8==4.0.1
+click==8.1.7
+black==24.4.2
+flake8==7.1.0
 flynt~=0.69.0
 isort==5.10.1
 mock==4.0.3
 packaging>=20.4
-pytest==7.2.0
-pytest-timeout==2.0.1
-pytest-asyncio>=0.16.0
-tox==3.24.4
-tox-docker==4.0.0a2
-invoke==1.6.0
-pytest-cov>=3.0.0
+pytest==8.2.2
+pytest-timeout==2.3.1
+pytest-asyncio>=0.23.7
+tox>=4.16.0
+tox-docker>=5.0.0
+invoke==2.2.0
+pytest-cov>=5.0.0
 vulture>=2.3.0
 ujson>=4.2.0
-wheel>=0.30.0
+wheel>=0.43.0
+docker>=7.1.0