Python unit test specific variants from default or any varianter mechanism

[pevogam]

Hi all,

Is there a way to provide specific variant multiplications to specific unit tests? If we have a python file of two unit tests like:

from avocado import Test

class MyTest(Test):

    def test1(self):
        self.log('Testing something important')

    def test2(self):
        self.log('Testing something even more important')

then is it possible to define separate parameters and variants for test1 as opposed to test2? The way it seems to me right now, any variantis and parameters we apply here will multiply and end up with the same variant parameters for both test1 and test2 prompting the need to provide only one method, one class, and even one file per unit test. Is there even a way to provide separate variants for separate files? The command line seems to pick up variants and apply them for all files listed under avocado-run (or maybe I miss something in the way I use it).

I read through both

https://avocado-framework.readthedocs.io/en/latest/guides/writer/chapters/writing.html#running-multiple-variants-of-tests
https://avocado-framework.readthedocs.io/en/latest/guides/writer/chapters/parameters.html#test-parameter

but didn't find anything relevant to this.

[richtja]

Hi @pevogam one possibility would be to use Job API and create two suites. Like this:

#!/usr/bin/env python3

import sys

from avocado.core.job import Job
from avocado.core.suite import TestSuite

config_variant = {
    "resolver.references": ["../avocado/examples/tests/sleeptest.py:SleepTest.test"],
    "yaml_to_mux.files": ["../avocado/examples/tests/sleeptest.py.data/sleeptest.yaml"],
}

suite_variant = TestSuite.from_config(config_variant)
config = {
    "resolver.references": ["../avocado/examples/tests/sleeptest.py:SleepTest.test"],
}

suite = TestSuite.from_config(config)
with Job(config, [suite, suite_variant]) as j:
    sys.exit(j.run())

[pevogam]

Hi @richtja I can see that at least programmatically one can script each unit test as a variant like

#!/usr/bin/env python3

import sys

from avocado.core.job import Job
from avocado.core.suite import TestSuite

config_variant1 = {
    "resolver.references": ["../avocado/examples/tests/test.py:MyTest.test1"],
    "yaml_to_mux.files": ["../avocado/examples/tests/test.py.data/my_first_test_variants.yaml"],
}
suite_variant1 = TestSuite.from_config(config_variant1)

config_variant2 = {
    "resolver.references": ["../avocado/examples/tests/test.py:MyTest.test2"],
    "yaml_to_mux.files": ["../avocado/examples/tests/test.py.data/my_second_test_variants.yaml"],
}
suite_variant2 = TestSuite.from_config(config_variant2)

config_rest = {
    "resolver.references": ["../avocado/examples/tests/test.py:MyTest.test_else"],
}
suite_rest = TestSuite.from_config(config_rest)

with Job(config, [suite_variant1, suite_variant2, suite_rest]) as j:
    sys.exit(j.run())

but I guess there is no way to simply configure this in any way? I assume it is also not something we can do from the command line and needs scripting at best but I guess this is a more minor problem compared to the lack of configurability.