How to choose an Android and iOS emulator to run Flutter integration tests?

[mregnauld]

Hello,

In my codemagic.yaml file, I would like to run my integration tests for my Flutter app using the following scripts, following the documentation:

workflows:
  tests-workflow:
    name: Tests Workflow
    max_build_duration: 60
    instance_type: mac_mini
    environment:
      flutter: stable
      xcode: latest
      cocoapods: 1.9.1
    scripts:
      - name: Integration tests Android
        script: |
          flutter emulators --launch emulator &
          adb wait-for-device
          flutter -d emulator-5554 test --machine > test-results/flutter.json integration_test --flavor free
        test_report: test-results/flutter.json
      - name: Integration tests iOS
        script: |
          flutter emulators --launch apple_ios_simulator
          flutter -d iPhone test --machine > test-results/flutter.json integration_test --flavor free
        test_report: test-results/flutter.json

Is it possible to choose which Android emulator and which iOS emulator to run?

Thanks.

[himesh-cm]

Hi @mregnauld, for iOS, you can find the documentation here under the iOS tab.

[mregnauld]

Great! Thanks!

That being said, how can I know which emulators are available?

For example, I tried the following command on my machine:

xcrun simctl create test-device com.apple.CoreSimulator.SimDeviceType.iPhone-11 com.apple.CoreSimulator.SimRuntime.iOS-15-0

And I got the error: Invalid runtime: com.apple.CoreSimulator.SimRuntime.iOS-15-0

Then I tried (I just changed iOS 15.0 to 15.5):

xcrun simctl create test-device com.apple.CoreSimulator.SimDeviceType.iPhone-11 com.apple.CoreSimulator.SimRuntime.iOS-15-5

And I got the following (so I guess it worked here): FA6F56A4-4878-41BD-B85D-C8E34D33A3AB

So I assume that the script mentioned in the documentation works only if the desired emulator is available.

So how can I know which emulators are available?
Or is it better practice to use a third party service like Firebase Test Lab or emulator.wtf?

[himesh-cm]

Hi @mregnauld, there is a command line tool xcrun
more info on the list of available commands here
Regarding android, you can run tests with emulators on mac pro / Linux instances; the available emulator is
Device: pixel_3a (Google)
you can find the details here
We have documentation for both firebase test lab & emulator.wtf.

[mregnauld]

Great! I'll take a look at that, thanks!

[himesh-cm]

Also, it depends on your requirements when it comes to using emulators on Codemagic vs. some external services.

If you are looking for a wider selection of devices to test then external services would make more sense.