Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure autofill nightly tests succeed #5092

Conversation

CDRussell
Copy link
Member

@CDRussell CDRussell commented Oct 2, 2024

Task/Issue URL: https://app.asana.com/0/608920331025315/1208459234138716/f

Description

Autofill nightlies are failing because as of #5007, we require a more modern WebView than is available in Maestro Cloud emulators.

This PR:

  • fixes one of the ways the tests fail, by ensuring the warning banner in password management screen doesn't upset the tests
  • stops running the test which tests actual WebView autofill as part of the nightly (won't be possible to run this on CI until either Maestro Cloud ships their emulators with a decent WebView version, or we run the tests on different infrastructure)
  • adds some scrollUntilVisible to help add resilience to the tests running on smaller devices or when there are extra warning/promo banners above the items we want to tap on

Steps to test this PR

Copy link
Member Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @CDRussell and the rest of your teammates on Graphite Graphite

@@ -1,9 +1,9 @@
appId: com.duckduckgo.mobile.android
name: "Autofill: Prompted to save and update credentials on web form"
tags:
- autofillNoAuthTests
- autofillNoAuthTestsModernWebView
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changing this to prevent it from running during autofill nightlies (since Maestro Cloud emulators don't come with a modern WebView version, we can't test for actual autofill in the WebView)

Copy link
Contributor

@cmonfortep cmonfortep Oct 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As a follow-up, do you think makes sense to skip our capabilities checks (in maestro) and run it anyways? it should work there

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think I understand; if the capability checks are telling us it won't run, why would we try it in the UI test?

@CDRussell CDRussell marked this pull request as ready for review October 2, 2024 16:39
@CDRussell CDRussell merged commit 6c0eae8 into develop Oct 2, 2024
11 checks passed
@CDRussell CDRussell deleted the feature/craig/fix/craig/ensure_autofill_nightly_tests_succeed branch October 2, 2024 17:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants