AdevintaSpain / AdevintaSpain/Barista

Failing UI tests on API 31

Aberta
#456 0 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
Kotlin
Estrelas
1.7k
Forks
119
Métricas de merge de PRs
Nenhum PR com merge em 30d

Descrição


**Describe the Bug:**
There are failing UI tests on API 31 on CI workflow runs. It seems to be flaky on CI environment and could be related to material components as per the test case failures.

Tests that are failing:

```
> Task :sample:connectedDebugAndroidTest

com.adevinta.android.barista.sample.ClickTest > checkClickWhenParentIsNotAnScrollView_byText[test(AVD) - 12] FAILED
com.adevinta.android.barista.internal.failurehandler.BaristaException: No view matching ((an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Hi! I'm the second screen!" or (view.getParent() is assignable from class and (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Hi! I'm the second screen!")))) was found
at com.adevinta.android.barista.internal.failurehandler.SpyFailureHandler.resendFirstError(SpyFailureHandler.kt:25)

com.adevinta.android.barista.sample.ClickTest > checkClick_byStringResource[test(AVD) - 12] FAILED
com.adevinta.android.barista.internal.failurehandler.BaristaException: No view matching ((an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Hi! I'm the second screen!" or (view.getParent() is assignable from class and (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Hi! I'm the second screen!")))) was found
at com.adevinta.android.barista.internal.failurehandler.SpyFailureHandler.resendFirstError(SpyFailureHandler.kt:25)

com.adevinta.android.barista.sample.ClickTest > checkClickWhenParentIsNotAnScrollView_byId[test(AVD) - 12] FAILED
com.adevinta.android.barista.internal.failurehandler.BaristaException: No view matching ((an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Hi! I'm the second screen!" or (view.getParent() is assignable from class and (view is an instance of android.view.ViewGroup and has descendant matching an instance of android.widget.TextView and view.getText() with or without transformation to match: is "Hi! I'm the second screen!")))) was found
at com.adevinta.android.barista.internal.failurehandler.SpyFailureHandler.resendFirstError(SpyFailureHandler.kt:25)
```

A clear description of what is the bug is.

**Steps to reproduce the bug:**
1. Create a PR
2. Wait for API 31 test results

**Expected Behavior:**
Tests should pass.

A clear description of what you expected to happen.
The tests should not be flaky and be able to pass on first run in CI.

Guia de contribuição

Abrir o guia de contribuição

Direção de pesquisa

Start with the failing ClickTest cases and the connectedDebugAndroidTest task on the API 31 AVD, then compare the reported view-matching failures across CI runs. Reproduce the failures in the CI workflow and identify the cause of the flakiness; done means these tests pass reliably on the first API 31 run.

Escrita pelo modelo de indexação a partir do texto da issue.

Avaliação

Stack de tecnologia
android, kotlin
Domínio
ci-cd, mobile, testing
Tipo de issue
Bug
Dificuldade
4/5
Tempo estimado
3-5 dias
Status de atividade
Estagnada
Clareza
Precisa de esclarecimento
Facilidade para iniciantes
35/100

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.