Commit Graph

15 Commits

Author SHA1 Message Date
Sam Dubey
261cc40187 Disable inernal app before running tests
Debuggable reamdump data collection dialog is triggering up while
running tests. These are causing flakes. While a better fix would be
figuring out why these are triaggered, the wm tests should be
independent of internal apps which an end user of Android won't see.

Test: Forrest
Bug: 258578781
Bug: 239384214
Change-Id: Ia4c0c670fe3e35f84640787cb8fce70e74edb264
2022-11-14 13:34:59 +00:00
Nataniel Borges
48fcff3ca4 Revert "Revert "Revert "Increase SF buffer size before starting flicker tests"""
This reverts commit 93bffb3233.

Reason for revert: b/256840614

Change-Id: Ifb67431703f246da63cba34f1bf3833dd6c6e098
2022-11-01 15:38:31 +00:00
Nataniel Borges
93bffb3233 Revert "Revert "Increase SF buffer size before starting flicker tests""
This reverts commit 7c5f0e8e64.

Reason for revert: Landing feature again. We need a larger buffer for flicker detection

Fixes: 255715397
Change-Id: I5e51ae254b94eacd5751a04a03991147aa19154a
2022-10-27 18:41:01 +00:00
Nataniel Borges
7c5f0e8e64 Revert "Increase SF buffer size before starting flicker tests"
This reverts commit 3bedae5d01.

Reason for revert: Significantly increased flakiness in go/wm-tests-flicker

Change-Id: I8e1e051103029abf1b431d514b24a7b6253599b9
2022-10-15 10:30:34 +00:00
Nataniel Borges
3bedae5d01 Increase SF buffer size before starting flicker tests
Ensure all data from a CUJ fits in the buffer

Test: atest FlickerTests WMShellFlickerTests
Change-Id: I6e00acfdee26dcec349a3aa5d82f15ac664e62df
2022-10-14 15:07:02 +00:00
Nataniel Borges
12fafeeb6c Ensure lock screen is enabled in swipe mode at the start of the test
Test: atest FlickerLibTest && atest FlickerTests
Change-Id: Idd324fbf9c0697cb4af341e1288fdcb021ed1d86
2022-10-03 20:07:04 +00:00
Nataniel Borges
816c9464ec 3/ Update flicker tests to compatibilize with new apps
Test: atest FlickerLibTest && atest FlickerTests
Change-Id: I9306a2a3905026a5eee53c8ae6f0aa0f87bc42c9
2022-09-21 12:40:59 +00:00
Nataniel Borges
669a1a74c9 Disable async trace
Using compressed trace files speeds up trace collection and the benefits of using async trace fetch become negligible.

To simplify the code, remove the functionality

Bug: 209843622
Test: atest FlickerTests WMShellFlickerTests
Change-Id: Id21d58af5393eb7f364b353db619c55a5a5b616c
2022-02-16 07:14:59 +01:00
Nataniel Borges
ccc875cc97 Fetch traces async
Due to the large amount of traces on flicker, the tests take 15min+ to copy the files from the device to the host after the test execution. Instead, start copying the files asynchronously.

It is not possible to use the async mechanism from Tradefed's FilePullerLogCollector because it either: (1) pushes the files form the directory multiple times -- once per test -- creating a lot of duplicates; or (2) cleans up the directory without checking for new files, losing some files.

This CL creates an asynchronous file upload mechanism for flicker using coroutines

Bug: 216111397
Test: atest FlickerTests WMShellFlickerTests
Change-Id: I5bbae834cf3439950626823c6b665c733e27e517
2022-02-01 20:08:51 +01:00
Nataniel Borges
9aafa92630 Stop rebooting device after Flicker tests
Because of the configuration file split we no longer need to reboot the device at the end of flicker tests - this will speed up the time required to get the final results from tests.

Test: atest FlickerTests WMShellFlickerTests
Bug: 206633034
Change-Id: I76285ca64aa7a8913088e625999d5756a2e662a0
2021-11-16 19:18:11 +01:00
Nataniel Borges
d85b2e28c7 Log WM trace on frame instead of transaction
Logging all transactions of WM lead to logging inconsistent states that are not sent to SF nor visible to the end user. This information increases the flakiness of the test.

Logging only on frame means that the log will only contain the information sent to SF.

Test: atest FlickerTests WMShellFlickerTests
Bug: 167521849
Change-Id: I16624181ebd127482724439fff84d4bca7fe9ab3
2021-03-05 15:52:05 +01:00
Nataniel Borges
3ff83743e2 Remove flaky from default excluded tests
Atest cannot override include-annotation and exclude-annotation from the Android.xml, only append new ones.

Ideally we should have a single test configuration for all flicker tests (presubmit/postsubmit/flaky) and adjust the arguments according to the type of test we intend to run.

Presubmit:
    atest FlickerTests -- --module-arg FlickerTests:include-annotation:android.platform.test.annotations.Presubmit --module-arg FlickerTests:exclude-annotation:androidx.test.filters.FlakyTest

Postsubmit:
    atest FlickerTests -- --module-arg FlickerTests:include-annotation:android.platform.test.annotations.Postsubmit --module-arg FlickerTests:exclude-annotation:androidx.test.filters.FlakyTest

Flaky:
    atest FlickerTests -- --module-arg FlickerTests:include-annotation:androidx.test.filters.FlakyTest

To run WMShellFlickerTests, just replace FlickerTests for WMShellFlickerTests in the commands above.

Bug: 170490377
Test: atest FlickerTests WMShellFlickerTests
Change-Id: Ic252f27065714e9039e3c0f33659b98eb288aa6f
2021-02-08 14:19:09 +01:00
Nataniel Borges
da5136ea43 Provides assertion blocks on Flicker
Enable tests ot be in presubmit, postsubmit or marked as flaky

Do not require flicker DSL changes

Bug: 162923992
Test: atest FlickerTests WMShellFlickerTests
Change-Id: I74fdadaf5f6f08d96973683682297200eec6658d
2021-02-02 18:16:12 +01:00
Nataniel Borges
28823f1d5c Refactor flickerlib dependencies
Previously the flickerlib had some pixel specific code, now it's
general. All pixel specific code either should migrate to FlickerTests
or to flickerlib-helpers

Test: atest FlickerTests
Change-Id: Ibca99f2bf68a511f73130439f6334a01e47a8671
2020-09-01 10:52:13 +02:00
Hongwei Wang
bbf561ac3a Add flicker test for WM Shell
Separated folders in libs/WindowManager/Shell/tests
- unittest, for unit tests
- flicker, for this flicker tests
- propose to add functional/ folder for functional tests

Note also
- Copied over EnterPipTest from existing flicker tests as proof of
concept
- TODO: need to figure out the next step for the flicker test library
itself as it's currently packaged in com.android.server.wm

Bug: 161561007
Test: atest WMShellFlickerTests
Test: atest WMShellUnitTests
Change-Id: Ic06e7cb0f98151591ccb9f5217260939349a9aa5
2020-08-20 16:13:57 -07:00