Disable the flicker tests which are currently flaky and the failing ones to push the test suite into presubmit.
Test: atest FlickerTests
Change-Id: I92fadad88882ad331f183174aaa803cd87e8c97c
Pip is currently flaky. Disable them on the flicker tests until the
stabilize.
Test: atest FlickerTests
Change-Id: I762a998e99acf21e30140a8bb8950420f22df77e
The test harness must be enabled to alllow the test to interact with
TAPL (launcher), otherwise the test crashes with an "Error granting
runtime permission" exception.
Test: atest FlickerTests
Change-Id: I5fffa4e756fab7ab4abca8a4d301f3c01e1297ce
Currently, each test has its own "@Before" method which executed a transition.
Instead, each method now returns its transition and the base test class handles the execution.
Test: atest FlickerTests
Change-Id: I96a0be436ed28ed1d8ffe258ab2a002cca57dd9e
With b/150232615, we will need an explicit value set for the exported
flag when intent filters are present, as the default behavior is
changing for S+. This change adds the value reflecting the previous
default to the manifest.
These changes were made using an automated tool, the xml file may be
reformatted slightly creating a larger diff. The only "real" change is
the addition of "android:exported" to activities, services, and
receivers that have one or more intent-filters.
Bug: 150232615
Test: TH
Exempt-From-Owner-Approval: mechanical refactoring
Change-Id: I4457ff2bd466a4c56fed2570e110f251031c2385
Split screen tests cannot run until the split screen divider is
available again in the accessibility service (UiAutomation) API, which
we use to interact with the app under test.
Test: atest FlickerTests
Change-Id: Id7573c162a7aa765a77f07596fedc4920d44964a
Currently, when the device is in an incorrect state (e.g. in split
screen) because another test failed to teardown the error message is a
java.lang.NullPointerException. Instead of this error, show a message
warning about the problem to aid debugging.
Test: atest FlickerTests
Change-Id: If3bd75c14c90209952484802ee17f817ab4f0f20
If the test crashes for any reason, still clean-up the device to leave
the device in a consistent state and avoid affecting other tests.
Test: atest FlickerTests
Change-Id: If7c0238875fdc7a3cb548d6e6f9d49340bc96f26
If the test crashes for any reason, still clean-up the device to leave
the device in a consistent state and avoid affecting other tests.
Test: atest FlickerTests
Change-Id: I53d4288b765a5c5221fae4cd1b8ce2b5035676a8
Previously the rotation animatino layer was called "ScreenshotLayer",
now that layer is called "RotationLayer". Updated the flicker tests to
consider the new name.
Test: astest FlickerTests
Change-Id: I4600d4be57284b6f373588081d3f6dac8125f06b
* changes:
New flicker test: Add rotation to split screen test
Ensure screenshot layer appears during rotation
New FlickerTests: Create initial flicker tests for Pip
Currently the split screen test only starts the app in 0 degrees. As the other tests, start in both 0 and 90 degrees to ensure animations work correctly.
Test: atest FlickerTests:OpenAppToSplitScreenTest
Change-Id: Ied316d9c48b243728544ad4a972cb3e0fa81bec8
Add some additional checks on flicker tests to ensure that the screenshot layer ir correctly being displayed during the rotation animation.
Test: atest FlickerTests:ChangeAppRotationTest, atest FlickerTests:OpenAppColdTest and atest FlickerTests:OpenAppWarmTest
Change-Id: I2a6c74179c07eee86caae08f05430752aa4e084e
Create an initial set of tests for pip. Initial tests are:
- All regions covered
- Status and navigation bar is always visible
- Pip window is shown, expanded, closed, and doesn't flicker
- Pip layer is shown, expanded, closed, and doesn't flicker
- Background is displayed behind Pip window
Test: atest FlickerTests:PipToHomeTest and atest FlickerTests:PipToAppTest
Change-Id: I16345de39a799744b97a5390495538d568693222
When the flicker tests fail we log as well what is the checksum of the trace file which was analyzed to ensure that the file which was tested is the same available for debugging. Also, print the checksum information on the test failure message.
Test: atest FlickerTests, then check if the resulting folder contains a ".sha256" file for each WM/SF trace.
Change-Id: I448bf373e3b837c2e40317809d511a0f5236de1f
These tests are still flaky. Disable them for now so that we can move the flicker tests to presubmit.
Test: atest FlickerTests
Change-Id: I811f32723cdbaece3aff7d6dbb100c0c5b2653fa
To reduce the flicker test time, reduce the tests to consider only:
* Start test at 0 degrees
* Start test at 90 degrees
* Rotation tests from 0 to 90 degrees
* Rotation tests from 90 to 0 degrees
Also, execute each action a single time.
Test: atest FlickerTest
Change-Id: I5976cf950998a8150fd5a1b32f0f1432cd731ee1
Due to bug b/147659548 the seamless rotation is not working properly on the flicker tests. Disable the test until the bug is fixed.
Test: atest FlickerTests
Change-Id: Ib286cadde9019e12dbf7c673cb7f60b53a1687bf
Currently the flicker tests leave data on the /sdcard/flicker directory. We now clean up this data after the test.
The logs are still available in the atest results directory.
Test: atest FlickerTests
Change-Id: Ia83cbedff3104964e3d4be14a7c035f2193d36a8
Sometimes the tests crash because all runs are janky. Our checks are so far robust to jank, so we will consider janky runs too
Test: atest FlickerTests
Change-Id: I20303d530e1a9cc266230530c6f7fa1cecd51020
After a change in the flickerlib the videos are no longer recorded by
default. The tests which need to record a video must signal it.
Test: atest FlickerTests, check if the video exists in /sdcard/flicker
Change-Id: I8e74411ca6bf654ec7c0afcacf1c0591610f50bb
These tests are timing dependent and require the DUT to have the same performance
characteristics as the real devices.
Test: cd frameworks/base/tests/FlickerTests && atest :postsubmit
Change-Id: Ie836aa0a5df1050733169c8bd16adaccbfdf5e3c
* changes:
New FlickerTests: Run split screen tests at 0 and 90 degrees
New FlickerTests: Start app warm and cold at both 0 and 90 degrees
New FlickerTests: Start IME alongside the app (0 and 90 degrees)
New FlickerTests: Start IME tests with app rotated by 90 degrees
When running the flicker tests on postsubmit the apps require the following permission: "android.permission.WRITE_SECURE_SETTINGS"
Test: atest FlickerTests
Change-Id: I6a2647fb6d2351617297b3f89ae3f3edc1aad981
Some flicker tests are failing because of open bugs. Mark them as
ignored until the bugs are fixed to prevent test failures.
Test: atest FlickerTests
Change-Id: If9216bccc32d64cd32ff87fae785df200eae8b79
