Giter Club home page Giter Club logo

fladle's Introduction

fladle's People

Contributors

andersu avatar andrewreitz avatar asadsalman avatar changusmc avatar cristiangm avatar dependabot[bot] avatar digitalbuddha avatar francescocervone avatar japplin avatar johnjohndoe avatar julioz avatar justintuchek avatar kozaxinan avatar marcosholgado avatar matthewtpage avatar nnoel-grubhub avatar notsatyarth avatar pawelpasterz avatar piotradamczyk5 avatar rciovati avatar renovate[bot] avatar runningcode avatar samtstern avatar simonmarquis avatar tahirhajizada avatar tasomaniac avatar winterdroid avatar zacsweers avatar zlippard avatar zlippard-gd avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

fladle's Issues

Setting flankVersion(String) doesn't seem to be effective

My Fladle extension config:

fladle {
    ....
    flankVersion("6.2.0")
    ....
}

Then, I run my tests:

./gradlew runFlank

Expectation: Gradle Build Scan shows a dependency on flank:flank:6.2.0. Flank v6.2.0 is invoked
Actual results: Gradle Build Scan shows a dependency on flank:flank:5.1.0, which appears to be the default value.

I've also tried v6.2.0 and banana, neither of which provided any different results. Flank 5.1.0 is always used.

My environment:
Fladle 0.6.2, Gradle 5.4.1, macOS Mojave 10.14.5

flakyTestAttempts not working

Using fladle version 0.3.7 I try running with this fladle block:

fladle {
    // Required parameters
    serviceAccountCredentials("${project.file("firebase-config-tst.json")}")

    // Optional parameters
    useOrchestrator = true
    testTargets = [
            "package my.package"
    ]
    devices = [
            new Device("Nexus5", 23, null, null)
    ]
    projectId("my-project-id")
    flankVersion("v3.2.1")
    autoGoogleLogin = true
    clearPackageData = true
    testShards = 10
    flakyTestAttempts = 3
    configs {
        nl {
            debugApk("$buildDir/path/to/nl/debug.apk")
            instrumentationApk("$buildDir/path/to/nl/debug-androidTest.apk")
        }
        de {
            debugApk("$buildDir/path/to/de/debug.apk")
            instrumentationApk("$buildDir/path/to/de/debug-androidTest.apk")
        }
    }
}

And the error when trying to sync gradle is
Could not set unknown property 'flakyTestAttempts' for object of type com.osacky.flank.gradle.FlankGradleExtension.

Unable to set environmentVariables

When trying to set the environmentVariables parameter in the Fladle block, I get the following error: Could not set unknown property 'environmentVariables' for object of type com.osacky.flank.gradle.FlankGradleExtension.

Question: How can I get the runFlank task to fail upon receiving Google Cloud API errors?

I've run the runFlank task and have received the following error:

Request failed, retrying 10x Request failed, retrying 10x com.google.api.client.googleapis.json.GoogleJsonResponseException: 429 Too Many Requests
{
  "code" : 429,
  "errors" : [ {
    "domain" : "global",
    "message" : "Insufficient test quota. See http://firebase.google.com/pricing/ for details.",
    "reason" : "rateLimitExceeded"
  } ],
  "message" : "Insufficient test quota. See http://firebase.google.com/pricing/ for details.",
  "status" : "RESOURCE_EXHAUSTED"
}

I would expect the task to fail after reaching the retry limit. That doesn't seem to be the case. Would there be a way to enable this? Otherwise, my CI job just hangs indefinitely.

Updating matrix file failed

Hi, this is my first time using fladle plugin, the running script seems fine until FetchArtifacts tasks on Windows OS, on CI system(Ubuntu) is works very well, the result on Firebase Test lab is totally fine too.

Running script
**./gradlew assembleMock assembleAndroidTest runFlank**

my configurations

**
fladle {
    serviceAccountCredentials("${project.file("src/release/app-dist-account.json")}")
    projectId("dev-test")
    useOrchestrator = true

    debugApk("$buildDir/outputs/apk/mock/app-mock.apk")

    instrumentationApk("$buildDir/outputs/apk/androidTest/mock/app-mock-androidTest.apk")

    devices = [
            ["model": "Nexus6", "version": "21", "locale": "en", "orientation": "portrait"]
    ]
}**

Gradle output

9:35:22 AM: Executing task 'runFlank'...

Executing tasks: [runFlank] in project C:\Users\Him\Documents\androids\7peaksandroiddevelopertest

> Task :buildSrc:compileKotlin UP-TO-DATE
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy NO-SOURCE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources NO-SOURCE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:inspectClassesForKotlinIC UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:compileTestKotlin NO-SOURCE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
> Task :app:writeConfigProps

> Task :app:execFlank
AndroidArgs
    gcloud:
      results-bucket: test-lab-hfx53fsx452xq-y2af9whtjinwi
      results-dir: null
      record-video: true
      timeout: 15m
      async: false
      results-history-name: null
      # Android gcloud
      app: C:\Users\Him\Documents\androids\7peaksandroiddevelopertest\app\build\outputs\apk\mock\app-mock.apk
      test: C:\Users\Him\Documents\androids\7peaksandroiddevelopertest\app\build\outputs\apk\androidTest\mock\app-mock-androidTest.apk
      auto-google-login: false
      use-orchestrator: true
      directories-to-pull:

      performance-metrics: true
      test-runner-class: null
      test-targets:

      device:
        - model: Nexus6
          version: 21
          locale: en
          orientation: portrait
      num-flaky-test-attempts: 0

    flank:
      max-test-shards: 1
      shard-time: -1
      num-test-runs: 1
      smart-flank-gcs-path: 
      smart-flank-disable-upload: false
      files-to-download:

      test-targets-always-run:

      disable-sharding: false
      project: peaks-dev-test
      local-result-dir: results
      # Android Flank Yml
      keep-file-path: false
      additional-app-test-apks:

RunTests
  Uploading app-mock-androidTest.apk   Uploading app-mock.apk ..


  Smart Flank cache hit: 0% (0 / 4)
  Shard times: 40s

  4 tests / 1 shard

  1 matrix ids created in 0m 5s
  https://console.developers.google.com/storage/browser/test-lab-hfx53fsx452xq-y2af9whtjinwi/2020-02-17_02-35-28.377000_StjU/

PollMatrices
  0m  1s matrix-9n8hgyh9qsf4a Nexus6-21 VALIDATING
  0m 13s matrix-9n8hgyh9qsf4a Nexus6-21 PENDING
  0m 32s matrix-9n8hgyh9qsf4a Nexus6-21 Starting attempt 1.
  0m 32s matrix-9n8hgyh9qsf4a Nexus6-21 RUNNING
  1m 28s matrix-9n8hgyh9qsf4a Nexus6-21 Started logcat recording.
  1m 28s matrix-9n8hgyh9qsf4a Nexus6-21 Preparing device.
  2m  0s matrix-9n8hgyh9qsf4a Nexus6-21 Installing apps.
  2m 19s matrix-9n8hgyh9qsf4a Nexus6-21 Retrieving Pre-Test Package Stats information from the device.
  2m 19s matrix-9n8hgyh9qsf4a Nexus6-21 Retrieving Performance Environment information from the device.
  2m 19s matrix-9n8hgyh9qsf4a Nexus6-21 Started crash detection.
  2m 19s matrix-9n8hgyh9qsf4a Nexus6-21 Started crash monitoring.
  2m 19s matrix-9n8hgyh9qsf4a Nexus6-21 Started performance monitoring.
  2m 25s matrix-9n8hgyh9qsf4a Nexus6-21 Started video recording.
  2m 25s matrix-9n8hgyh9qsf4a Nexus6-21 Starting instrumentation test.
  3m 27s matrix-9n8hgyh9qsf4a Nexus6-21 Completed instrumentation test.
  3m 33s matrix-9n8hgyh9qsf4a Nexus6-21 Stopped performance monitoring.
  4m  5s matrix-9n8hgyh9qsf4a Nexus6-21 Stopped crash monitoring.
  4m  5s matrix-9n8hgyh9qsf4a Nexus6-21 Retrieving Post-test Package Stats information from the device.
  4m  5s matrix-9n8hgyh9qsf4a Nexus6-21 Stopped logcat recording.
  4m  5s matrix-9n8hgyh9qsf4a Nexus6-21 Done. Test time = 57 (secs)
  4m  5s matrix-9n8hgyh9qsf4a Nexus6-21 Starting results processing. Attempt: 1
  4m 15s matrix-9n8hgyh9qsf4a Nexus6-21 Completed results processing. Time taken = 5 (secs)
  4m 15s matrix-9n8hgyh9qsf4a Nexus6-21 FINISHED
  4m 15s matrix-9n8hgyh9qsf4a FINISHED

FetchArtifacts
  .
  Updating matrix file

java.lang.NullPointerException
	at sun.nio.fs.WindowsFileSystem.getPath(WindowsFileSystem.java:247)
	at java.nio.file.Paths.get(Paths.java:84)
	at ftl.reports.util.ReportManager.getWebLink(ReportManager.kt:44)
	at ftl.reports.util.ReportManager.processXml(ReportManager.kt:68)
	at ftl.reports.util.ReportManager.parseTestSuite(ReportManager.kt:89)
	at ftl.reports.util.ReportManager.generate(ReportManager.kt:95)
	at ftl.run.TestRunner.newRun(TestRunner.kt:349)
	at ftl.run.TestRunner$newRun$1.invokeSuspend(TestRunner.kt)
	at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33)
	at kotlinx.coroutines.ResumeModeKt.resumeUninterceptedMode(ResumeMode.kt:45)
	at kotlinx.coroutines.internal.ScopeCoroutine.afterCompletionInternal(Scopes.kt:32)
	at kotlinx.coroutines.JobSupport.completeStateFinalization(JobSupport.kt:310)
	at kotlinx.coroutines.JobSupport.tryFinalizeFinishingState(JobSupport.kt:236)
	at kotlinx.coroutines.JobSupport.tryMakeCompletingSlowPath(JobSupport.kt:849)
	at kotlinx.coroutines.JobSupport.tryMakeCompleting(JobSupport.kt:811)
	at kotlinx.coroutines.JobSupport.makeCompletingOnce$kotlinx_coroutines_core(JobSupport.kt:787)
	at kotlinx.coroutines.AbstractCoroutine.resumeWith(AbstractCoroutine.kt:111)
	at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:46)
	at kotlinx.coroutines.DispatchedTask.run(Dispatched.kt:241)
	at kotlinx.coroutines.EventLoopImplBase.processNextEvent(EventLoop.common.kt:270)
	at kotlinx.coroutines.BlockingCoroutine.joinBlocking(Builders.kt:79)
	at kotlinx.coroutines.BuildersKt__BuildersKt.runBlocking(Builders.kt:54)
	at kotlinx.coroutines.BuildersKt.runBlocking(Unknown Source)
	at kotlinx.coroutines.BuildersKt__BuildersKt.runBlocking$default(Builders.kt:36)
	at kotlinx.coroutines.BuildersKt.runBlocking$default(Unknown Source)
	at ftl.cli.firebase.test.android.AndroidRunCommand.run(AndroidRunCommand.kt:49)
	at picocli.CommandLine.executeUserObject(CommandLine.java:1729)
	at picocli.CommandLine.access$900(CommandLine.java:145)
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2101)
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2068)
	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:1935)
	at picocli.CommandLine.execute(CommandLine.java:1864)
	at ftl.Main$Companion.main(Main.kt:41)
	at ftl.Main.main(Main.kt)

> Task :app:execFlank FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':app:execFlank'.
> Process 'command 'C:\Program Files\Android\Android Studio\jre\bin\java.exe'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 59s
2 actionable tasks: 2 executed
9:42:22 AM: Task execution finished 'runFlank'.

`shardTime` config property not written to flank.yml

While shardTime is present in the gradle plugin's configuration properties, it is not supported in FlankGradleExtension or YamlWriter. It will not be written to flank.yml properly as shard-time

This prevents the ability to use shardTime to dynamically set the shardCount.

Add support for tasks which run different test filters

Here are my thoughts on the API:
I was thinking of adding a map to the extension like so:

additionalTestFilters = mapOf(
  "pr" to listOf(listOf("class .........", "package......."))
  "regression" to listOf("class .........", "package......."))
)

this would generate two additional tasks
runFlankPr and runFlankRegression in addition to the runFlank task which would run with the default testFilters.

Let's use customizable tasks instead.

Support clearPackageData environment variable

I would like my generated flank.yml to have this setting so that package data is cleared between each test:

gcloud:
  environment-variables:
    clearPackageData: true

(I'm happy to do a pull request myself, but I ran into some issues with "Could not find org.jetbrains.trove4j:trove4j:20160824". Any idea why I'm getting that?)

Configuration option to ignore failures

Standard test tasks support ignoreFailures, which Flank doesn't appear to. Ignoring failures is useful for CI, where it's more desirable for Gradle invocations to complete successfully, and test results to be analyzed afterward.

Feature Request: remove build logs

We see these build logs (even when not running Fladle)

Fladle: Configuring fladle.debugApk from variant debug
Fladle: Configuring fladle.instrumentationApk from variant debug-androidTest
Fladle: Automatically detected the use of Android Test Orchestrator

I guess these are happening during Gradle config phase. Either way it would be nice to remove them.

auto-detect apk path is not respected if multiple variants configured in configs

fladle {
    serviceAccountCredentials(testLabApiKey)

    devices = [
        new Device("Pixel2", 28, null, null)
    ]    

    configs {
        one {
            variant = "one-debug"            
        }
        two {
            variant = "two-debug"            
        }
    }
}

Running runFlankOne or runFlankTwo is expected to get the right app and test path however it will choose a random variant during auto-detection

Device not found

When trying to add a new device as an optional parameter, the device object is not found on the classpath com.osacky.flank.gradle.Device. I'm using the following fladle block:

apply plugin: "com.osacky.fladle"

import com.osacky.flank.gradle.Device

fladle {
// Required parameters
serviceAccountCredentials("${project.file("path-to-key-file.json")}")

// Optional parameters
useOrchestrator = true

environmentVariables = ["annotation": "some-annotation"]

directoriesToPull = [
        "/sdcard/screenshots"
]
filesToDownload = [
        ".*/screenshots/.*"
]
timeoutMin = 15
recordVideo = true
performanceMetrics = false
devices = [
        new Device("Pixel2", 28, null, null),
]
flankVersion("v4.3.1")
debugApk("$buildDir/outputs/apk/debug/app-debug.apk")
instrumentationApk("$buildDir/outputs/apk/androidTest/debug/app-debug-androidTest.apk" )
autoGoogleLogin = true
testShards = 15

}

I'm using Gradle 5.2.1 and Gradle Plugin 3.3.0.

Support snapshot version

It would be great to be able to use the latest snapshot version as well. Or to specify the jar file itself instead of downloading. Actually both options would be great!

Code coverage report

Hi

I'm trying to setup code coverage with FTL usage. I read the tutorial on Flank page
https://github.com/TestArmada/flank#android-code-coverage

I thought I'm almost there but one thing is missing results-dir: coverage_ec
Since the value is not set via FladleExtension Flank falls back to results-dir: null

I'm not 100% sure if I'm obligated to set results-dir to actually run code coverage but definitely this value is missing from the extension.

Is there any hack I could use?
Thanks

Fladle not setting GOOGLE_APPLICATION_CREDENTIALS and GOOGLE_CLOUD_PROJECT env vars

It's been a few weeks since I ran Fladle on my local machine. It was working fine before. Today I get two errors. First one:

> Task :app:execFlank FAILED
project is not set. Define GOOGLE_CLOUD_PROJECT or set project in flank.yml
 See https://github.com/GoogleCloudPlatform/google-cloud-java#specifying-a-project-id

So I then manually set projectId in build.gradle and run again. I then get this error:

Caused by: java.io.IOException: Error reading credential file from environment variable GOOGLE_APPLICATION_CREDENTIALS, value 'null': File does not exist.

So I think Fladle is not correctly setting GOOGLE_APPLICATION_CREDENTIALS and GOOGLE_CLOUD_PROJECT env vars (https://github.com/TestArmada/flank#authenticate-with-a-service-account)

I don't really think I changed anything. I'm still using v 0.2.12 of this plugin and using the default version of Flank (3.1.1).

Tasks not showing up

Since no GROUP is set on the public-API tasks, they are not showing up the ./gradlew tasks without --all.

Not downloading right Flank version

These are my fladle settings:

fladle {
    serviceAccountCredentials("${project.file("firebase-test-lab-service-account.json")}")
    useOrchestrator = true
    testShards = 2
    flankVersion("v3.2.1")
    devices = [
            new Device("Nexus5X", 25, null, null)
    ]
}

I see this in my gradle logs:

Download https://github.com/TestArmada/flank/releases/download/v3.1.1/flank.jar

Support multiple modules

It would be great to support mult-module builds with multiple instrumentation APKs but a single debugApk.

Unauthorized response from firebase

When trying to run ./gradlew runFlank, I get the following response back:
{
"code" : 403,
"errors" : [ {
"domain" : "global",
"message" : "Forbidden",
"reason" : "forbidden"
} ],
"message" : "Forbidden"
}

When using Flank on the command line with exactly the same Service Account Credentials everything works fine.

Feature Request: Generate app apk and test apk if not found

Right now I have to build app and test apks before running flank:

./gradlew clean app:assembleDebug app:assembleDebugAndroidTest app:runFlank --no-parallel

I know that you already added "auto detect apks" in #1. It would be great if Fladle was one step smarter and I could just call ./gradlew app:runFlank and have it work out all the magic.

Fladle dependency on AGP should be compileOnly

Currently Fladle has an implementation dependency on AGP:

dependencies {
  implementation("com.android.tools.build:gradle:3.5.3")
}

If a project which applies Fladle uses a lower version of AGP, e.g. 3.5.1, Gradle will silently use the higher version which comes from Fladle instead of version 3.5.1, specified by user. This is definitely not something that the user would expect.

Gradle devs recommend using compileOnly configuration for dependencies provided by user:
https://blog.gradle.org/introducing-compile-only-dependencies

Cryptic gradle crash

Running flank via fladle on bitrise we are starting to see this cryptic gradle error

Tests seem to run just fine
Task :app:execFlank
AndroidArgs
    gcloud:
      results-bucket: test-lab-wr02yd8ryt2um-njz0cdshhpsn0
      results-dir: null
      record-video: false
      timeout: 30m
      async: false
      results-history-name: null
      # Android gcloud
      app: /bitrise/src/app/build/outputs/apk/debug/app-debug.apk
      test: /bitrise/src/app/build/outputs/apk/androidTest/debug/app-debug-androidTest.apk
      auto-google-login: false
      use-orchestrator: true
      directories-to-pull:
      performance-metrics: true
      test-runner-class: null
      test-targets:
      device:
        - model: Pixel2
          version: 28
          locale: en
          orientation: portrait
        - model: Pixel2
          version: 27
          locale: en
          orientation: portrait
        - model: Nexus5X
          version: 26
          locale: en
          orientation: portrait
        - model: Nexus5X
          version: 25
          locale: en
          orientation: portrait
      flaky-test-attempts: 0
    flank:
      max-test-shards: 4
      shard-time: -1
      repeat-tests: 1
      smart-flank-gcs-path: gs://test-lab-wr02yd8ryt2um-njz0cdshhpsn0/flank/flank_android.xml
      smart-flank-disable-upload: false
      files-to-download:
      test-targets-always-run:
      disable-sharding: false
      project: orion-labs
      local-result-dir: results
      # Android Flank Yml
      additional-app-test-apks:
RunTests
  Uploading app-debug-androidTest.apk .  Uploading app-debug.apk .
  Smart Flank cache hit: 100% (55 / 55)
  Shard times: 301s, 302s, 302s, 302s
  55 tests / 4 shards
  4 matrix ids created in 0m 4s
  https://console.developers.google.com/storage/browser/test-lab-wr02yd8ryt2um-njz0cdshhpsn0/2019-09-05_14-54-07.143000_WYYO/
PollMatrices
  0m  0s matrix-qux8dazq4ocaa Pixel2-28 VALIDATING
  0m  0s matrix-qux8dazq4ocaa Nexus5X-26 VALIDATING
  0m  0s matrix-qux8dazq4ocaa Nexus5X-25 VALIDATING
  0m  0s matrix-qux8dazq4ocaa Pixel2-27 VALIDATING
  0m 15s matrix-qux8dazq4ocaa Pixel2-28 PENDING
  0m 15s matrix-qux8dazq4ocaa Nexus5X-26 PENDING
  0m 15s matrix-qux8dazq4ocaa Nexus5X-25 PENDING
  0m 15s matrix-qux8dazq4ocaa Pixel2-27 PENDING
  0m 45s matrix-qux8dazq4ocaa Pixel2-28 Starting attempt 1.
  0m 45s matrix-qux8dazq4ocaa Pixel2-28 RUNNING
  0m 45s matrix-qux8dazq4ocaa Nexus5X-26 Starting attempt 1.
  0m 45s matrix-qux8dazq4ocaa Nexus5X-26 RUNNING
  0m 45s matrix-qux8dazq4ocaa Nexus5X-25 Starting attempt 1.
  0m 45s matrix-qux8dazq4ocaa Nexus5X-25 RUNNING
  0m 45s matrix-qux8dazq4ocaa Pixel2-27 Starting attempt 1.
  0m 45s matrix-qux8dazq4ocaa Pixel2-27 RUNNING
  1m 45s matrix-qux8dazq4ocaa Pixel2-28 Started logcat recording.
  1m 45s matrix-qux8dazq4ocaa Pixel2-28 Preparing device.
  1m 45s matrix-qux8dazq4ocaa Nexus5X-26 Started logcat recording.
  1m 45s matrix-qux8dazq4ocaa Nexus5X-26 Preparing device.
  1m 45s matrix-qux8dazq4ocaa Nexus5X-25 Started logcat recording.
  1m 45s matrix-qux8dazq4ocaa Nexus5X-25 Preparing device.
  1m 45s matrix-qux8dazq4ocaa Pixel2-27 Started logcat recording.
  1m 45s matrix-qux8dazq4ocaa Pixel2-27 Preparing device.
  2m 15s matrix-qux8dazq4ocaa Pixel2-28 Installing apps.
  2m 15s matrix-qux8dazq4ocaa Nexus5X-26 Installing apps.
  2m 15s matrix-qux8dazq4ocaa Nexus5X-26 Retrieving Pre-Test Package Stats information from the device.
  2m 15s matrix-qux8dazq4ocaa Nexus5X-26 Retrieving Performance Environment information from the device.
  2m 15s matrix-qux8dazq4ocaa Nexus5X-26 Started crash detection.
  2m 15s matrix-qux8dazq4ocaa Nexus5X-26 Started crash monitoring.
  2m 15s matrix-qux8dazq4ocaa Nexus5X-26 Started performance monitoring.
  2m 15s matrix-qux8dazq4ocaa Nexus5X-26 Starting instrumentation test.
  2m 15s matrix-qux8dazq4ocaa Nexus5X-25 Installing apps.
  2m 30s matrix-qux8dazq4ocaa Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  2m 30s matrix-qux8dazq4ocaa Pixel2-28 Retrieving Performance Environment information from the device.
  2m 30s matrix-qux8dazq4ocaa Pixel2-28 Started crash detection.
  2m 30s matrix-qux8dazq4ocaa Pixel2-28 Started crash monitoring.
  2m 30s matrix-qux8dazq4ocaa Pixel2-28 Started performance monitoring.
  2m 30s matrix-qux8dazq4ocaa Pixel2-28 Starting instrumentation test.
  2m 30s matrix-qux8dazq4ocaa Nexus5X-25 Retrieving Pre-Test Package Stats information from the device.
  2m 30s matrix-qux8dazq4ocaa Nexus5X-25 Retrieving Performance Environment information from the device.
  2m 30s matrix-qux8dazq4ocaa Nexus5X-25 Started crash detection.
  2m 30s matrix-qux8dazq4ocaa Nexus5X-25 Started crash monitoring.
  2m 30s matrix-qux8dazq4ocaa Nexus5X-25 Started performance monitoring.
  2m 30s matrix-qux8dazq4ocaa Nexus5X-25 Starting instrumentation test.
  2m 30s matrix-qux8dazq4ocaa Pixel2-27 Installing apps.
  2m 30s matrix-qux8dazq4ocaa Pixel2-27 Retrieving Pre-Test Package Stats information from the device.
  2m 30s matrix-qux8dazq4ocaa Pixel2-27 Retrieving Performance Environment information from the device.
  2m 30s matrix-qux8dazq4ocaa Pixel2-27 Started crash detection.
  2m 30s matrix-qux8dazq4ocaa Pixel2-27 Started crash monitoring.
  2m 30s matrix-qux8dazq4ocaa Pixel2-27 Started performance monitoring.
  2m 30s matrix-qux8dazq4ocaa Pixel2-27 Starting instrumentation test.
  3m 31s matrix-qux8dazq4ocaa Nexus5X-25 Completed instrumentation test.
  3m 46s matrix-qux8dazq4ocaa Nexus5X-26 Completed instrumentation test.
  3m 46s matrix-qux8dazq4ocaa Nexus5X-26 Stopped performance monitoring.
  3m 46s matrix-qux8dazq4ocaa Nexus5X-25 Stopped performance monitoring.
  3m 46s matrix-qux8dazq4ocaa Nexus5X-25 Stopped crash monitoring.
  3m 46s matrix-qux8dazq4ocaa Nexus5X-25 Stopped logcat recording.
  3m 46s matrix-qux8dazq4ocaa Nexus5X-25 Retrieving Post-test Package Stats information from the device.
  3m 46s matrix-qux8dazq4ocaa Nexus5X-25 Done. Test time = 48 (secs)
  3m 46s matrix-qux8dazq4ocaa Nexus5X-25 Starting results processing. Attempt: 1
  4m  1s matrix-qux8dazq4ocaa Nexus5X-26 Stopped crash monitoring.
  4m  1s matrix-qux8dazq4ocaa Nexus5X-26 Stopped logcat recording.
  4m  1s matrix-qux8dazq4ocaa Nexus5X-26 Retrieving Post-test Package Stats information from the device.
  4m  1s matrix-qux8dazq4ocaa Nexus5X-26 Done. Test time = 68 (secs)
  4m  1s matrix-qux8dazq4ocaa Nexus5X-26 Starting results processing. Attempt: 1
  4m  1s matrix-qux8dazq4ocaa Nexus5X-26 Completed results processing. Time taken = 3 (secs)
  4m  1s matrix-qux8dazq4ocaa Nexus5X-26 FINISHED
  4m  1s matrix-qux8dazq4ocaa Nexus5X-25 Completed results processing. Time taken = 5 (secs)
  4m  1s matrix-qux8dazq4ocaa Nexus5X-25 FINISHED
  4m  1s matrix-qux8dazq4ocaa Pixel2-27 Completed instrumentation test.
  4m  1s matrix-qux8dazq4ocaa Pixel2-27 Stopped performance monitoring.
  4m 16s matrix-qux8dazq4ocaa Pixel2-27 Stopped crash monitoring.
  4m 16s matrix-qux8dazq4ocaa Pixel2-27 Stopped logcat recording.
  4m 16s matrix-qux8dazq4ocaa Pixel2-27 Retrieving Post-test Package Stats information from the device.
  4m 16s matrix-qux8dazq4ocaa Pixel2-27 Done. Test time = 81 (secs)
  4m 16s matrix-qux8dazq4ocaa Pixel2-27 Starting results processing. Attempt: 1
  4m 31s matrix-qux8dazq4ocaa Pixel2-27 Completed results processing. Time taken = 4 (secs)
  4m 31s matrix-qux8dazq4ocaa Pixel2-27 FINISHED
  4m 46s matrix-qux8dazq4ocaa Pixel2-28 Completed instrumentation test.
  4m 46s matrix-qux8dazq4ocaa Pixel2-28 Stopped performance monitoring.
  5m 16s matrix-qux8dazq4ocaa Pixel2-28 Stopped crash monitoring.
  5m 16s matrix-qux8dazq4ocaa Pixel2-28 Stopped logcat recording.
  5m 16s matrix-qux8dazq4ocaa Pixel2-28 Retrieving Post-test Package Stats information from the device.
  5m 16s matrix-qux8dazq4ocaa Pixel2-28 Done. Test time = 133 (secs)
  5m 16s matrix-qux8dazq4ocaa Pixel2-28 Starting results processing. Attempt: 1
  5m 16s matrix-qux8dazq4ocaa Pixel2-28 Completed results processing. Time taken = 5 (secs)
  5m 16s matrix-qux8dazq4ocaa Pixel2-28 FINISHED
  5m 16s matrix-qux8dazq4ocaa PENDING
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Starting attempt 1.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Started logcat recording.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Preparing device.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Installing apps.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Retrieving Pre-Test Package Stats information from the device.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Retrieving Performance Environment information from the device.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Started crash detection.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Started crash monitoring.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Started performance monitoring.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Starting instrumentation test.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Completed instrumentation test.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Stopped performance monitoring.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Stopped crash monitoring.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Stopped logcat recording.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 Retrieving Post-test Package Stats information from the device.
  5m 16s matrix-227skse2ct5kp Nexus5X-25 RUNNING
  5m 16s matrix-227skse2ct5kp Pixel2-28 Starting attempt 1.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Started logcat recording.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Preparing device.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Installing apps.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Retrieving Performance Environment information from the device.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Started crash detection.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Started performance monitoring.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Started crash monitoring.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Starting instrumentation test.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Completed instrumentation test.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Stopped performance monitoring.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Stopped crash monitoring.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Stopped logcat recording.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Retrieving Post-test Package Stats information from the device.
  5m 16s matrix-227skse2ct5kp Pixel2-28 Done. Test time = 116 (secs)
  5m 16s matrix-227skse2ct5kp Pixel2-28 Starting results processing. Attempt: 1
  5m 16s matrix-227skse2ct5kp Pixel2-28 Completed results processing. Time taken = 4 (secs)
  5m 16s matrix-227skse2ct5kp Pixel2-28 FINISHED
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Starting attempt 1.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Started logcat recording.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Preparing device.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Installing apps.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Retrieving Pre-Test Package Stats information from the device.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Retrieving Performance Environment information from the device.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Started crash detection.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Started crash monitoring.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Started performance monitoring.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Starting instrumentation test.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Completed instrumentation test.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Stopped performance monitoring.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Stopped crash monitoring.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Retrieving Post-test Package Stats information from the device.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Stopped logcat recording.
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Done. Test time = 79 (secs)
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Starting results processing. Attempt: 1
  5m 16s matrix-227skse2ct5kp Nexus5X-26 Completed results processing. Time taken = 3 (secs)
  5m 16s matrix-227skse2ct5kp Nexus5X-26 FINISHED
  5m 16s matrix-227skse2ct5kp Pixel2-27 Starting attempt 1.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Started logcat recording.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Preparing device.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Installing apps.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Retrieving Pre-Test Package Stats information from the device.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Retrieving Performance Environment information from the device.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Started crash detection.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Started crash monitoring.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Started performance monitoring.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Starting instrumentation test.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Completed instrumentation test.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Stopped performance monitoring.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Stopped crash monitoring.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Stopped logcat recording.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Retrieving Post-test Package Stats information from the device.
  5m 16s matrix-227skse2ct5kp Pixel2-27 Done. Test time = 89 (secs)
  5m 16s matrix-227skse2ct5kp Pixel2-27 Starting results processing. Attempt: 1
  5m 16s matrix-227skse2ct5kp Pixel2-27 Completed results processing. Time taken = 10 (secs)
  5m 16s matrix-227skse2ct5kp Pixel2-27 FINISHED
  9m 18s matrix-227skse2ct5kp Nexus5X-25 Done. Test time = 50 (secs)
  9m 18s matrix-227skse2ct5kp Nexus5X-25 Starting results processing. Attempt: 1
  9m 18s matrix-227skse2ct5kp Nexus5X-25 Completed results processing. Time taken = 4 (secs)
  9m 18s matrix-227skse2ct5kp Nexus5X-25 FINISHED
  9m 18s matrix-227skse2ct5kp FINISHED
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Starting attempt 1.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Started logcat recording.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Preparing device.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Installing apps.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Retrieving Pre-Test Package Stats information from the device.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Retrieving Performance Environment information from the device.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Started crash detection.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Started performance monitoring.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Started crash monitoring.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Starting instrumentation test.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Completed instrumentation test.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Stopped performance monitoring.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Stopped crash monitoring.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Stopped logcat recording.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Retrieving Post-test Package Stats information from the device.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Done. Test time = 48 (secs)
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Starting results processing. Attempt: 1
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 Completed results processing. Time taken = 4 (secs)
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-25 FINISHED
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Starting attempt 1.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Started logcat recording.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Preparing device.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Installing apps.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Retrieving Pre-Test Package Stats information from the device.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Retrieving Performance Environment information from the device.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Started crash detection.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Started performance monitoring.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Started crash monitoring.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Starting instrumentation test.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Completed instrumentation test.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Stopped performance monitoring.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Stopped crash monitoring.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Stopped logcat recording.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Retrieving Post-test Package Stats information from the device.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Done. Test time = 82 (secs)
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Starting results processing. Attempt: 1
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 Completed results processing. Time taken = 4 (secs)
  9m 18s matrix-9sog4kc8k2q4a Pixel2-27 FINISHED
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Starting attempt 1.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Started logcat recording.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Preparing device.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Installing apps.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Retrieving Pre-Test Package Stats information from the device.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Retrieving Performance Environment information from the device.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Started crash detection.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Started crash monitoring.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Started performance monitoring.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Starting instrumentation test.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Completed instrumentation test.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Stopped performance monitoring.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Stopped crash monitoring.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Stopped logcat recording.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Retrieving Post-test Package Stats information from the device.
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Done. Test time = 72 (secs)
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Starting results processing. Attempt: 1
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 Completed results processing. Time taken = 3 (secs)
  9m 18s matrix-9sog4kc8k2q4a Nexus5X-26 FINISHED
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Starting attempt 1.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Started logcat recording.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Preparing device.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Installing apps.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Retrieving Performance Environment information from the device.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Started crash detection.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Started crash monitoring.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Started performance monitoring.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Starting instrumentation test.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Completed instrumentation test.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Stopped performance monitoring.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Stopped crash monitoring.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Retrieving Post-test Package Stats information from the device.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Stopped logcat recording.
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Done. Test time = 153 (secs)
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Starting results processing. Attempt: 1
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 Completed results processing. Time taken = 5 (secs)
  9m 18s matrix-9sog4kc8k2q4a Pixel2-28 FINISHED
  9m 18s matrix-9sog4kc8k2q4a FINISHED
  9m 19s matrix-1b474eld41cha Nexus5X-26 Starting attempt 1.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Started logcat recording.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Preparing device.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Installing apps.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Retrieving Pre-Test Package Stats information from the device.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Retrieving Performance Environment information from the device.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Started crash detection.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Started performance monitoring.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Started crash monitoring.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Starting instrumentation test.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Completed instrumentation test.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Stopped performance monitoring.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Stopped crash monitoring.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Stopped logcat recording.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Retrieving Post-test Package Stats information from the device.
  9m 19s matrix-1b474eld41cha Nexus5X-26 Done. Test time = 72 (secs)
  9m 19s matrix-1b474eld41cha Nexus5X-26 Starting results processing. Attempt: 1
  9m 19s matrix-1b474eld41cha Nexus5X-26 Completed results processing. Time taken = 3 (secs)
  9m 19s matrix-1b474eld41cha Nexus5X-26 FINISHED
  9m 19s matrix-1b474eld41cha Pixel2-28 Starting attempt 1.
  9m 19s matrix-1b474eld41cha Pixel2-28 Started logcat recording.
  9m 19s matrix-1b474eld41cha Pixel2-28 Preparing device.
  9m 19s matrix-1b474eld41cha Pixel2-28 Installing apps.
  9m 19s matrix-1b474eld41cha Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  9m 19s matrix-1b474eld41cha Pixel2-28 Retrieving Performance Environment information from the device.
  9m 19s matrix-1b474eld41cha Pixel2-28 Started crash detection.
  9m 19s matrix-1b474eld41cha Pixel2-28 Started crash monitoring.
  9m 19s matrix-1b474eld41cha Pixel2-28 Started performance monitoring.
  9m 19s matrix-1b474eld41cha Pixel2-28 Starting instrumentation test.
  9m 19s matrix-1b474eld41cha Pixel2-28 Completed instrumentation test.
  9m 19s matrix-1b474eld41cha Pixel2-28 Stopped performance monitoring.
  9m 19s matrix-1b474eld41cha Pixel2-28 Stopped crash monitoring.
  9m 19s matrix-1b474eld41cha Pixel2-28 Retrieving Post-test Package Stats information from the device.
  9m 19s matrix-1b474eld41cha Pixel2-28 Stopped logcat recording.
  9m 19s matrix-1b474eld41cha Pixel2-28 Done. Test time = 113 (secs)
  9m 19s matrix-1b474eld41cha Pixel2-28 Starting results processing. Attempt: 1
  9m 19s matrix-1b474eld41cha Pixel2-28 Completed results processing. Time taken = 4 (secs)
  9m 19s matrix-1b474eld41cha Pixel2-28 FINISHED
  9m 19s matrix-1b474eld41cha Pixel2-27 Starting attempt 1.
  9m 19s matrix-1b474eld41cha Pixel2-27 Started logcat recording.
  9m 19s matrix-1b474eld41cha Pixel2-27 Preparing device.
  9m 19s matrix-1b474eld41cha Pixel2-27 Installing apps.
  9m 19s matrix-1b474eld41cha Pixel2-27 Retrieving Pre-Test Package Stats information from the device.
  9m 19s matrix-1b474eld41cha Pixel2-27 Retrieving Performance Environment information from the device.
  9m 19s matrix-1b474eld41cha Pixel2-27 Started crash detection.
  9m 19s matrix-1b474eld41cha Pixel2-27 Started crash monitoring.
  9m 19s matrix-1b474eld41cha Pixel2-27 Started performance monitoring.
  9m 19s matrix-1b474eld41cha Pixel2-27 Starting instrumentation test.
  9m 19s matrix-1b474eld41cha Pixel2-27 Completed instrumentation test.
  9m 19s matrix-1b474eld41cha Pixel2-27 Stopped performance monitoring.
  9m 19s matrix-1b474eld41cha Pixel2-27 Stopped crash monitoring.
  9m 19s matrix-1b474eld41cha Pixel2-27 Retrieving Post-test Package Stats information from the device.
  9m 19s matrix-1b474eld41cha Pixel2-27 Stopped logcat recording.
  9m 19s matrix-1b474eld41cha Pixel2-27 Done. Test time = 79 (secs)
  9m 19s matrix-1b474eld41cha Pixel2-27 Starting results processing. Attempt: 1
  9m 19s matrix-1b474eld41cha Pixel2-27 Completed results processing. Time taken = 4 (secs)
  9m 19s matrix-1b474eld41cha Pixel2-27 FINISHED
  9m 19s matrix-1b474eld41cha Nexus5X-25 Starting attempt 1.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Started logcat recording.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Preparing device.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Installing apps.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Retrieving Pre-Test Package Stats information from the device.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Retrieving Performance Environment information from the device.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Started crash detection.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Started performance monitoring.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Started crash monitoring.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Starting instrumentation test.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Completed instrumentation test.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Stopped performance monitoring.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Stopped crash monitoring.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Stopped logcat recording.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Retrieving Post-test Package Stats information from the device.
  9m 19s matrix-1b474eld41cha Nexus5X-25 Done. Test time = 50 (secs)
  9m 19s matrix-1b474eld41cha Nexus5X-25 Starting results processing. Attempt: 1
  9m 19s matrix-1b474eld41cha Nexus5X-25 Completed results processing. Time taken = 5 (secs)
  9m 19s matrix-1b474eld41cha Nexus5X-25 FINISHED
  9m 19s matrix-1b474eld41cha FINISHED
FetchArtifacts
  ............
  Updating matrix file
CostReport
  Virtual devices
    $0.37 for 22m
MatrixResultsReport
  1 / 4 (25.00%)
  3 matrices failed
  matrix-227skse2ct5kp 
  https://console.firebase.google.com/project/orion-labs/testlab/histories/bh.e8c1c7141603d848/matrices/5027917751868811800
  matrix-9sog4kc8k2q4a 
  https://console.firebase.google.com/project/orion-labs/testlab/histories/bh.e8c1c7141603d848/matrices/7971171289900438288
  matrix-1b474eld41cha 
  https://console.firebase.google.com/project/orion-labs/testlab/histories/bh.e8c1c7141603d848/matrices/5986142041159178838
Actual shard times:
  Shard 0: Expected: 301s, Actual: 0s, Diff: -301s
  Shard 1: Expected: 302s, Actual: 302s, Diff: 0s
  Shard 2: Expected: 302s, Actual: 302s, Diff: 0s
  Shard 3: Expected: 302s, Actual: 302s, Diff: 0s
  Uploading smart flank XML .
Then build fails
> Task :app:execFlank FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':app:execFlank'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 2
* Try:
Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Exception is:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':app:execFlank'.
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$3.accept(ExecuteActionsTaskExecuter.java:151)
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$3.accept(ExecuteActionsTaskExecuter.java:148)
	at org.gradle.internal.Try$Failure.ifSuccessfulOrElse(Try.java:191)
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:141)
	at org.gradle.api.internal.tasks.execution.ResolveBeforeExecutionStateTaskExecuter.execute(ResolveBeforeExecutionStateTaskExecuter.java:75)
	at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:62)
	at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:108)
	at org.gradle.api.internal.tasks.execution.ResolveBeforeExecutionOutputsTaskExecuter.execute(ResolveBeforeExecutionOutputsTaskExecuter.java:67)
	at org.gradle.api.internal.tasks.execution.ResolveAfterPreviousExecutionStateTaskExecuter.execute(ResolveAfterPreviousExecutionStateTaskExecuter.java:46)
	at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:94)
	at org.gradle.api.internal.tasks.execution.FinalizePropertiesTaskExecuter.execute(FinalizePropertiesTaskExecuter.java:46)
	at org.gradle.api.internal.tasks.execution.ResolveTaskExecutionModeExecuter.execute(ResolveTaskExecutionModeExecuter.java:95)
	at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:57)
	at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:56)
	at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:36)
	at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.executeTask(EventFiringTaskExecuter.java:73)
	at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.call(EventFiringTaskExecuter.java:52)
	at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.call(EventFiringTaskExecuter.java:49)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$CallableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:416)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$CallableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:406)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$1.execute(DefaultBuildOperationExecutor.java:165)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:250)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:158)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.call(DefaultBuildOperationExecutor.java:102)
	at org.gradle.internal.operations.DelegatingBuildOperationExecutor.call(DelegatingBuildOperationExecutor.java:36)
	at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:49)
	at org.gradle.execution.plan.LocalTaskNodeExecutor.execute(LocalTaskNodeExecutor.java:43)
	at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$InvokeNodeExecutorsAction.execute(DefaultTaskExecutionGraph.java:355)
	at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$InvokeNodeExecutorsAction.execute(DefaultTaskExecutionGraph.java:343)
	at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareExecutionAction.execute(DefaultTaskExecutionGraph.java:336)
	at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareExecutionAction.execute(DefaultTaskExecutionGraph.java:322)
	at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker$1.execute(DefaultPlanExecutor.java:134)
	at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker$1.execute(DefaultPlanExecutor.java:129)
	at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker.execute(DefaultPlanExecutor.java:202)
	at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker.executeNextNode(DefaultPlanExecutor.java:193)
	at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker.run(DefaultPlanExecutor.java:129)
	at org.gradle.execution.plan.DefaultPlanExecutor.process(DefaultPlanExecutor.java:74)
	at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph.executeWithServices(DefaultTaskExecutionGraph.java:178)
	at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph.execute(DefaultTaskExecutionGraph.java:154)
	at org.gradle.execution.SelectedTaskExecutionAction.execute(SelectedTaskExecutionAction.java:41)
	at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:40)
	at org.gradle.execution.DefaultBuildExecuter.access$000(DefaultBuildExecuter.java:24)
	at org.gradle.execution.DefaultBuildExecuter$1.proceed(DefaultBuildExecuter.java:46)
	at org.gradle.execution.DryRunBuildExecutionAction.execute(DryRunBuildExecutionAction.java:49)
	at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:40)
	at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:33)
	at org.gradle.initialization.DefaultGradleLauncher$ExecuteTasks.run(DefaultGradleLauncher.java:383)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:402)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:394)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$1.execute(DefaultBuildOperationExecutor.java:165)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:250)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:158)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:92)
	at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
	at org.gradle.initialization.DefaultGradleLauncher.runTasks(DefaultGradleLauncher.java:247)
	at org.gradle.initialization.DefaultGradleLauncher.doBuildStages(DefaultGradleLauncher.java:159)
	at org.gradle.initialization.DefaultGradleLauncher.executeTasks(DefaultGradleLauncher.java:134)
	at org.gradle.internal.invocation.GradleBuildController$1.execute(GradleBuildController.java:58)
	at org.gradle.internal.invocation.GradleBuildController$1.execute(GradleBuildController.java:55)
	at org.gradle.internal.invocation.GradleBuildController$3.create(GradleBuildController.java:82)
	at org.gradle.internal.invocation.GradleBuildController$3.create(GradleBuildController.java:75)
	at org.gradle.internal.work.DefaultWorkerLeaseService.withLocks(DefaultWorkerLeaseService.java:183)
	at org.gradle.internal.work.StopShieldingWorkerLeaseService.withLocks(StopShieldingWorkerLeaseService.java:40)
	at org.gradle.internal.invocation.GradleBuildController.doBuild(GradleBuildController.java:75)
	at org.gradle.internal.invocation.GradleBuildController.run(GradleBuildController.java:55)
	at org.gradle.tooling.internal.provider.ExecuteBuildActionRunner.run(ExecuteBuildActionRunner.java:31)
	at org.gradle.launcher.exec.ChainingBuildActionRunner.run(ChainingBuildActionRunner.java:35)
	at org.gradle.launcher.exec.BuildOutcomeReportingBuildActionRunner.run(BuildOutcomeReportingBuildActionRunner.java:58)
	at org.gradle.tooling.internal.provider.ValidatingBuildActionRunner.run(ValidatingBuildActionRunner.java:32)
	at org.gradle.launcher.exec.BuildCompletionNotifyingBuildActionRunner.run(BuildCompletionNotifyingBuildActionRunner.java:39)
	at org.gradle.launcher.exec.RunAsBuildOperationBuildActionRunner$3.call(RunAsBuildOperationBuildActionRunner.java:51)
	at org.gradle.launcher.exec.RunAsBuildOperationBuildActionRunner$3.call(RunAsBuildOperationBuildActionRunner.java:45)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$CallableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:416)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$CallableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:406)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$1.execute(DefaultBuildOperationExecutor.java:165)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:250)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:158)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.call(DefaultBuildOperationExecutor.java:102)
	at org.gradle.internal.operations.DelegatingBuildOperationExecutor.call(DelegatingBuildOperationExecutor.java:36)
	at org.gradle.launcher.exec.RunAsBuildOperationBuildActionRunner.run(RunAsBuildOperationBuildActionRunner.java:45)
	at org.gradle.launcher.exec.InProcessBuildActionExecuter$1.transform(InProcessBuildActionExecuter.java:49)
	at org.gradle.launcher.exec.InProcessBuildActionExecuter$1.transform(InProcessBuildActionExecuter.java:46)
	at org.gradle.composite.internal.DefaultRootBuildState.run(DefaultRootBuildState.java:78)
	at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:46)
	at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:31)
	at org.gradle.launcher.exec.BuildTreeScopeBuildActionExecuter.execute(BuildTreeScopeBuildActionExecuter.java:42)
	at org.gradle.launcher.exec.BuildTreeScopeBuildActionExecuter.execute(BuildTreeScopeBuildActionExecuter.java:28)
	at org.gradle.tooling.internal.provider.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:78)
	at org.gradle.tooling.internal.provider.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:52)
	at org.gradle.tooling.internal.provider.SubscribableBuildActionExecuter.execute(SubscribableBuildActionExecuter.java:59)
	at org.gradle.tooling.internal.provider.SubscribableBuildActionExecuter.execute(SubscribableBuildActionExecuter.java:36)
	at org.gradle.tooling.internal.provider.SessionScopeBuildActionExecuter.execute(SessionScopeBuildActionExecuter.java:68)
	at org.gradle.tooling.internal.provider.SessionScopeBuildActionExecuter.execute(SessionScopeBuildActionExecuter.java:38)
	at org.gradle.tooling.internal.provider.GradleThreadBuildActionExecuter.execute(GradleThreadBuildActionExecuter.java:37)
	at org.gradle.tooling.internal.provider.GradleThreadBuildActionExecuter.execute(GradleThreadBuildActionExecuter.java:26)
	at org.gradle.tooling.internal.provider.ParallelismConfigurationBuildActionExecuter.execute(ParallelismConfigurationBuildActionExecuter.java:43)
	at org.gradle.tooling.internal.provider.ParallelismConfigurationBuildActionExecuter.execute(ParallelismConfigurationBuildActionExecuter.java:29)
	at org.gradle.tooling.internal.provider.StartParamsValidatingActionExecuter.execute(StartParamsValidatingActionExecuter.java:60)
	at org.gradle.tooling.internal.provider.StartParamsValidatingActionExecuter.execute(StartParamsValidatingActionExecuter.java:32)
	at org.gradle.tooling.internal.provider.SessionFailureReportingActionExecuter.execute(SessionFailureReportingActionExecuter.java:55)
	at org.gradle.tooling.internal.provider.SessionFailureReportingActionExecuter.execute(SessionFailureReportingActionExecuter.java:41)
	at org.gradle.tooling.internal.provider.SetupLoggingActionExecuter.execute(SetupLoggingActionExecuter.java:48)
	at org.gradle.tooling.internal.provider.SetupLoggingActionExecuter.execute(SetupLoggingActionExecuter.java:32)
	at org.gradle.launcher.daemon.server.exec.ExecuteBuild.doBuild(ExecuteBuild.java:67)
	at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:36)
	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
	at org.gradle.launcher.daemon.server.exec.WatchForDisconnection.execute(WatchForDisconnection.java:37)
	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
	at org.gradle.launcher.daemon.server.exec.ResetDeprecationLogger.execute(ResetDeprecationLogger.java:26)
	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
	at org.gradle.launcher.daemon.server.exec.RequestStopIfSingleUsedDaemon.execute(RequestStopIfSingleUsedDaemon.java:34)
	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
	at org.gradle.launcher.daemon.server.exec.ForwardClientInput$2.call(ForwardClientInput.java:74)
	at org.gradle.launcher.daemon.server.exec.ForwardClientInput$2.call(ForwardClientInput.java:72)
	at org.gradle.util.Swapper.swap(Swapper.java:38)
	at org.gradle.launcher.daemon.server.exec.ForwardClientInput.execute(ForwardClientInput.java:72)
	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
	at org.gradle.launcher.daemon.server.exec.LogAndCheckHealth.execute(LogAndCheckHealth.java:50)
	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
	at org.gradle.launcher.daemon.server.exec.LogToClient.doBuild(LogToClient.java:62)
	at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:36)
	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
	at org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment.doBuild(EstablishBuildEnvironment.java:81)
	at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:36)
	at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:104)
	at org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy$1.run(StartBuildOrRespondWithBusy.java:50)
	at org.gradle.launcher.daemon.server.DaemonStateCoordinator$1.run(DaemonStateCoordinator.java:295)
	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
	at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
	at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
Caused by: org.gradle.process.internal.ExecException: Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 2
	at org.gradle.process.internal.DefaultExecHandle$ExecResultImpl.assertNormalExitValue(DefaultExecHandle.java:396)
	at org.gradle.process.internal.DefaultJavaExecAction.execute(DefaultJavaExecAction.java:38)
	at org.gradle.api.tasks.JavaExec.exec(JavaExec.java:81)
	at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:103)
	at org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:48)
	at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:41)
	at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:28)
	at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:702)
	at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:669)
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$5.run(ExecuteActionsTaskExecuter.java:404)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:402)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:394)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor$1.execute(DefaultBuildOperationExecutor.java:165)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:250)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:158)
	at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:92)
	at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:393)
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:376)
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.access$200(ExecuteActionsTaskExecuter.java:80)
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution.execute(ExecuteActionsTaskExecuter.java:213)
	at org.gradle.internal.execution.steps.ExecuteStep.lambda$execute$1(ExecuteStep.java:33)
	at org.gradle.internal.execution.steps.ExecuteStep.execute(ExecuteStep.java:33)
	at org.gradle.internal.execution.steps.ExecuteStep.execute(ExecuteStep.java:26)
	at org.gradle.internal.execution.steps.CleanupOutputsStep.execute(CleanupOutputsStep.java:58)
	at org.gradle.internal.execution.steps.CleanupOutputsStep.execute(CleanupOutputsStep.java:35)
	at org.gradle.internal.execution.steps.ResolveInputChangesStep.execute(ResolveInputChangesStep.java:48)
	at org.gradle.internal.execution.steps.ResolveInputChangesStep.execute(ResolveInputChangesStep.java:33)
	at org.gradle.internal.execution.steps.CancelExecutionStep.execute(CancelExecutionStep.java:39)
	at org.gradle.internal.execution.steps.TimeoutStep.executeWithoutTimeout(TimeoutStep.java:73)
	at org.gradle.internal.execution.steps.TimeoutStep.execute(TimeoutStep.java:54)
	at org.gradle.internal.execution.steps.CatchExceptionStep.execute(CatchExceptionStep.java:35)
	at org.gradle.internal.execution.steps.CreateOutputsStep.execute(CreateOutputsStep.java:51)
	at org.gradle.internal.execution.steps.SnapshotOutputsStep.execute(SnapshotOutputsStep.java:45)
	at org.gradle.internal.execution.steps.SnapshotOutputsStep.execute(SnapshotOutputsStep.java:31)
	at org.gradle.internal.execution.steps.CacheStep.executeWithoutCache(CacheStep.java:201)
	at org.gradle.internal.execution.steps.CacheStep.execute(CacheStep.java:70)
	at org.gradle.internal.execution.steps.CacheStep.execute(CacheStep.java:45)
	at org.gradle.internal.execution.steps.BroadcastChangingOutputsStep.execute(BroadcastChangingOutputsStep.java:49)
	at org.gradle.internal.execution.steps.StoreSnapshotsStep.execute(StoreSnapshotsStep.java:43)
	at org.gradle.internal.execution.steps.StoreSnapshotsStep.execute(StoreSnapshotsStep.java:32)
	at org.gradle.internal.execution.steps.RecordOutputsStep.execute(RecordOutputsStep.java:38)
	at org.gradle.internal.execution.steps.RecordOutputsStep.execute(RecordOutputsStep.java:24)
	at org.gradle.internal.execution.steps.SkipUpToDateStep.executeBecause(SkipUpToDateStep.java:96)
	at org.gradle.internal.execution.steps.SkipUpToDateStep.lambda$execute$0(SkipUpToDateStep.java:89)
	at org.gradle.internal.execution.steps.SkipUpToDateStep.execute(SkipUpToDateStep.java:54)
	at org.gradle.internal.execution.steps.SkipUpToDateStep.execute(SkipUpToDateStep.java:38)
	at org.gradle.internal.execution.steps.ResolveChangesStep.execute(ResolveChangesStep.java:77)
	at org.gradle.internal.execution.steps.ResolveChangesStep.execute(ResolveChangesStep.java:37)
	at org.gradle.internal.execution.steps.legacy.MarkSnapshottingInputsFinishedStep.execute(MarkSnapshottingInputsFinishedStep.java:36)
	at org.gradle.internal.execution.steps.legacy.MarkSnapshottingInputsFinishedStep.execute(MarkSnapshottingInputsFinishedStep.java:26)
	at org.gradle.internal.execution.steps.ResolveCachingStateStep.execute(ResolveCachingStateStep.java:90)
	at org.gradle.internal.execution.steps.ResolveCachingStateStep.execute(ResolveCachingStateStep.java:48)
	at org.gradle.internal.execution.impl.DefaultWorkExecutor.execute(DefaultWorkExecutor.java:33)
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:120)
	... 126 more
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.4.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 15m 25s
260 actionable tasks: 260 executed
Gradle task failed, error: exit status 1

There is no reference to flank in the stacktrace so I'm not sure what is going wrong. I'm not 100% this is flank/fladle related but thought I'd post in case others are seeing this issue.

Setup:

app build.gradle:

fladle {
    flankVersion("7.0.1")
    projectId("XXX")
    serviceAccountCredentials("${project.file("firebase-test-lab-service-account.json")}")
    useOrchestrator = true
    smartFlankGcsPath = "gs://test-lab-XXXX/flank/flank_android.xml"
    testShards = 4
    recordVideo = false
    timeoutMin = 30
    devices = [
            new Device("Pixel2", 28, null, null),
            new Device("Pixel2", 27, null, null),
            new Device("Nexus5X", 26, null, null),
            new Device("Nexus5X", 25, null, null)
    ]
    environmentVariables = [
            "clearPackageData": "true"
    ]
}

root build.gradle:

        classpath "gradle.plugin.com.osacky.flank.gradle:fladle:0.6.6"

Invalid YAML when providing projectId

I just updated to Flank v5.1.0 and Fladle v0.6.0
In our fladle config in build.gradle we had
projectId("our-project-id")

Flank did not like the YAML that was generated:

Exception in thread "main" picocli.CommandLine$ExecutionException: Error while running command (ftl.cli.firebase.test.android.AndroidRunCommand@45afc369): com.fasterxml.jackson.dataformat.yaml.snakeyaml.error.MarkedYAMLException: mapping values are not allowed here
 in 'reader', line 21, column 12:
        project: our-project-id

I think it might have to do with indentation because the line with project: our-project-id in the generated flank.yml was indented more than it should.

As a workaround I removed projectId("our-project-id") from our fladle config.
fladle still discovers the project id from the service account credentials.
The YAML generated this time was valid and everything worked again.

Automatic APK detection not working

Unfortunately the APK detection is not working for me. I have a simple sample project with AGP 3.3.0 and Gradle 4.10.1. Once fladle tries to derive the APK automatically it fails with: Could not find AppExtension in app

Here is the stacktrace:

Caused by: java.lang.IllegalArgumentException: Could not find AppExtension in app
        at com.osacky.flank.gradle.FlankGradlePlugin.findDebugAndInstrumentationApk(FlankGradlePlugin.kt:97)
        at com.osacky.flank.gradle.FlankGradlePlugin.access$findDebugAndInstrumentationApk(FlankGradlePlugin.kt:13)
        at com.osacky.flank.gradle.FlankGradlePlugin$configureTasks$2$1.execute(FlankGradlePlugin.kt:43)
        at com.osacky.flank.gradle.FlankGradlePlugin$configureTasks$2$1.execute(FlankGradlePlugin.kt:13)
        at org.gradle.api.internal.plugins.DefaultPluginManager$3.execute(DefaultPluginManager.java:240)
        at org.gradle.api.internal.plugins.DefaultPluginManager$3.execute(DefaultPluginManager.java:238)
        at org.gradle.api.internal.DefaultDomainObjectCollection.all(DefaultDomainObjectCollection.java:158)
        at org.gradle.api.internal.plugins.DefaultPluginManager.withPlugin(DefaultPluginManager.java:243)
        at com.osacky.flank.gradle.FlankGradlePlugin$configureTasks$2.execute(FlankGradlePlugin.kt:41)

I tried applying the Android plugin before and after applying fladle. But nothing worked.

can't find debugApk despite being configured manually

When I "runFlank", it complains that "buildApk cannot be null". Autodetection failed (would be nice to have autodetection print out where it's looking).
So I specified the paths directly.

app build.config looks like (also tried moving this into the root build.gradle but that didn't work either):

// command line: gradle clean assembleKayakFreeDebug assembleKayakFreeAndroidTest runFlank
apply plugin: "com.osacky.fladle"
fladle {
    serviceAccountCredentials("${project.file("flank-gradle-service-account.json")}")
    directoriesToPull = [
            "/sdcard/screenshots"
    ]
    filesToDownload = [
            ".*/screenshots/.*"
    ]
    testTargets = [
            "class com.kayak.android.BasicLoginTest",
            "class com.kayak.android.BasicSearchTest"
    ]
    debugApk("$buildDir/outputs/apk/kayakFree/debug/KAYAK-kayakFree-debug-9999.0-9999.apk")
    instrumentationApk("$buildDir/outputs/apk/androidTest/kayakFree/debug/KayakTravelApp-kayakFree-debug-androidTest.apk")
}

Test matrices pass, but flank fails

Hi, we're seeing some flaky behavior from flank/fladle in our CI. Sometimes, all matrices are reported to have passed, but the flank process exits with a non-zero status code and tanks the build. Rebuilding the project succeeds, usually.

Any idea what we could do to debug this? It's not clear from the output what, if anything, is actually wrong.

Gradle output

> Task :app:execFlank
Picked up JAVA_TOOL_OPTIONS: -Xmx1g
AndroidArgs
    gcloud:
      results-bucket: test-lab-ysvv7d00td10a-hppdbavjfw5v2
      results-dir: null
      record-video: true
      timeout: 20m
      async: false
      results-history-name: null
      # Android gcloud
      app: /home/circleci/project/app/build/outputs/apk/debug/app-debug.apk
      test: /home/circleci/project/app/build/outputs/apk/androidTest/debug/app-debug-androidTest.apk
      auto-google-login: false
      use-orchestrator: true
      directories-to-pull:

      performance-metrics: true
      test-runner-class: null
      test-targets:

      device:
        - model: Pixel2
          version: 28
          locale: en_US
          orientation: portrait
      flaky-test-attempts: 0

    flank:
      max-test-shards: 30
      shard-time: -1
      repeat-tests: 1
      smart-flank-gcs-path: 
      smart-flank-disable-upload: false
      files-to-download:

      test-targets-always-run:

      disable-sharding: false
      project: app-ae416
      local-result-dir: results
      # Android Flank Yml
      additional-app-test-apks:

RunTests
  Uploading app-debug-androidTest.apk .  Uploading app-debug.apk .


  Smart Flank cache hit: 0% (0 / 389)
  Shard times: 120s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s, 130s

  389 tests / 30 shards

  30 matrix ids created in 0m 7s
  <bucket url>

PollMatrices
  0m  0s matrix-f88t4kmt0fhaa Pixel2-28 VALIDATING
  0m 45s matrix-f88t4kmt0fhaa Pixel2-28 PENDING
  1m 31s matrix-f88t4kmt0fhaa Pixel2-28 Starting attempt 1.
  1m 31s matrix-f88t4kmt0fhaa Pixel2-28 RUNNING
  2m 32s matrix-f88t4kmt0fhaa Pixel2-28 Started logcat recording.
  2m 32s matrix-f88t4kmt0fhaa Pixel2-28 Preparing device.
  3m  2s matrix-f88t4kmt0fhaa Pixel2-28 Installing apps.
  3m 18s matrix-f88t4kmt0fhaa Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  3m 18s matrix-f88t4kmt0fhaa Pixel2-28 Retrieving Performance Environment information from the device.
  3m 18s matrix-f88t4kmt0fhaa Pixel2-28 Started crash detection.
  3m 18s matrix-f88t4kmt0fhaa Pixel2-28 Started crash monitoring.
  3m 18s matrix-f88t4kmt0fhaa Pixel2-28 Started performance monitoring.
  3m 18s matrix-f88t4kmt0fhaa Pixel2-28 Started video recording.
  3m 18s matrix-f88t4kmt0fhaa Pixel2-28 Starting instrumentation test.
  5m 33s matrix-f88t4kmt0fhaa Pixel2-28 Completed instrumentation test.
  5m 33s matrix-f88t4kmt0fhaa Pixel2-28 Stopped performance monitoring.
  6m  4s matrix-f88t4kmt0fhaa Pixel2-28 Stopped crash monitoring.
  6m  4s matrix-f88t4kmt0fhaa Pixel2-28 Stopped logcat recording.
  6m  4s matrix-f88t4kmt0fhaa Pixel2-28 Retrieving Post-test Package Stats information from the device.
  6m  4s matrix-f88t4kmt0fhaa Pixel2-28 Done. Test time = 132 (secs)
  6m  4s matrix-f88t4kmt0fhaa Pixel2-28 Starting results processing. Attempt: 1
  6m 20s matrix-f88t4kmt0fhaa Pixel2-28 Completed results processing. Time taken = 11 (secs)
  6m 20s matrix-f88t4kmt0fhaa Pixel2-28 FINISHED
  6m 20s matrix-f88t4kmt0fhaa FINISHED
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Starting attempt 1.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Started logcat recording.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Preparing device.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Installing apps.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Retrieving Performance Environment information from the device.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Started crash detection.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Started crash monitoring.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Started performance monitoring.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Started video recording.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Starting instrumentation test.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Completed instrumentation test.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 Stopped performance monitoring.
  6m 20s matrix-bl70fygtj6zla Pixel2-28 RUNNING
  6m 50s matrix-bl70fygtj6zla Pixel2-28 Stopped crash monitoring.
  6m 50s matrix-bl70fygtj6zla Pixel2-28 Retrieving Post-test Package Stats information from the device.
  6m 50s matrix-bl70fygtj6zla Pixel2-28 Stopped logcat recording.
  6m 50s matrix-bl70fygtj6zla Pixel2-28 Done. Test time = 166 (secs)
  6m 50s matrix-bl70fygtj6zla Pixel2-28 Starting results processing. Attempt: 1
  6m 50s matrix-bl70fygtj6zla Pixel2-28 Completed results processing. Time taken = 11 (secs)
  6m 50s matrix-bl70fygtj6zla Pixel2-28 FINISHED
  6m 50s matrix-bl70fygtj6zla PENDING
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Starting attempt 1.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Started logcat recording.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Preparing device.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Installing apps.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Retrieving Performance Environment information from the device.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Started crash detection.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Started crash monitoring.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Started performance monitoring.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Started video recording.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Starting instrumentation test.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Completed instrumentation test.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 Stopped performance monitoring.
  6m 50s matrix-37kmr3c6f8e32 Pixel2-28 RUNNING
  7m  5s matrix-37kmr3c6f8e32 Pixel2-28 Stopped crash monitoring.
  7m  5s matrix-37kmr3c6f8e32 Pixel2-28 Stopped logcat recording.
  7m  5s matrix-37kmr3c6f8e32 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m  5s matrix-37kmr3c6f8e32 Pixel2-28 Done. Test time = 200 (secs)
  7m  5s matrix-37kmr3c6f8e32 Pixel2-28 Starting results processing. Attempt: 1
  7m 21s matrix-37kmr3c6f8e32 Pixel2-28 Completed results processing. Time taken = 11 (secs)
  7m 21s matrix-37kmr3c6f8e32 Pixel2-28 FINISHED
  7m 21s matrix-37kmr3c6f8e32 FINISHED
  7m 21s matrix-8dxthyvybquna Pixel2-28 Starting attempt 1.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Started logcat recording.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Preparing device.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Installing apps.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Retrieving Performance Environment information from the device.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Started crash detection.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Started performance monitoring.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Started crash monitoring.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Started video recording.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Starting instrumentation test.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Completed instrumentation test.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Stopped performance monitoring.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Stopped crash monitoring.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Stopped logcat recording.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 21s matrix-8dxthyvybquna Pixel2-28 Done. Test time = 175 (secs)
  7m 21s matrix-8dxthyvybquna Pixel2-28 Starting results processing. Attempt: 1
  7m 21s matrix-8dxthyvybquna Pixel2-28 Completed results processing. Time taken = 10 (secs)
  7m 21s matrix-8dxthyvybquna Pixel2-28 FINISHED
  7m 21s matrix-8dxthyvybquna FINISHED
  7m 22s matrix-3jglg60p1485w Pixel2-28 Starting attempt 1.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Started logcat recording.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Preparing device.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Installing apps.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Retrieving Performance Environment information from the device.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Started crash detection.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Started crash monitoring.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Started performance monitoring.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Started video recording.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Starting instrumentation test.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Completed instrumentation test.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Stopped performance monitoring.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Stopped crash monitoring.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Stopped logcat recording.
  7m 22s matrix-3jglg60p1485w Pixel2-28 Done. Test time = 180 (secs)
  7m 22s matrix-3jglg60p1485w Pixel2-28 Starting results processing. Attempt: 1
  7m 22s matrix-3jglg60p1485w Pixel2-28 Completed results processing. Time taken = 11 (secs)
  7m 22s matrix-3jglg60p1485w Pixel2-28 FINISHED
  7m 22s matrix-3jglg60p1485w FINISHED
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Starting attempt 1.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Started logcat recording.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Preparing device.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Installing apps.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Retrieving Performance Environment information from the device.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Started crash detection.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Started performance monitoring.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Started crash monitoring.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Started video recording.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Starting instrumentation test.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Completed instrumentation test.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Stopped performance monitoring.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Stopped crash monitoring.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Stopped logcat recording.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Done. Test time = 166 (secs)
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Starting results processing. Attempt: 1
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 Completed results processing. Time taken = 11 (secs)
  7m 22s matrix-1jjpnoxqjp62l Pixel2-28 FINISHED
  7m 22s matrix-1jjpnoxqjp62l FINISHED
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Starting attempt 1.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Started logcat recording.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Preparing device.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Installing apps.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Retrieving Performance Environment information from the device.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Started crash detection.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Started crash monitoring.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Started performance monitoring.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Started video recording.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Starting instrumentation test.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Completed instrumentation test.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Stopped performance monitoring.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Stopped crash monitoring.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Stopped logcat recording.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Done. Test time = 152 (secs)
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Starting results processing. Attempt: 1
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 23s matrix-22g4mj42dxnrd Pixel2-28 FINISHED
  7m 23s matrix-22g4mj42dxnrd FINISHED
  7m 23s matrix-ercommuadp4aa Pixel2-28 Starting attempt 1.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Started logcat recording.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Preparing device.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Installing apps.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Retrieving Performance Environment information from the device.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Started crash detection.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Started performance monitoring.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Started crash monitoring.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Started video recording.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Starting instrumentation test.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Completed instrumentation test.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Stopped performance monitoring.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Stopped crash monitoring.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Stopped logcat recording.
  7m 23s matrix-ercommuadp4aa Pixel2-28 Done. Test time = 131 (secs)
  7m 23s matrix-ercommuadp4aa Pixel2-28 Starting results processing. Attempt: 1
  7m 23s matrix-ercommuadp4aa Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 23s matrix-ercommuadp4aa Pixel2-28 FINISHED
  7m 23s matrix-ercommuadp4aa FINISHED
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Starting attempt 1.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Started logcat recording.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Preparing device.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Installing apps.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Retrieving Performance Environment information from the device.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Started crash detection.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Started performance monitoring.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Started crash monitoring.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Started video recording.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Starting instrumentation test.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Completed instrumentation test.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Stopped performance monitoring.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Stopped crash monitoring.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Stopped logcat recording.
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Done. Test time = 152 (secs)
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Starting results processing. Attempt: 1
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 Completed results processing. Time taken = 10 (secs)
  7m 23s matrix-161ng2wpsmxyk Pixel2-28 FINISHED
  7m 23s matrix-161ng2wpsmxyk FINISHED
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Starting attempt 1.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Started logcat recording.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Preparing device.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Installing apps.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Retrieving Performance Environment information from the device.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Started crash detection.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Started performance monitoring.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Started crash monitoring.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Started video recording.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Starting instrumentation test.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Completed instrumentation test.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Stopped performance monitoring.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Stopped crash monitoring.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Stopped logcat recording.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Done. Test time = 132 (secs)
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Starting results processing. Attempt: 1
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 24s matrix-2hdlxiv9c6lrj Pixel2-28 FINISHED
  7m 24s matrix-2hdlxiv9c6lrj FINISHED
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Starting attempt 1.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Started logcat recording.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Preparing device.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Installing apps.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Retrieving Performance Environment information from the device.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Started crash detection.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Started crash monitoring.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Started performance monitoring.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Started video recording.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Starting instrumentation test.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Completed instrumentation test.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Stopped performance monitoring.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Stopped crash monitoring.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Stopped logcat recording.
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Done. Test time = 161 (secs)
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Starting results processing. Attempt: 1
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 Completed results processing. Time taken = 10 (secs)
  7m 24s matrix-1jzvaawt57tg4 Pixel2-28 FINISHED
  7m 24s matrix-1jzvaawt57tg4 FINISHED
  7m 25s matrix-60veg8z79b5va Pixel2-28 Starting attempt 1.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Started logcat recording.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Preparing device.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Installing apps.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Retrieving Performance Environment information from the device.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Started crash detection.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Started performance monitoring.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Started crash monitoring.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Started video recording.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Starting instrumentation test.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Completed instrumentation test.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Stopped performance monitoring.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Stopped crash monitoring.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Stopped logcat recording.
  7m 25s matrix-60veg8z79b5va Pixel2-28 Done. Test time = 163 (secs)
  7m 25s matrix-60veg8z79b5va Pixel2-28 Starting results processing. Attempt: 1
  7m 25s matrix-60veg8z79b5va Pixel2-28 Completed results processing. Time taken = 11 (secs)
  7m 25s matrix-60veg8z79b5va Pixel2-28 FINISHED
  7m 25s matrix-60veg8z79b5va FINISHED
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Starting attempt 1.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Started logcat recording.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Preparing device.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Installing apps.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Retrieving Performance Environment information from the device.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Started crash detection.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Started crash monitoring.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Started performance monitoring.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Started video recording.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Starting instrumentation test.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Completed instrumentation test.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Stopped performance monitoring.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Stopped crash monitoring.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Stopped logcat recording.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Done. Test time = 155 (secs)
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Starting results processing. Attempt: 1
  7m 25s matrix-1a5cptg345w73 Pixel2-28 Completed results processing. Time taken = 10 (secs)
  7m 25s matrix-1a5cptg345w73 Pixel2-28 FINISHED
  7m 25s matrix-1a5cptg345w73 FINISHED
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Starting attempt 1.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Started logcat recording.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Preparing device.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Installing apps.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Retrieving Performance Environment information from the device.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Started crash detection.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Started crash monitoring.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Started performance monitoring.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Started video recording.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Starting instrumentation test.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Completed instrumentation test.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Stopped performance monitoring.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Stopped crash monitoring.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Stopped logcat recording.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Done. Test time = 162 (secs)
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Starting results processing. Attempt: 1
  7m 26s matrix-2khgqwh2j443k Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 26s matrix-2khgqwh2j443k Pixel2-28 FINISHED
  7m 26s matrix-2khgqwh2j443k FINISHED
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Starting attempt 1.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Started logcat recording.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Preparing device.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Installing apps.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Retrieving Performance Environment information from the device.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Started crash detection.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Started performance monitoring.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Started crash monitoring.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Started video recording.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Starting instrumentation test.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Completed instrumentation test.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Stopped performance monitoring.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Stopped crash monitoring.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Stopped logcat recording.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Done. Test time = 164 (secs)
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Starting results processing. Attempt: 1
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 Completed results processing. Time taken = 11 (secs)
  7m 26s matrix-2r7z3a7ysjjwj Pixel2-28 FINISHED
  7m 26s matrix-2r7z3a7ysjjwj FINISHED
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Starting attempt 1.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Started logcat recording.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Preparing device.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Installing apps.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Retrieving Performance Environment information from the device.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Started crash detection.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Started performance monitoring.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Started crash monitoring.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Started video recording.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Starting instrumentation test.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Completed instrumentation test.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Stopped performance monitoring.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Stopped crash monitoring.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Stopped logcat recording.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Done. Test time = 188 (secs)
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Starting results processing. Attempt: 1
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 Completed results processing. Time taken = 11 (secs)
  7m 27s matrix-1qu5ibidneno1 Pixel2-28 FINISHED
  7m 27s matrix-1qu5ibidneno1 FINISHED
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Starting attempt 1.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Started logcat recording.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Preparing device.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Installing apps.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Retrieving Performance Environment information from the device.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Started crash detection.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Started crash monitoring.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Started performance monitoring.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Started video recording.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Starting instrumentation test.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Completed instrumentation test.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Stopped performance monitoring.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Stopped crash monitoring.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Stopped logcat recording.
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Done. Test time = 146 (secs)
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Starting results processing. Attempt: 1
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 27s matrix-1gc32oa61qof2 Pixel2-28 FINISHED
  7m 27s matrix-1gc32oa61qof2 FINISHED
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Starting attempt 1.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Started logcat recording.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Preparing device.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Installing apps.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Retrieving Performance Environment information from the device.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Started crash detection.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Started crash monitoring.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Started performance monitoring.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Started video recording.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Starting instrumentation test.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Completed instrumentation test.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Stopped performance monitoring.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Stopped crash monitoring.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Stopped logcat recording.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Done. Test time = 147 (secs)
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Starting results processing. Attempt: 1
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 28s matrix-2nhlibs17ch12 Pixel2-28 FINISHED
  7m 28s matrix-2nhlibs17ch12 FINISHED
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Starting attempt 1.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Started logcat recording.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Preparing device.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Installing apps.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Retrieving Performance Environment information from the device.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Started crash detection.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Started crash monitoring.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Started performance monitoring.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Started video recording.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Starting instrumentation test.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Completed instrumentation test.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Stopped performance monitoring.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Stopped crash monitoring.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Stopped logcat recording.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Done. Test time = 148 (secs)
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Starting results processing. Attempt: 1
  7m 28s matrix-342s21w10b7b7 Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 28s matrix-342s21w10b7b7 Pixel2-28 FINISHED
  7m 28s matrix-342s21w10b7b7 FINISHED
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Starting attempt 1.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Started logcat recording.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Preparing device.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Installing apps.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Retrieving Performance Environment information from the device.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Started crash detection.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Started crash monitoring.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Started performance monitoring.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Started video recording.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Starting instrumentation test.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Completed instrumentation test.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Stopped performance monitoring.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Stopped crash monitoring.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Stopped logcat recording.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Done. Test time = 164 (secs)
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Starting results processing. Attempt: 1
  7m 28s matrix-78v4f0odf66sa Pixel2-28 Completed results processing. Time taken = 12 (secs)
  7m 28s matrix-78v4f0odf66sa Pixel2-28 FINISHED
  7m 28s matrix-78v4f0odf66sa FINISHED
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Starting attempt 1.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Started logcat recording.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Preparing device.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Installing apps.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Retrieving Performance Environment information from the device.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Started crash detection.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Started crash monitoring.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Started performance monitoring.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Started video recording.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Starting instrumentation test.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Completed instrumentation test.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Stopped performance monitoring.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Stopped crash monitoring.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Stopped logcat recording.
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Done. Test time = 157 (secs)
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Starting results processing. Attempt: 1
  7m 29s matrix-30g2gl7vol143 Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 29s matrix-30g2gl7vol143 Pixel2-28 FINISHED
  7m 29s matrix-30g2gl7vol143 FINISHED
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Starting attempt 1.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Started logcat recording.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Preparing device.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Installing apps.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Retrieving Performance Environment information from the device.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Started crash detection.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Started performance monitoring.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Started crash monitoring.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Started video recording.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Starting instrumentation test.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Completed instrumentation test.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Stopped performance monitoring.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Stopped crash monitoring.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Stopped logcat recording.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Done. Test time = 196 (secs)
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Starting results processing. Attempt: 1
  7m 29s matrix-1d11pkrpw76et Pixel2-28 Completed results processing. Time taken = 11 (secs)
  7m 29s matrix-1d11pkrpw76et Pixel2-28 FINISHED
  7m 29s matrix-1d11pkrpw76et FINISHED
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Starting attempt 1.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Started logcat recording.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Preparing device.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Installing apps.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Retrieving Performance Environment information from the device.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Started crash detection.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Started crash monitoring.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Started performance monitoring.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Started video recording.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Starting instrumentation test.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Completed instrumentation test.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Stopped performance monitoring.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Stopped crash monitoring.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Stopped logcat recording.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Done. Test time = 114 (secs)
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Starting results processing. Attempt: 1
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 29s matrix-10ze4j2hplr1g Pixel2-28 FINISHED
  7m 29s matrix-10ze4j2hplr1g FINISHED
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Starting attempt 1.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Started logcat recording.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Preparing device.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Installing apps.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Retrieving Performance Environment information from the device.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Started crash detection.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Started performance monitoring.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Started crash monitoring.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Started video recording.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Starting instrumentation test.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Completed instrumentation test.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Stopped performance monitoring.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Stopped crash monitoring.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Stopped logcat recording.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Done. Test time = 124 (secs)
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Starting results processing. Attempt: 1
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 30s matrix-33ktgnfvhm0yn Pixel2-28 FINISHED
  7m 30s matrix-33ktgnfvhm0yn FINISHED
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Starting attempt 1.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Started logcat recording.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Preparing device.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Installing apps.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Retrieving Performance Environment information from the device.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Started crash detection.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Started performance monitoring.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Started crash monitoring.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Started video recording.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Starting instrumentation test.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Completed instrumentation test.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Stopped performance monitoring.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Stopped crash monitoring.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Stopped logcat recording.
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Done. Test time = 126 (secs)
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Starting results processing. Attempt: 1
  7m 30s matrix-g1fihe7na35sa Pixel2-28 Completed results processing. Time taken = 10 (secs)
  7m 30s matrix-g1fihe7na35sa Pixel2-28 FINISHED
  7m 30s matrix-g1fihe7na35sa FINISHED
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Starting attempt 1.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Started logcat recording.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Preparing device.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Installing apps.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Retrieving Performance Environment information from the device.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Started crash detection.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Started crash monitoring.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Started performance monitoring.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Started video recording.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Starting instrumentation test.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Completed instrumentation test.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Stopped performance monitoring.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Stopped crash monitoring.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Stopped logcat recording.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Done. Test time = 132 (secs)
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Starting results processing. Attempt: 1
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 30s matrix-2stz1ezd5rs57 Pixel2-28 FINISHED
  7m 30s matrix-2stz1ezd5rs57 FINISHED
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Starting attempt 1.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Started logcat recording.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Preparing device.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Installing apps.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Retrieving Performance Environment information from the device.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Started crash detection.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Started crash monitoring.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Started performance monitoring.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Started video recording.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Starting instrumentation test.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Completed instrumentation test.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Stopped performance monitoring.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Stopped crash monitoring.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Stopped logcat recording.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Done. Test time = 132 (secs)
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Starting results processing. Attempt: 1
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 31s matrix-3bdlybzdpiqm7 Pixel2-28 FINISHED
  7m 31s matrix-3bdlybzdpiqm7 FINISHED
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Starting attempt 1.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Started logcat recording.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Preparing device.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Installing apps.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Retrieving Performance Environment information from the device.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Started crash detection.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Started crash monitoring.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Started performance monitoring.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Started video recording.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Starting instrumentation test.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Completed instrumentation test.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Stopped performance monitoring.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Stopped crash monitoring.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Stopped logcat recording.
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Done. Test time = 126 (secs)
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Starting results processing. Attempt: 1
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 31s matrix-yq9xle35xtyaa Pixel2-28 FINISHED
  7m 31s matrix-yq9xle35xtyaa FINISHED
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Starting attempt 1.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Started logcat recording.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Preparing device.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Installing apps.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Retrieving Performance Environment information from the device.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Started crash detection.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Started performance monitoring.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Started crash monitoring.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Started video recording.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Starting instrumentation test.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Completed instrumentation test.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Stopped performance monitoring.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Stopped crash monitoring.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Stopped logcat recording.
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Done. Test time = 154 (secs)
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Starting results processing. Attempt: 1
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 Completed results processing. Time taken = 11 (secs)
  7m 32s matrix-3jszqfvdpo9ds Pixel2-28 FINISHED
  7m 32s matrix-3jszqfvdpo9ds FINISHED
  7m 32s matrix-2jazh0130r15a Pixel2-28 Starting attempt 1.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Started logcat recording.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Preparing device.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Installing apps.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Retrieving Pre-Test Package Stats information from the device.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Retrieving Performance Environment information from the device.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Started crash detection.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Started crash monitoring.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Started performance monitoring.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Started video recording.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Starting instrumentation test.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Completed instrumentation test.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Stopped performance monitoring.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Stopped crash monitoring.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Stopped logcat recording.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Retrieving Post-test Package Stats information from the device.
  7m 32s matrix-2jazh0130r15a Pixel2-28 Done. Test time = 146 (secs)
  7m 32s matrix-2jazh0130r15a Pixel2-28 Starting results processing. Attempt: 1
  7m 32s matrix-2jazh0130r15a Pixel2-28 Completed results processing. Time taken = 9 (secs)
  7m 32s matrix-2jazh0130r15a Pixel2-28 FINISHED
  7m 32s matrix-2jazh0130r15a FINISHED

FetchArtifacts
  .................................................
  Updating matrix file

CostReport
  Virtual devices
    $1.48 for 1h 29m

MatrixResultsReport
  30 / 30 (100.00%)

> Task :app:execFlank FAILED

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.