Skip to content

Latest commit

 

History

History
988 lines (890 loc) · 99.1 KB

release_notes.md

File metadata and controls

988 lines (890 loc) · 99.1 KB

v23.10.1

Bug Fixes

  • #2447 Update shard limit for Arm devices to 200 ()
  • #2444 Point authentication error message link to correct/relevant docs ()

CI Changes

  • #2445 Pass full commit sha through release command ()

v23.10.0

Bug Fixes

  • #2438 Replace hub with GitHub CLI 'gh' for GitHub Actions (schnecle)

Features

  • #2437 Add retry configuration to Google Cloud Storage client (schnecle)

v23.07.0

Bug Fixes

  • #2404 Set correct max test shards when arm devices are configured ()

v23.06.2

Bug Fixes

  • #2392 Update out of date dependencies ()

v23.06.1

Bug Fixes

  • #2375 Update google-auth-library-oauth2-http version to 1.17.0 ()

v23.06.0

Bug Fixes

  • #2373 Update various dependencies ()
  • #2369 Remove usage of secrets to fix failing builds ()
  • #2360 Rate limiting issue when downloading flank with no version supplied ()

v23.04.0

Bug Fixes

  • #2366 Bringing integration tests back to life ()
  • #2364 Removed test case time overhead calculation ()

v23.03.2

Bug Fixes

  • #2352 Revert "Fixes missing HTTP header X-Goog-User-Project" ()

v23.03.1

Documentation

  • #2351 Update developer details

v23.03.0

Bug Fixes

  • #2348 Fixes missing HTTP header X-Goog-User-Project

v23.01.0

Bug Fixes

  • #2274 Stop loading entire file into memory to fix OOM errors ()

Features

  • #2273 Add billable minutes to JSON output report ()

Tests update

  • #2331 Update Google cloud project used in tests ()

CI Changes

  • #2326 Update scorecard-action version ()

Documentation

  • #2325 Fix list formatting in "Authenticate with a service account" section ()

v22.10.0

Refactor

  • #2306 Remove references to JFrog and Bintray
  • #2299 Remove references to codecov.io
  • #2298 Remove references to BugSnag
  • #2287 Remove MixPanel analytics
  • #2283 Remove Sentry analytics

v22.05.0

Bug Fixes

Features

v22.04.0

Bug Fixes

  • #2189 Adds check for .aab format before querying apkDetails (Xlopec)

Features

  • #2241 Use Firebase Test Lab matrix details URL for test matrix webLink (tonybaroneee)

v22.03.0

Bug Fixes

  • #2225 Revert jackson upgrade
  • #2223 Fix BufferUnderflowException when parsing dex file with Espresso 3.4.0 Fixes #2203
  • #2207 Add support for robo-directives

Tests update

  • #2185 Update app_many_tests to AndroidX libraries

v21.11.0

Bug Fixes

Features

v21.09.0

Features

Bug Fixes

v21.08.1

Features

Refactor

Bug Fixes

CI Changes

v21.08.0

Features

Bug Fixes

Refactor

Documentation

v21.07.2

Features

Bug Fixes

Refactor

v21.07.1

Features

Refactor

Bug Fixes

v21.07.0

Features

Bug Fixes

Refactor

v21.06.1

Bug Fixes

Features

v21.06.0

Bug Fixes

Features

Documentation

CI Changes

Refactor

v21.05.0

Refactor

Bug Fixes

Features

Tests update

CI Changes

Documentation

v21.04.1

Documentation

Tests update

Bug Fixes

Features

Refactor

v21.04.0

Bug Fixes

Documentation

Refactor

Tests update

Features

v21.03.1

Bug Fixes

Features

CI Changes

Documentation

Tests update

Refactor

v21.03.0

CI Changes

Documentation

Features

Bug Fixes

Refactor

v21.02.0

Bug Fixes

CI Changes

Tests update

Features

Documentation

Refactor

v21.01.1

CI Changes

Bug Fixes

v21.01.0

CI Changes

Features

Refactor

Bug Fixes

Documentation

Tests update

v20.12.0

Bug Fixes

Refactor

CI Changes

Documentation

Features

Tests update

v20.09.3

Bug Fixes

Features

Documentation

CI Changes

Refactor

v20.09.2

Features

Bug Fixes

v20.09.1

Bug Fixes

v20.09.0

Bug Fixes

CI Changes

v20.08.4

Features

  • #1056 Added validation of smart-flank-gcs-path to not override different junit results (adamfilipow92)
  • #1040 Add test axis value column to summary table (jan-gogo)
  • #1043 Add printing messages for MatrixCanceledError and InfrastructureError (pawelpasterz)
  • #1042 Added option for default test time and average time for smart shard (piotradamczyk5)

Tests update

Bug Fixes

Refactor

Documentation

v20.08.3

CI Changes

Bug Fixes

Refactor

v20.08.2

Features

Refactor

Bug Fixes

CI Changes

Documentation

v20.08.1

v20.08.0

v20.07.0

v20.06.2

v20.06.1

v20.06.0

v20.05.2

v20.05.1

v20.05.0

v8.1.0

v8.0.1

v8.0.0

v7.0.2

v7.0.1

v7.0.0

  • #574 Improve test shard error reporting. Update device catalog to use projectId. (bootstraponline)
  • #582 Fix iOS exit code when using flaky-test-attempts. Don't print environment-variables to stdout for security. (bootstraponline)
  • #584 Poll all test executions instead of only the first per matrix. (bootstraponline)
  • #585 Fix bug in smart flank when sharding tests that run in 0 seconds. (bootstraponline)

v6.2.3

v6.2.2

v6.2.1

v6.2.0

  • #560 Add --test-runner-class support for Android. (jschear)

v6.1.0

  • #542 Add additional-app-test-apks to include multiple app/test apk pairs in a single run. (bootstraponline)

v6.0.1

v6.0.0

v5.1.0

  • #537 Add smart-flank-disable-upload yml option to prevent new results from overriding previous results. (elihart)

v5.0.2

v5.0.1

v5.0.0

  • #506 Add bugsnag reporting to detect Flank crashes. (bootstraponline)
  • #507 Improve error message when credentials fail to load, folder doesn't exist, and on bucket creation failure. Properly pass through user credential when checking the storage bucket. (bootstraponline)
  • #514 Rename testShards to maxTestShards (miguelslemos)
  • #518 Add deprecation warnings when old key names are used. flank android doctor --fix will auto fix the YAML file. (bootstraponline)
  • #519 Rename maxTestShards to max-test-shards, shardTime to shard-time, repeatTests to repeat-tests, smartFlankGcsPath to smart-flank-gcs-path, disableSharding to disable-sharding. Moved project from gcloud to flank (bootstraponline)
  • #523 Add --local-result-dir to make it easy to find the test result at a fixed path. (bootstraponline)
  • #524 Fix iOS test sharding when there's a space in the path (bootstraponline)
  • #522 Correctly report test results and exit code when using flaky-test-attempts (bootstraponline)
  • #530 Save files downloaded with files-to-download to device root folder. Fix web links in HTML report. (bootstraponline)
  • #533 Update matrix_ids.json on every matrix change. Useful for debugging runs that crashed. (jschear)

v4.4.0

v4.3.1

v4.3.0

v4.2.0

  • Fix create Gcs bucket #444
  • Add files-to-download to Android and iOS. Specify a list of regular expressions to download files from the Google Cloud Storage bucket. #441
  • Add flank auth login to authorize with a user account instead of a service account. #446
  • Add flaky-test-attempts support on Android and iOS which automatically retries failed tests. #454

v4.1.1

  • Add support for parameterized iOS tests when shard count is 1. #435
  • Add support for SkipTestIdentifiers when parsing iOS .xctestrun files. #435

v4.1.0

  • app, test, and xctestrun-file now support ~, environment variables, and globs (*, **) when resolving paths. #386
  • Add CLI support for flank android run and flank ios run
  • Add experimental smartFlankGcsPath to shard iOS and Android tests by time using historical run data. The amount of shards used is set by testShards. #385
  • Fix parsing empty testcase #402
  • Add progress bar when uploading files. #403
  • iOS iPhone 8 default device has been updated from 11.2 to 12.0.

v4.0.0

  • Add flank cancel command. See flank cancel --help
  • Add flank refresh command. See flank refresh --help
  • Automatically detect projectId from service account credential
  • Always generate aggregated JUnit XML reports
  • Update HTML report to use create-react-app v2.1.0
  • Add support for Xcode 10.1
  • Improve test parsing to detect Swift tests that throw errors
  • Update Flank exit codes, see readme for details.
  • Link to matrix root when testing on multiple devices