Skip to content

Added support for batch size and multi processing to evaluate_detections #6917

Added support for batch size and multi processing to evaluate_detections

Added support for batch size and multi processing to evaluate_detections #6917

Triggered via pull request January 11, 2025 01:09
Status Failure
Total duration 50m 0s
Billable time 1h 19m
Artifacts 2

pr.yml

on: pull_request
modified-files
26s
modified-files
Matrix: test / test-python
all-tests
0s
all-tests
Fit to window
Zoom out
Zoom in

Annotations

14 errors, 25 warnings, and 1 notice
test / test-python (ubuntu-latest-m, 3.9)
Process completed with exit code 1.
test / test-python (ubuntu-latest-m, 3.10)
Process completed with exit code 1.
test / test-python (ubuntu-latest-m, 3.11)
Process completed with exit code 1.
[chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior: e2e-pw/src/oss/specs/groups/ima-vid.spec.ts#L1
1) [chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior Test timeout of 60000ms exceeded.
[chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior: e2e-pw/src/oss/poms/modal/imavid-controls.ts#L36
1) [chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior Error: page.waitForFunction: Test timeout of 60000ms exceeded. at oss/poms/modal/imavid-controls.ts:36 34 | 35 | private async waitUntilBufferingIsFinished() { > 36 | await this.page.waitForFunction( | ^ 37 | () => 38 | document 39 | .querySelector("[data-cy=imavid-playhead]") at ModalImaAsVideoControlsPom.waitUntilBufferingIsFinished (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:36:21) at ModalImaAsVideoControlsPom.togglePlay (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:45:16) at ModalImaAsVideoControlsPom.playUntilFrames (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:71:16) at /home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/specs/groups/ima-vid.spec.ts:127:22
[chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior: e2e-pw/src/oss/specs/groups/ima-vid.spec.ts#L1
1) [chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 60000ms exceeded.
[chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior: e2e-pw/src/oss/poms/modal/imavid-controls.ts#L36
1) [chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForFunction: Test timeout of 60000ms exceeded. at oss/poms/modal/imavid-controls.ts:36 34 | 35 | private async waitUntilBufferingIsFinished() { > 36 | await this.page.waitForFunction( | ^ 37 | () => 38 | document 39 | .querySelector("[data-cy=imavid-playhead]") at ModalImaAsVideoControlsPom.waitUntilBufferingIsFinished (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:36:21) at ModalImaAsVideoControlsPom.togglePlay (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:45:16) at ModalImaAsVideoControlsPom.playUntilFrames (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:71:16) at /home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/specs/groups/ima-vid.spec.ts:127:22
[chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior: e2e-pw/src/oss/specs/groups/ima-vid.spec.ts#L1
1) [chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 60000ms exceeded.
[chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior: e2e-pw/src/oss/poms/modal/imavid-controls.ts#L36
1) [chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForFunction: Test timeout of 60000ms exceeded. at oss/poms/modal/imavid-controls.ts:36 34 | 35 | private async waitUntilBufferingIsFinished() { > 36 | await this.page.waitForFunction( | ^ 37 | () => 38 | document 39 | .querySelector("[data-cy=imavid-playhead]") at ModalImaAsVideoControlsPom.waitUntilBufferingIsFinished (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:36:21) at ModalImaAsVideoControlsPom.togglePlay (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:45:16) at ModalImaAsVideoControlsPom.playUntilFrames (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:71:16) at /home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/specs/groups/ima-vid.spec.ts:127:22
[chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior: e2e-pw/src/oss/specs/groups/ima-vid.spec.ts#L1
1) [chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior Retry #3 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 60000ms exceeded.
[chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior: e2e-pw/src/oss/poms/modal/imavid-controls.ts#L36
1) [chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior Retry #3 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForFunction: Test timeout of 60000ms exceeded. at oss/poms/modal/imavid-controls.ts:36 34 | 35 | private async waitUntilBufferingIsFinished() { > 36 | await this.page.waitForFunction( | ^ 37 | () => 38 | document 39 | .querySelector("[data-cy=imavid-playhead]") at ModalImaAsVideoControlsPom.waitUntilBufferingIsFinished (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:36:21) at ModalImaAsVideoControlsPom.togglePlay (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:45:16) at ModalImaAsVideoControlsPom.playUntilFrames (/home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/poms/modal/imavid-controls.ts:71:16) at /home/runner/work/fiftyone/fiftyone/e2e-pw/src/oss/specs/groups/ima-vid.spec.ts:127:22
[chromium] › oss/specs/groups/dynamic-groups.spec.ts:70:3 › pcd dynamic group pagination bar: e2e-pw/src/oss/specs/groups/dynamic-groups.spec.ts#L1
2) [chromium] › oss/specs/groups/dynamic-groups.spec.ts:70:3 › pcd dynamic group pagination bar ── Test timeout of 60000ms exceeded.
[chromium] › oss/specs/groups/dynamic-groups.spec.ts:70:3 › pcd dynamic group pagination bar: e2e-pw/src/oss/poms/grid/index.ts#L55
2) [chromium] › oss/specs/groups/dynamic-groups.spec.ts:70:3 › pcd dynamic group pagination bar ── Error: locator.click: Test timeout of 60000ms exceeded. Call log: - waiting for getByTestId('fo-grid').getByTestId('looker').first() - locator resolved to <div tabindex="-1" data-cy="looker" title="Click to expand" class="_looker_1i9j2_16">…</div> - attempting click action - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker3d" class="_loading_1wcd9_1">…</div> from <div id="modal" class="modalon">…</div> subtree intercepts pointer events - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker3d" class="_loading_1wcd9_1">…</div> from <div id="modal" class="modalon">…</div> subtree intercepts pointer events - retrying click action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker3d" class="_loading_1wcd9_1">…</div> from <div id="modal" class="modalon">…</div> subtree intercepts pointer events - retrying click action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker3d" class="_loading_1wcd9_1">…</div> from <div id="modal" class="modalon">…</div> subtree intercepts pointer events - retrying click action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker3d" class="_loading_1wcd9_1">…</div> from <div id="modal" class="modalon">…</div> subtree intercepts pointer events - retrying click action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker3d" class="_loading_1wcd9_1">…</div> from <div id="modal" class="modalon">…</div> subtree intercepts pointer events - retrying click action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker3d" class="_loading_1wcd9_1">…</div> from <div id="modal" class="modalon">…</div> subtree intercepts pointer events - retrying click action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker3d" class="_loading_1wcd9_1">…</div> from <div id="modal" class="modalon">…</div> subtree intercepts pointer events - retrying click action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker3d" class="_loading_1wcd9_1">…</div> from <div id="modal" class="modalon">…</div> subtree intercepts pointer events - retrying click action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div data-cy="looker
all-tests
Process completed with exit code 1.
modified-files
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
build / changes
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
lint / eslint
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
lint / eslint: app/packages/operators/src/CustomPanel.tsx#L45
React Hook useEffect has missing dependencies: 'panelId', 'panelName', 'props.onUnLoad', 'setPanelCloseEffect', 'trackEvent', and 'triggerPanelEvent'. Either include them or remove the dependency array
lint / eslint: app/packages/operators/src/CustomPanel.tsx#L110
React Hook useEffect has a missing dependency: 'dimensions'. Either include it or remove the dependency array
lint / eslint: app/packages/operators/src/built-in-operators.ts#L820
'ctx' is defined but never used. Allowed unused args must match /^_/u
lint / eslint
'ctx' is defined but never used. Allowed unused args must match /^_/u
lint / eslint
'ctx' is defined but never used. Allowed unused args must match /^_/u
lint / eslint
'ctx' is defined but never used. Allowed unused args must match /^_/u
lint / eslint
'ctx' is defined but never used. Allowed unused args must match /^_/u
lint / eslint
'path' is never reassigned. Use 'const' instead
lint / eslint
'value' is never reassigned. Use 'const' instead
lint / eslint
'ctx' is defined but never used. Allowed unused args must match /^_/u
test / test-app
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test / test-python (ubuntu-latest-m, 3.9)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
test / test-python (ubuntu-latest-m, 3.10)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
test / test-python (ubuntu-latest-m, 3.11)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Slow Test: e2e-pw/[chromium] › oss/specs/smoke-tests/field-visibility.spec.ts#L1
e2e-pw/[chromium] › oss/specs/smoke-tests/field-visibility.spec.ts took 3.8m
Slow Test: e2e-pw/[chromium] › oss/specs/smoke-tests/saved-views.spec.ts#L1
e2e-pw/[chromium] › oss/specs/smoke-tests/saved-views.spec.ts took 1.4m
Slow Test: e2e-pw/[chromium] › oss/specs/selection.spec.ts#L1
e2e-pw/[chromium] › oss/specs/selection.spec.ts took 1.3m
Slow Test: e2e-pw/[chromium] › oss/specs/operators/prompt.spec.ts#L1
e2e-pw/[chromium] › oss/specs/operators/prompt.spec.ts took 1.1m
Slow Test: e2e-pw/[chromium] › oss/specs/sidebar/sidebar.spec.ts#L1
e2e-pw/[chromium] › oss/specs/sidebar/sidebar.spec.ts took 58.2s
e2e / test-e2e
Unexpected input(s) 'working-directory', valid inputs are ['path', 'key', 'restore-keys', 'upload-chunk-size', 'enableCrossOsArchive', 'fail-on-cache-miss', 'lookup-only', 'save-always']
e2e / test-e2e
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
all-tests
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
🎭 Playwright Run Summary
1 failed [chromium] › oss/specs/groups/ima-vid.spec.ts:118:1 › check modal playback and tagging behavior 14 flaky [chromium] › oss/specs/groups/dynamic-groups.spec.ts:70:3 › pcd dynamic group pagination bar ─── [chromium] › oss/specs/groups/dynamic-groups.spec.ts:70:3 › png dynamic group pagination bar ─── [chromium] › oss/specs/groups/nested-dynamic-groups.spec.ts:116:1 › dynamic groups of groups works [chromium] › oss/specs/groups/sparse-groups.spec.ts:96:3 › mp4 second slice ──────────────────── [chromium] › oss/specs/groups/sparse-groups.spec.ts:96:3 › png second slice ──────────────────── [chromium] › oss/specs/regression-tests/group-video/group-video-label.spec.ts:87:3 › groups video labels › video plays with correct label for each slice [chromium] › oss/specs/regression-tests/index-page.spec.ts:24:1 › index page ─────────────────── [chromium] › oss/specs/smoke-tests/embeddings.spec.ts:62:3 › embeddings on quickstart dataset › lasso samples work [chromium] › oss/specs/smoke-tests/quickstart-groups.spec.ts:79:5 › quickstart-groups › modal › navigation works [chromium] › oss/specs/smoke-tests/quickstart-groups.spec.ts:104:5 › quickstart-groups › modal › group media visibility toggle works [chromium] › oss/specs/smoke-tests/quickstart-groups.spec.ts:139:3 › quickstart-groups › modal with grid filter [chromium] › oss/specs/smoke-tests/quickstart.spec.ts:36:3 › quickstart › smoke ──────────────── [chromium] › oss/specs/smoke-tests/quickstart.spec.ts:63:3 › quickstart › entry counts text when toPatches then groupedBy [chromium] › oss/specs/smoke-tests/quickstart.spec.ts:80:3 › quickstart › selection bookmark ─── 2 skipped 89 passed (42.6m)

Artifacts

Produced during runtime
Name Size
dist
19.7 MB
playwright-report
128 MB