Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Randomly failing tests on CI #11534

Open
laurent22 opened this issue Dec 18, 2024 · 0 comments
Open

Randomly failing tests on CI #11534

laurent22 opened this issue Dec 18, 2024 · 0 comments
Labels
bug It's a bug high High priority issues

Comments

@laurent22
Copy link
Owner

laurent22 commented Dec 18, 2024

We'll list here the randomly failing tests so that we can find out if it's often the same ones that come back or not. If it's often the same ones we could potentially comment them out.

main.spec.ts: should correctly resize large images

Count: 1

➤ YN0000: [@joplin/app-desktop]:   1) main.spec.ts:99:6 › main › should correctly resize large images ───────────────────────────────
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:     TimeoutError: locator.waitFor: Timeout 30000ms exceeded.
➤ YN0000: [@joplin/app-desktop]:     Call log:
➤ YN0000: [@joplin/app-desktop]:       - waiting for locator('.rli-editor').locator('iframe[src$="note-viewer/index.html"]').frameLocator(':scope').getByAltText('large-jpg-image-with-exif-rotation.jpg')
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:        at util/getImageSourceSize.ts:6
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:       4 | 	// Use state: 'attached' -- we don't need the image to be on the screen (just present
➤ YN0000: [@joplin/app-desktop]:       5 | 	// in the DOM).
➤ YN0000: [@joplin/app-desktop]:     > 6 | 	await imageLocator.waitFor({ state: 'attached' });
➤ YN0000: [@joplin/app-desktop]:         | 	                   ^
➤ YN0000: [@joplin/app-desktop]:       7 |
➤ YN0000: [@joplin/app-desktop]:       8 | 	// We load a copy of the image to avoid returning an overriden width set with
➤ YN0000: [@joplin/app-desktop]:       9 | 	//    .width = some_number
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:         at getImageSourceSize (/home/runner/work/joplin/joplin/packages/app-desktop/integration-tests/util/getImageSourceSize.ts:6:21)
➤ YN0000: [@joplin/app-desktop]:         at /home/runner/work/joplin/joplin/packages/app-desktop/integration-tests/main.spec.ts:131:47
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:     Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:     TimeoutError: locator.waitFor: Timeout 30000ms exceeded.
➤ YN0000: [@joplin/app-desktop]:     Call log:
➤ YN0000: [@joplin/app-desktop]:       - waiting for locator('.rli-editor').locator('iframe[src$="note-viewer/index.html"]').frameLocator(':scope').getByAltText('large-jpg-image-with-exif-rotation.jpg')
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:        at util/getImageSourceSize.ts:6
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:       4 | 	// Use state: 'attached' -- we don't need the image to be on the screen (just present
➤ YN0000: [@joplin/app-desktop]:       5 | 	// in the DOM).
➤ YN0000: [@joplin/app-desktop]:     > 6 | 	await imageLocator.waitFor({ state: 'attached' });
➤ YN0000: [@joplin/app-desktop]:         | 	                   ^
➤ YN0000: [@joplin/app-desktop]:       7 |
➤ YN0000: [@joplin/app-desktop]:       8 | 	// We load a copy of the image to avoid returning an overriden width set with
➤ YN0000: [@joplin/app-desktop]:       9 | 	//    .width = some_number
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:         at getImageSourceSize (/home/runner/work/joplin/joplin/packages/app-desktop/integration-tests/util/getImageSourceSize.ts:6:21)
➤ YN0000: [@joplin/app-desktop]:         at /home/runner/work/joplin/joplin/packages/app-desktop/integration-tests/main.spec.ts:121:44
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:     attachment #1: trace (application/zip) ─────────────────────────────────────────────────────────
➤ YN0000: [@joplin/app-desktop]:     test-results/main-main-should-correctly-resize-large-images-retry1/trace.zip
➤ YN0000: [@joplin/app-desktop]:     Usage:
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:         yarn playwright show-trace test-results/main-main-should-correctly-resize-large-images-retry1/trace.zip
➤ YN0000: [@joplin/app-desktop]: 

markdownEditor.spec.ts: preview pane should render video attachments

Count: 2

➤ YN0000: [@joplin/app-desktop]:   1) markdownEditor.spec.ts:83:6 › markdownEditor › preview pane should render video attachments ───
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:     Error: toBeSeekableMediaElement: Should play until 7:
➤ YN0000: [@joplin/app-desktop]:       Error: expect(received).toBeGreaterThan(expected)
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:     Expected: > 7
➤ YN0000: [@joplin/app-desktop]:     Received:   0
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:     Call Log:
➤ YN0000: [@joplin/app-desktop]:     - Timeout 5000ms exceeded while waiting on the predicate
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:       92 | 		const videoLocator = editor.getNoteViewerFrameLocator().locator('video');
➤ YN0000: [@joplin/app-desktop]:       93 | 		const expectVideoToRender = async () => {
➤ YN0000: [@joplin/app-desktop]:     > 94 | 			await expect(videoLocator).toBeSeekableMediaElement(6.9, 7);
➤ YN0000: [@joplin/app-desktop]:          | 			                           ^
➤ YN0000: [@joplin/app-desktop]:       95 | 		};
➤ YN0000: [@joplin/app-desktop]:       96 |
➤ YN0000: [@joplin/app-desktop]:       97 | 		await expectVideoToRender();
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]:         at expectVideoToRender (/home/runner/work/joplin/joplin/packages/app-desktop/integration-tests/markdownEditor.spec.ts:94:31)
➤ YN0000: [@joplin/app-desktop]:         at /home/runner/work/joplin/joplin/packages/app-desktop/integration-tests/markdownEditor.spec.ts:104:9
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]: 
➤ YN0000: [@joplin/app-desktop]: [16/37] markdownEditor.spec.ts:107:6 › markdownEditor › arrow keys should navigate the toolbar

screens/Note › changing the note body in the editor should update the note's body

Count: 2

➤ YN0000: [@joplin/app-mobile]: FAIL components/screens/Note/Note.test.tsx (152.329 s)
➤ YN0000: [@joplin/app-mobile]:   ● screens/Note › changing the note body in the editor should update the note's body
➤ YN0000: [@joplin/app-mobile]: 
➤ YN0000: [@joplin/app-mobile]:     Unable to find an element with accessibility label: Edit
➤ YN0000: [@joplin/app-mobile]: 
➤ YN0000: [@joplin/app-mobile]:     <View>
➤ YN0000: [@joplin/app-mobile]:       <View>
➤ YN0000: [@joplin/app-mobile]:         <RNCSafeAreaProvider>
➤ YN0000: [@joplin/app-mobile]:           <View>
➤ YN0000: [@joplin/app-mobile]:             <View>
➤ YN0000: [@joplin/app-mobile]:               <View>
➤ YN0000: [@joplin/app-mobile]:                 <View>
➤ YN0000: [@joplin/app-mobile]:                   <View
➤ YN0000: [@joplin/app-mobile]:                     accessibilityLabel="Back"
➤ YN0000: [@joplin/app-mobile]:                     accessibilityRole="button"
➤ YN0000: [@joplin/app-mobile]:                     accessibilityState={
➤ YN0000: [@joplin/app-mobile]:                       {
➤ YN0000: [@joplin/app-mobile]:                         "disabled": true,
➤ YN0000: [@joplin/app-mobile]:                       }
➤ YN0000: [@joplin/app-mobile]:                     }
➤ YN0000: [@joplin/app-mobile]:                     accessible={true}
➤ YN0000: [@joplin/app-mobile]:                   >
➤ YN0000: [@joplin/app-mobile]:                     <View>
➤ YN0000: [@joplin/app-mobile]:                       <View />
➤ YN0000: [@joplin/app-mobile]:                     </View>
➤ YN0000: [@joplin/app-mobile]:                   </View>
➤ YN0000: [@joplin/app-mobile]:                   <Text
➤ YN0000: [@joplin/app-mobile]:                     accessibilityRole="header"
➤ YN0000: [@joplin/app-mobile]:                   />
➤ YN0000: [@joplin/app-mobile]:                 </View>
➤ YN0000: [@joplin/app-mobile]:               </View>
➤ YN0000: [@joplin/app-mobile]:             </View>
➤ YN0000: [@joplin/app-mobile]:           </View>
➤ YN0000: [@joplin/app-mobile]:         </RNCSafeAreaProvider>
➤ YN0000: [@joplin/app-mobile]:       </View>
➤ YN0000: [@joplin/app-mobile]:       <RCTSafeAreaView>
➤ YN0000: [@joplin/app-mobile]:         <View />
➤ YN0000: [@joplin/app-mobile]:       </RCTSafeAreaView>
➤ YN0000: [@joplin/app-mobile]:     </View>
➤ YN0000: [@joplin/app-mobile]: 
➤ YN0000: [@joplin/app-mobile]:       136 |
➤ YN0000: [@joplin/app-mobile]:       137 | const openEditor = async () => {
➤ YN0000: [@joplin/app-mobile]:     > 138 | 	const editButton = await screen.findByLabelText('Edit');
➤ YN0000: [@joplin/app-mobile]:           | 	                                ^
➤ YN0000: [@joplin/app-mobile]:       139 |
➤ YN0000: [@joplin/app-mobile]:       140 | 	fireEvent.press(editButton);
➤ YN0000: [@joplin/app-mobile]:       141 | 	await expectToBeEditing(true);
➤ YN0000: [@joplin/app-mobile]: 
➤ YN0000: [@joplin/app-mobile]:       at openEditor (components/screens/Note/Note.test.tsx:138:34)
➤ YN0000: [@joplin/app-mobile]:       at components/screens/Note/Note.test.tsx:211:10
➤ YN0000: [@joplin/app-mobile]:       at runWithFakeTimers (../lib/testing/test-utils.ts:1144:16)
➤ YN0000: [@joplin/app-mobile]:       at components/screens/Note/Note.test.tsx:210:48
➤ YN0000: [@joplin/app-mobile]:       at callback (node_modules/@testing-library/react-native/src/act.ts:31:24)
➤ YN0000: [@joplin/app-mobile]:       at callback (node_modules/react/cjs/react.development.js:2512:16)
➤ YN0000: [@joplin/app-mobile]:       at actImplementation (node_modules/@testing-library/react-native/src/act.ts:30:25)
➤ YN0000: [@joplin/app-mobile]:       at Object.<anonymous> (components/screens/Note/Note.test.tsx:210:12)

@laurent22 laurent22 added bug It's a bug high High priority issues labels Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug It's a bug high High priority issues
Projects
None yet
Development

No branches or pull requests

1 participant