Code coverage for JavaScript tests

[mgeisler]

Now that #2462 is fixed, a natural next step would be to add support for code coverage on the JavaScript tests. Basically, I would like to know that we exercise most or all of book.js in our tests. The same goes for the other JavaScript files we maintain.

@Alx-Lai, @michael-kerscher or someone else, please let me know if you're interested in this.

[michael-kerscher]

I'm not sure if this is a major blocker but I wanted to document this at least.

We use the local runner

comprehensive-rust/tests/wdio.conf.ts

Line 8 in 380dc3c

runner: "local",

and we use the browser api to let the local runner test properties in the remote browser. Example:

comprehensive-rust/tests/src/basic.test.ts

Lines 6 to 7 in 380dc3c

	await browser.url("/");
	expect(await browser.execute(() => window.default_theme)).toBe("light");

I found documentation for coverage support for wdio but this documents how a browserrunner needs to be configured.

In order to enable code coverage reporting, enable it through the WebdriverIO browser runner configuration, e.g.:

This page also only documents Coverage Options for the browser runner

[michael-kerscher]

I'm not sure how to use the browser runner as this seems to requires a vite setup, which seems non-trivial for our use case. As far as I currently understand, vite needs to serve the entire html book + javascript and the tests will not run "outside" the served html but are injected into this site.

My current setup is looking at the website from the outside via the webdriver protocol with a browser that has this page open. The test is not running in the browser.