test: ensure test suite is passing on windows (wsl)

[ssbarnea]

Currently we are not test ui and e2e on CI because:

• github hosted windows runners are not supporting WSL2, docker and podman (no nested virtualization
• executing task ui or task e2e is crashing windows runners with ambiguous message below:

The hosted runner: devtools-win-x64_04594ca6558b lost communication with the server. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.

We did switch from default windows-2022 (8GB RAM) to enlarged 16GB one but without any visible change.

Next step would to setup a permanent self-hosted windows based github runner on AWS and use this one for testing. This should also allow us to connect to the machine directly and see why it was crashing.

Tasks

Preview Give feedback

1. Configure an AWS based Windows runner with WSL2, docker and podman installed and connect it. Use aws cli to spawn it and try to avoid using remote desktop to prepare it , document each command/step taken. -> Now doing this on Azure.
2. Enable execution of the entire test suite on Windows. Eventually allow broken tests to be ignored if needed, but file a tracking bug for them.
3. Fix the bugs found at previous step
4. Write an idempotent ansible playbook for configuring these runners (step 1), so we can run it again if runner is lost. Should allow us to configure more than one runner.

[alisonlhart]

If I'm reading this correctly, we can't run WSL2 on an EC2 Windows instance because it doesn't support nested virtualization, same issue that used to be present in the GH runners.
I'm seeing that issue right now when I try to configure the new instance to use WSL 2.

We may have to wait until the actions/runner-images folks get to my request for enabling WSL 2 before we can complete this.

[alisonlhart]

I don't think we have any paths forward until WSL 2 is enabled in github hosted runners.

[alisonlhart]

Using the Azure instance instead of AWS to do this. Description has been updated.

[alisonlhart]

shell: bash will not work for windows runners using WSL. Continuing to research and try other options.
See: actions/runner#1328

[vedantmgoyal9]

You can use https://github.com/vedantmgoyal9/setup-wsl2.

[gundalow]

For some projects under github.com/ansible and github.com/ansible-collections we use Azure Pipelines for testing against different Windows versions, this integrates well with GitHub's CI reporting

We could have a specific Azure Pipelines jobs that only runs windows.

We have a decent amount of Azure Pipeline capacity for running jobs.