[DRAFT] [net9.0] Diagnose Windows test failures.

[rolfbjarne]

This PR is to run tests only, no need to review.

[vs-mobiletools-engineering-service2]

🔥 Failed to compute test summaries on VSTS: test results 🔥

Failed to compute test summaries: Cannot bind argument to parameter 'InputObject' because it is null..

Pipeline on Agent
Merge 3ade6ce into 04596c3

[vs-mobiletools-engineering-service2]

🔥 [PR Build] Build failed 🔥

Build failed for the job 'Detect API changes'

Pipeline on Agent
Hash: d4a1ed93cf1e05b95b8fd9bbc9ac8a34740e2313 [PR build]

[vs-mobiletools-engineering-service2]

📚 [PR Build] Artifacts 📚

Packages generated

View packages

• xamarin.ios-17.3.0.632.pkg
• xamarin.mac-9.3.0.632.pkg

Pipeline on Agent
Hash: [PR build]

[vs-mobiletools-engineering-service2]

❌ [PR Build] Tests on macOS X64 - Mac Sonoma (14) failed ❌

Failed tests are:

• introspection
• xammac_tests
• monotouch-test

Pipeline on Agent
Hash: [PR build]

[vs-mobiletools-engineering-service2]

💻 [PR Build] Tests on macOS M1 - Mac Ventura (13) passed 💻

✅ All tests on macOS M1 - Mac Ventura (13) passed.

Pipeline on Agent
Hash: [PR build]

[vs-mobiletools-engineering-service2]

💻 [PR Build] Tests on macOS M1 - Mac Monterey (12) passed 💻

✅ All tests on macOS M1 - Mac Monterey (12) passed.

Pipeline on Agent
Hash: [PR build]

[vs-mobiletools-engineering-service2]

💻 [CI Build] Windows Integration Tests passed 💻

✅ All Windows Integration Tests passed.

Pipeline on Agent
Hash: d4a1ed93cf1e05b95b8fd9bbc9ac8a34740e2313 [PR build]

[vs-mobiletools-engineering-service2]

🔥 [CI Build] Test results 🔥

Test results

❌ Tests failed on VSTS: test results

1 tests crashed, 20 tests failed, 149 tests passed.

Failures

❌ introspection tests

2 tests failed, 6 tests passed.

• introspection/Mac [dotnet]/Debug [dotnet]: Failed (Test run failed.
  Tests run: 33 Passed: 32 Inconclusive: 0 Failed: 1 Ignored: 0)
• introspection/Mac Modern/Debug: Failed (Test run failed.
  Tests run: 37 Passed: 36 Inconclusive: 0 Failed: 1 Ignored: 0)

Html Report (VSDrops) Download

❌ mmp tests

1 tests failed, 1 tests passed.

• mmptest/macOS/Debug: Failed (Execution failed with exit code 2)

Html Report (VSDrops) Download

❌ monotouch tests (MacCatalyst)

8 tests failed, 0 tests passed.

• monotouch-test/Mac Catalyst [dotnet]/Debug [dotnet]: Failed (Test run failed.
  Tests run: 2982 Passed: 2858 Inconclusive: 10 Failed: 1 Ignored: 123)
• monotouch-test/Mac Catalyst [dotnet]/Release (static registrar) [dotnet]: Failed (Test run failed.
  Tests run: 2979 Passed: 2851 Inconclusive: 10 Failed: 1 Ignored: 127)
• monotouch-test/Mac Catalyst [dotnet]/Release (managed static registrar) [dotnet]: Failed (Test run failed.
  Tests run: 2979 Passed: 2851 Inconclusive: 10 Failed: 1 Ignored: 127)
• monotouch-test/Mac Catalyst [dotnet]/Release (NativeAOT) [dotnet]: Failed (Test run failed.
  Tests run: 2979 Passed: 2841 Inconclusive: 10 Failed: 1 Ignored: 137)
• monotouch-test/Mac Catalyst [dotnet]/Release (NativeAOT, x64) [dotnet]: Failed (Test run failed.
  Tests run: 2979 Passed: 2841 Inconclusive: 10 Failed: 1 Ignored: 137)
• monotouch-test/Mac Catalyst [dotnet]/Release (static registrar, all optimizations) [dotnet]: Failed (Test run failed.
  Tests run: 2979 Passed: 2845 Inconclusive: 10 Failed: 1 Ignored: 133)
• monotouch-test/Mac Catalyst [dotnet]/Debug (managed static registrar) [dotnet]: Failed (Test run failed.
  Tests run: 2979 Passed: 2857 Inconclusive: 10 Failed: 1 Ignored: 121)
• monotouch-test/Mac Catalyst [dotnet]/Release (managed static registrar, all optimizations) [dotnet]: Failed (Test run failed.
  Tests run: 2979 Passed: 2845 Inconclusive: 10 Failed: 1 Ignored: 133)

Html Report (VSDrops) Download

❌ monotouch tests (macOS)

9 tests failed, 0 tests passed.

• monotouch-test/Mac [dotnet]/Debug [dotnet]: Failed (Test run failed.
  Tests run: 2865 Passed: 2770 Inconclusive: 4 Failed: 1 Ignored: 94)
• monotouch-test/Mac [dotnet]/Debug (static registrar) [dotnet]: Failed (Test run failed.
  Tests run: 2862 Passed: 2768 Inconclusive: 4 Failed: 1 Ignored: 93)
• monotouch-test/Mac [dotnet]/Release (NativeAOT, x64) [dotnet]: Failed (Test run failed.
  Tests run: 2861 Passed: 2756 Inconclusive: 4 Failed: 1 Ignored: 104)
• monotouch-test/Mac [dotnet]/Release (static registrar) [dotnet]: Failed (Test run failed.
  Tests run: 2862 Passed: 2766 Inconclusive: 4 Failed: 1 Ignored: 95)
• monotouch-test/Mac [dotnet]/Release (managed static registrar) [dotnet]: Failed (Test run failed.
  Tests run: 2862 Passed: 2766 Inconclusive: 4 Failed: 1 Ignored: 95)
• monotouch-test/Mac [dotnet]/Release (NativeAOT) [dotnet]: Failed (Test run failed.
  Tests run: 2861 Passed: 2756 Inconclusive: 4 Failed: 1 Ignored: 104)
• monotouch-test/Mac [dotnet]/Release (static registrar, all optimizations) [dotnet]: Failed (Test run failed.
  Tests run: 2862 Passed: 2768 Inconclusive: 4 Failed: 1 Ignored: 93)
• monotouch-test/Mac [dotnet]/Debug (managed static registrar) [dotnet]: Failed (Test run failed.
  Tests run: 2862 Passed: 2768 Inconclusive: 4 Failed: 1 Ignored: 93)
• monotouch-test/Mac [dotnet]/Release (managed static registrar, all optimizations) [dotnet]: Failed (Test run failed.
  Tests run: 2862 Passed: 2768 Inconclusive: 4 Failed: 1 Ignored: 93)

Html Report (VSDrops) Download

❌ xammac tests

🔥 Failed catastrophically on VSTS: test results - xammac (no summary found).

Html Report (VSDrops) Download

Successes

✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 8 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 7 tests passed. Html Report (VSDrops) Download
✅ generator: All 2 tests passed. Html Report (VSDrops) Download
✅ install-source: All 1 tests passed. Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 7 tests passed. Html Report (VSDrops) Download
✅ linker: All 65 tests passed. Html Report (VSDrops) Download
✅ mac-binding-project: All 1 tests passed. Html Report (VSDrops) Download
✅ mononative: All 6 tests passed. Html Report (VSDrops) Download
✅ monotouch (iOS): All 11 tests passed. Html Report (VSDrops) Download
✅ monotouch (tvOS): All 11 tests passed. Html Report (VSDrops) Download
✅ monotouch (watchOS): All 4 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ mtouch: All 1 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 8 tests passed. Html Report (VSDrops) Download
✅ xtro: All 2 tests passed. Html Report (VSDrops) Download

Pipeline on Agent
Hash: [PR build]

[vs-mobiletools-engineering-service2]

💻 [CI Build] Windows Integration Tests passed 💻

✅ All Windows Integration Tests passed.

Pipeline on Agent
Hash: d4a1ed93cf1e05b95b8fd9bbc9ac8a34740e2313 [PR build]

[vs-mobiletools-engineering-service2]

❌ [CI Build] Windows Integration Tests failed ❌

❌ Failed ❌

Pipeline on Agent
Hash: d4a1ed93cf1e05b95b8fd9bbc9ac8a34740e2313 [PR build]