Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure on Helix tests - Tests timing out #40074

Open
MiYanni opened this issue Apr 9, 2024 · 7 comments
Open

Failure on Helix tests - Tests timing out #40074

MiYanni opened this issue Apr 9, 2024 · 7 comments

Comments

@MiYanni
Copy link
Member

MiYanni commented Apr 9, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
903749 dotnet/sdk Microsoft.NET.Build.Tests.dll.12.WorkItemExecution #45629
903748 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45630
903619 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45644
903621 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45589
903407 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45642
903382 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45637
903360 dotnet/sdk dotnet.Tests.dll.16.WorkItemExecution #45625
903341 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45614
903294 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45639
903240 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45637
903207 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45635
902850 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45160
901349 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45589
902880 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45630
902686 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45630
902648 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #42416
902506 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45622
902436 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45623
902478 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45567
902439 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45625
899898 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45567
902416 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45622
902381 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45614
902031 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45615
902375 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #45419
902340 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45552
902284 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45419
902221 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45620
902162 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45619
902134 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45618
901984 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45354
900775 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45522
901888 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45615
897207 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45485
901732 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45612
901638 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45611
901419 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45019
901401 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution #45605
901376 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45071
901350 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45588
901021 dotnet/sdk dotnet-sln.Tests.dll.2.WorkItemExecution #45598
901150 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45603
901153 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45369
901149 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45071
901137 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45545
901056 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #45156
901050 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45570
898008 dotnet/sdk dotnet.Tests.dll.1.WorkItemExecution #45494
900953 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45592
900095 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45312
900736 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45592
900723 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45435
900702 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45591
900662 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45584
900595 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45589
900428 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45570
900477 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #45522
900261 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45574
900106 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #44843
900056 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45553
900065 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45463
900034 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45435
899922 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45564
899860 dotnet/sdk dotnet.Tests.dll.27.WorkItemExecution #45566
899886 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45435
899870 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution #45462
899826 dotnet/sdk dotnet.Tests.dll.23.WorkItemExecution #45549
899815 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45565
899786 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution #45563
899811 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #45552
899763 dotnet/sdk Microsoft.NET.Publish.Tests.dll.2.WorkItemExecution #44461
899662 dotnet/sdk Microsoft.NET.Publish.Tests.dll.2.WorkItemExecution #45564
899562 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45561
899531 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45418
899521 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45554
899419 dotnet/sdk dotnet.Tests.dll.11.WorkItemExecution #45522
899405 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45560
899373 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45559
898521 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45527
899323 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45545
899343 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45558
898646 dotnet/sdk dotnet-sln.Tests.dll.2.WorkItemExecution #45534
899298 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45549
899157 dotnet/sdk Microsoft.NET.Publish.Tests.dll.3.WorkItemExecution #45547
899202 dotnet/sdk dotnet-sln.Tests.dll.1.WorkItemExecution #45463
899189 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45552
899175 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45554
899138 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #45553
899089 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45550
899080 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45530
899042 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45476
899035 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #44874
898974 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45549
898895 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45353
898800 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45071
898839 dotnet/sdk Microsoft.NET.Publish.Tests.dll.8.WorkItemExecution #45544
898822 dotnet/sdk Microsoft.NET.Publish.Tests.dll.8.WorkItemExecution #45462
898285 dotnet/sdk Microsoft.NET.Publish.Tests.dll.8.WorkItemExecution #45389
898790 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45540
898765 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45427
Displaying 100 of 510 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
4 36 510
@nagilson
Copy link
Member

@tmat May you please look at this dotnet watch failure?

@tmat
Copy link
Member

tmat commented May 20, 2024

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

@nagilson
Copy link
Member

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

@nagilson
Copy link
Member

We also just hit it in main, so there might be another existing problem: #41045

@baronfel
Copy link
Member

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

@tmat
Copy link
Member

tmat commented Aug 15, 2024

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

@baronfel
Copy link
Member

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.

@akoeplinger akoeplinger changed the title Darwin Build_Release failure on Helix tests - Tests timing out Failure on Helix tests - Tests timing out Nov 15, 2024
@marcpopMSFT marcpopMSFT added this to the 10.0.1xx milestone Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants