Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd #84911

Closed
v-wenyuxu opened this issue Apr 17, 2023 · 29 comments · Fixed by #106495
Closed

Test failure baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd #84911

v-wenyuxu opened this issue Apr 17, 2023 · 29 comments · Fixed by #106495
Assignees
@janvorli
Labels
arch-arm32 arch-arm64 area-VM-coreclr blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' blocking-clean-ci-optional Blocking optional rolling runs disabled-test The test is disabled in source code against the issue in-pr There is an active PR which will close this issue when it is merged JitStress CLR JIT issues involving JIT internal stress modes Known Build Error Use this to report build issues in the .NET Helix tab os-linux Linux OS (any supported distro) os-windows Priority:1 Work that is critical for the release, but we could probably ship without
Milestone
9.0.0

Comments

@v-wenyuxu
Copy link

v-wenyuxu commented Apr 17, 2023 •
edited by build-analysis bot
Loading

Run: runtime-coreclr jitstress-isas-x86 20230415.1

Failed test:

coreclr windows x86 Checked jitstress_isas_nohwintrinsic @ Windows.10.Amd64.Open

- baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd

Error message:

cmdLine:C:\h\w\B25509AE\w\A1800911\e\baseservices\exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.cmd Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 4/15/2023 9:38:05 PM, end: 4/15/2023 10:08:05 PM)

Return code:      -100
Raw output file:      C:\h\w\B25509AE\w\A1800911\uploads\Reports\baseservices.exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.output.txt
Raw output:
BEGIN EXECUTION
"C:\h\w\B25509AE\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  stackoverflowtester.dll
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeat 43042 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"

cmdLine:C:\h\w\B25509AE\w\A1800911\e\baseservices\exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.cmd Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 4/15/2023 9:38:05 PM, end: 4/15/2023 10:08:05 PM)
Invoking: C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\cdb.exe -c "$<C:\h\w\B25509AE\t\tmpofmm5c.tmp" -z "C:\cores\crashdump_3180.dmp"
stdout:
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.

Loading Dump File [C:\cores\crashdump_3180.dmp]
User Mini Dump File with Full Memory: Only application data is available

************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:\h\w\B25509AE\p\PDB
Symbol search path is: C:\h\w\B25509AE\p\PDB
Executable search path is:
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.5125 (rs1_release.220429-1732)
Machine Name:
Debug session time: Sat Apr 15 22:08:05.000 2023 (UTC + 0:00)
System Uptime: 0 days 0:47:51.988
Process Uptime: 0 days 0:29:54.000
ERROR: Reload failure, partially initialized target
WaitForEvent failed, HRESULT 0x8000FFFF
Catastrophic failure
When WaitForEvent fails on dump files the current state is not displayed.
If you are having symbol problems you will need to restart the debugger
after you correct the symbol path.  .restart can also be used.
?:???> cdb: Reading initial command '$<C:\h\w\B25509AE\t\tmpofmm5c.tmp'
?:???> .load C:\Users\runner.dotnet\sos\sos.dll
WARNING: The debugger does not have a current process or thread
WARNING: Many commands will not work
?:???> ~*k
WARNING: The debugger does not have a current process or thread
WARNING: Many commands will not work
^ Illegal thread error in '~*k'
?:???> !clrstack -f -all
WARNING: The debugger does not have a current process or thread
WARNING: Many commands will not work
Extension called without current PC
SOS does not support the current target architecture '' (0x0000). A 32 bit target may require a 32 bit debugger or vice versa. In general, try to use the same bitness for the debugger and target process.
?:???> q
WARNING: The debugger does not have a current process or thread
WARNING: Many commands will not work
quit:
NatVis script unloaded from 'C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\Visualizers\atlmfc.natvis'
NatVis script unloaded from 'C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\Visualizers\concurrency.natvis'
NatVis script unloaded from 'C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\Visualizers\cpp_rest.natvis'
NatVis script unloaded fr


Stack trace
   at baseservices_exceptions._stackoverflow_stackoverflowtester_stackoverflowtester_._stackoverflow_stackoverflowtester_stackoverflowtester_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": ["stackoverflowtester","Timed Out"],
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎
Result validation: ⚠️ Provided build not found. Provide a valid build in the "Build: 🔎" line.
Validation performed at: 7/28/2024 3:43:37 AM UTC

Report

Build Definition Test Pull Request
776063 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106413
776041 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106414
775936 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106139
775734 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #100272
775644 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105288
774985 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106164
774360 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105030
774234 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106328
773688 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106309
773437 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106000
773189 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106289
773146 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106287
772522 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106253
772131 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
771959 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106224
771572 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106210
771470 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106208
771327 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106130
770591 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105867
770680 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106179
770472 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106169
769920 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106146
769596 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106125
769233 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106103
769148 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106099
767713 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #104503
767505 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #106023
766166 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105945
765937 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105866
765436 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105909
765422 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105918
764816 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105877
764679 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105902
764671 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105901
764565 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105830
764396 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #104964
764272 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105869
763784 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105854
763492 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105844
762756 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105802
760956 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105353
760835 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd
760458 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105703
758039 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #105587
757926 dotnet/runtime baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd #104536

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 18 45
@v-wenyuxu v-wenyuxu added arch-x86 os-windows JitStress CLR JIT issues involving JIT internal stress modes labels Apr 17, 2023
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Apr 17, 2023
@ghost
Copy link

ghost commented Apr 17, 2023

Tagging subscribers to this area: @tommcdon
See info in area-owners.md if you want to be subscribed.

Issue Details

Run: runtime-coreclr jitstress-isas-x86 20230415.1

Failed test:

coreclr windows x86 Checked jitstress_isas_nohwintrinsic @ Windows.10.Amd64.Open

- baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd

Error message:

cmdLine:C:\h\w\B25509AE\w\A1800911\e\baseservices\exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.cmd Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 4/15/2023 9:38:05 PM, end: 4/15/2023 10:08:05 PM)

Return code:      -100
Raw output file:      C:\h\w\B25509AE\w\A1800911\uploads\Reports\baseservices.exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.output.txt
Raw output:
BEGIN EXECUTION
"C:\h\w\B25509AE\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  stackoverflowtester.dll
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeat 43042 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"

cmdLine:C:\h\w\B25509AE\w\A1800911\e\baseservices\exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.cmd Timed Out (timeout in milliseconds: 1800000 from variable __TestTimeout, start: 4/15/2023 9:38:05 PM, end: 4/15/2023 10:08:05 PM)
Invoking: C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\cdb.exe -c "$<C:\h\w\B25509AE\t\tmpofmm5c.tmp" -z "C:\cores\crashdump_3180.dmp"
stdout:
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.

Loading Dump File [C:\cores\crashdump_3180.dmp]
User Mini Dump File with Full Memory: Only application data is available

************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:\h\w\B25509AE\p\PDB
Symbol search path is: C:\h\w\B25509AE\p\PDB
Executable search path is:
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.5125 (rs1_release.220429-1732)
Machine Name:
Debug session time: Sat Apr 15 22:08:05.000 2023 (UTC + 0:00)
System Uptime: 0 days 0:47:51.988
Process Uptime: 0 days 0:29:54.000
ERROR: Reload failure, partially initialized target
WaitForEvent failed, HRESULT 0x8000FFFF
Catastrophic failure
When WaitForEvent fails on dump files the current state is not displayed.
If you are having symbol problems you will need to restart the debugger
after you correct the symbol path.  .restart can also be used.
?:???> cdb: Reading initial command '$<C:\h\w\B25509AE\t\tmpofmm5c.tmp'
?:???> .load C:\Users\runner.dotnet\sos\sos.dll
WARNING: The debugger does not have a current process or thread
WARNING: Many commands will not work
?:???> ~*k
WARNING: The debugger does not have a current process or thread
WARNING: Many commands will not work
^ Illegal thread error in '~*k'
?:???> !clrstack -f -all
WARNING: The debugger does not have a current process or thread
WARNING: Many commands will not work
Extension called without current PC
SOS does not support the current target architecture '' (0x0000). A 32 bit target may require a 32 bit debugger or vice versa. In general, try to use the same bitness for the debugger and target process.
?:???> q
WARNING: The debugger does not have a current process or thread
WARNING: Many commands will not work
quit:
NatVis script unloaded from 'C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\Visualizers\atlmfc.natvis'
NatVis script unloaded from 'C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\Visualizers\concurrency.natvis'
NatVis script unloaded from 'C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\Visualizers\cpp_rest.natvis'
NatVis script unloaded fr


Stack trace
   at baseservices_exceptions._stackoverflow_stackoverflowtester_stackoverflowtester_._stackoverflow_stackoverflowtester_stackoverflowtester_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
Author: v-wenyuxu
Assignees: -
Labels:

arch-x86, os-windows, JitStress, area-Diagnostics-coreclr
Milestone: -

@BruceForstall
Copy link
Member

Another stackoverflowtester failure @janvorli

@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr pgostress 20230428.1

Failed test:

coreclr windows x86 Checked fullpgo_random_gdv_edge @ Windows.10.Amd64.Open

- baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd

Error message:

Return code:      1
Raw output file:      C:\h\w\B2CC0955\w\BE6309C4\uploads\Reports\baseservices.exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.output.txt
Raw output:
BEGIN EXECUTION
"C:\h\w\B2CC0955\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  stackoverflowtester.dll
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeat 43046 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeat 43146 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow3 test()
Call number 50 to the Execute method
Call number 100 to the Execute method
Call number 150 to the Execute method
"Stack overflow."
""
Missing "Main" method frame at the last line
Expected: 100
Actual: 105
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:\cores since 4/29/2023 7:45:07 AM
Processing C:\cores\corerun.exe.456.dmp
Invoking: C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\cdb.exe -c "$<C:\h\w\B2CC0955\t\tmpgn5gfm.tmp" -z "C:\cores\corerun.exe.456.dmp"
stdout:
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.


Loading Dump File [C:\cores\corerun.exe.456.dmp]
User Mini Dump File with Full Memory: Only application data is available


************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:\h\w\B2CC0955\p\PDB
Symbol search path is: C:\h\w\B2CC0955\p\PDB
Executable search path is:
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.5125 (rs1_release.220429-1732)
Machine Name:
Debug session time: Sat Apr 29 07:45:21.000 2023 (UTC + 0:00)
System Uptime: 0 days 0:18:47.456
Process Uptime: 0 days 0:00:02.000
.....................



Stack trace
   at baseservices_exceptions._stackoverflow_stackoverflowtester_stackoverflowtester_._stackoverflow_stackoverflowtester_stackoverflowtester_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

@AndyAyersMS AndyAyersMS mentioned this issue May 8, 2023
Merged
@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr pgostress 20230512.1

Failed tests:

coreclr windows x86 Checked fullpgo_methodprofiling_always_optimized @ Windows.10.Amd64.Open
    - baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd

�Error message:

 
Return code:      1
Raw output file:      C:\h\w\B9540A1E\w\AD6109A2\uploads\Reports\baseservices.exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.output.txt
Raw output:
BEGIN EXECUTION
 "C:\h\w\B9540A1E\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  stackoverflowtester.dll 
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeat 43089 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeat 43118 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow3 test()
Call number 50 to the Execute method
Call number 100 to the Execute method
Call number 150 to the Execute method
"Stack overflow."
""
Missing "Main" method frame at the last line
Expected: 100
Actual: 105
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:\cores since 5/13/2023 7:48:12 AM
Processing C:\cores\corerun.exe.440.dmp
Invoking: C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\cdb.exe -c "$<C:\h\w\B9540A1E\t\tmpmoza50.tmp" -z "C:\cores\corerun.exe.440.dmp"
stdout: 
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.


Loading Dump File [C:\cores\corerun.exe.440.dmp]
User Mini Dump File with Full Memory: Only application data is available


************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:\h\w\B9540A1E\p\PDB
Symbol search path is: C:\h\w\B9540A1E\p\PDB
Executable search path is: 
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.5125 (rs1_release.220429-1732)
Machine Name:
Debug session time: Sat May 13 07:48:33.000 2023 (UTC + 0:00)
System Uptime: 0 days 0:30:39.175
P

�Stack trace:

    at baseservices_exceptions._stackoverflow_stackoverflowtester_stackoverflowtester_._stackoverflow_stackoverflowtester_stackoverflowtester_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

@BruceForstall BruceForstall added the blocking-clean-ci-optional Blocking optional rolling runs label May 15, 2023
@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr jitstress 20230522.1

Failed tests:

coreclr windows x86 Checked jitstress1_tiered @ Windows.10.Amd64.Open
    - baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd

Error message:

 
Return code:      1
Raw output file:      C:\h\w\A9C9091B\w\B25509AA\uploads\Reports\baseservices.exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.output.txt
Raw output:
BEGIN EXECUTION
 "C:\h\w\A9C9091B\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  stackoverflowtester.dll 
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeat 43040 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeat 43137 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow3 test()
Call number 50 to the Execute method
Call number 100 to the Execute method
Call number 150 to the Execute method
"Stack overflow."
""
Missing "Main" method frame at the last line
Expected: 100
Actual: 105
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:\cores since 5/23/2023 5:55:31 AM
Processing C:\cores\corerun.exe.5652.dmp
Invoking: C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\cdb.exe -c "$<C:\h\w\A9C9091B\t\tmptw5p5t.tmp" -z "C:\cores\corerun.exe.5652.dmp"
stdout: 
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.


Loading Dump File [C:\cores\corerun.exe.5652.dmp]
User Mini Dump File with Full Memory: Only application data is available


************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:\h\w\A9C9091B\p\PDB
Symbol search path is: C:\h\w\A9C9091B\p\PDB
Executable search path is: 
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.5125 (rs1_release.220429-1732)
Machine Name:
Debug session time: Tue May 23 05:56:11.000 2023 (UTC + 0:00)
System Uptime: 0 days 0:20:07.721
Process Uptime: 0 days 0:00:05.000
...............................

************* Symbol Loading Er

Stack trace:

    at baseservices_exceptions._stackoverflow_stackoverflowtester_stackoverflowtester_._stackoverflow_stackoverflowtester_stackoverflowtester_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

@EgorBo EgorBo mentioned this issue May 26, 2023
Merged
@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr pgostress 20230602.1

Failed test:

coreclr windows x86 Checked fullpgo_random_gdv @ Windows.10.Amd64.Open

- baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd

Error message:

Return code:      1
Raw output file:      C:\h\w\BC640A32\w\A7F30A14\uploads\Reports\baseservices.exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.output.txt
Raw output:
BEGIN EXECUTION
"C:\h\w\BC640A32\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  stackoverflowtester.dll
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeat 43056 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeat 43143 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow3 test()
Call number 50 to the Execute method
Call number 100 to the Execute method
Call number 150 to the Execute method
"Stack overflow."
""
Missing "Main" method frame at the last line
Expected: 100
Actual: 105
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:\cores since 6/3/2023 7:59:38 AM
Processing C:\cores\corerun.exe.2632.dmp
Invoking: C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\cdb.exe -c "$<C:\h\w\BC640A32\t\tmpc5w10r.tmp" -z "C:\cores\corerun.exe.2632.dmp"
stdout:
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.


Loading Dump File [C:\cores\corerun.exe.2632.dmp]
User Mini Dump File with Full Memory: Only application data is available


************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:\h\w\BC640A32\p\PDB
Symbol search path is: C:\h\w\BC640A32\p\PDB
Executable search path is:
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.5125 (rs1_release.220429-1732)
Machine Name:
Debug session time: Sat Jun  3 07:59:59.000 2023 (UTC + 0:00)
System Uptime: 0 days 0:12:23.506
Process Uptime: 0 days 0:00:03.000
...................



Stack trace
   at baseservices_exceptions._stackoverflow_stackoverflowtester_stackoverflowtester_._stackoverflow_stackoverflowtester_stackoverflowtester_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

This was referenced Jun 8, 2023
Merged
Merged
Merged
@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr pgostress 20230609.1

Failed tests:

coreclr windows x86 Checked syntheticpgo @ Windows.10.Amd64.Open
    - baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd

Error message:

 
Return code:      1
Raw output file:      C:\h\w\B17E0A04\w\97780881\uploads\Reports\baseservices.exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.output.txt
Raw output:
BEGIN EXECUTION
 "C:\h\w\B17E0A04\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  stackoverflowtester.dll 
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeat 43058 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeat 43124 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow3 test()
Call number 50 to the Execute method
Call number 100 to the Execute method
Call number 150 to the Execute method
"Stack overflow."
""
Missing "Main" method frame at the last line
Expected: 100
Actual: 105
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:\cores since 6/10/2023 7:54:44 AM
Processing C:\cores\corerun.exe.8752.dmp
Invoking: C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\cdb.exe -c "$<C:\h\w\B17E0A04\t\tmpgcaqye.tmp" -z "C:\cores\corerun.exe.8752.dmp"
stdout: 
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.


Loading Dump File [C:\cores\corerun.exe.8752.dmp]
User Mini Dump File with Full Memory: Only application data is available


************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:\h\w\B17E0A04\p\PDB
Symbol search path is: C:\h\w\B17E0A04\p\PDB
Executable search path is: 
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.5125 (rs1_release.220429-1732)
Machine Name:
Debug session time: Sat Jun 10 07:55:01.

Stack trace:

    at baseservices_exceptions._stackoverflow_stackoverflowtester_stackoverflowtester_._stackoverflow_stackoverflowtester_stackoverflowtester_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

@sherlock-xu
Copy link

Failed again in: runtime-coreclr jitstress 20230619.1

Failed tests:

coreclr windows x86 Checked jitstress2_tiered @ Windows.10.Amd64.Open
    - baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd

�Error message:

 
Return code:      1
Raw output file:      C:\h\w\9DF70875\w\A7630927\uploads\Reports\baseservices.exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.output.txt
Raw output:
BEGIN EXECUTION
 "C:\h\w\9DF70875\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  stackoverflowtester.dll 
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeat 43094 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeat 43129 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow3 test()
Call number 50 to the Execute method
Call number 100 to the Execute method
Call number 150 to the Execute method
"Stack overflow."
""
Missing "Main" method frame at the last line
Expected: 100
Actual: 105
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:\cores since 6/20/2023 6:03:14 AM
Processing C:\cores\corerun.exe.1232.dmp
Invoking: C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\cdb.exe -c "$<C:\h\w\9DF70875\t\tmpexugwc.tmp" -z "C:\cores\corerun.exe.1232.dmp"
stdout: 
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.


Loading Dump File [C:\cores\corerun.exe.1232.dmp]
User Mini Dump File with Full Memory: Only application data is available


************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:\h\w\9DF70875\p\PDB
Symbol search path is: C:\h\w\9DF70875\p\PDB
Executable search path is: 
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.5125 (rs1_release.220429-1732)
Machine Name:
Debug session time: Tue Jun 20 06:03:28.000 2023 (UTC + 0:00)
System Uptime: 0 days 0:08:33.988
Process Uptime: 0 days 0:00:02.000
...............................

************* Symbol Loading Error Summary **************
Module name            Error
ntdll                  The system cannot find the file specified

You can troubleshoot most symbol related issues by turning on symbol loading diagnostics (!sym noi

�Stack trace:

    at baseservices_exceptions._stackoverflow_stackoverflowtester_stackoverflowtester_._stackoverflow_stackoverflowtester_stackoverflowtester_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

�

@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr pgostress 20230714.1

Failed tests:

coreclr windows x86 Checked fullpgo_random_gdv @ Windows.10.Amd64.Open
    - baseservices\\exceptions\\stackoverflow\\stackoverflowtester\\stackoverflowtester.cmd

Error message:

 
Return code:      1
Raw output file:      C:\h\w\B06C09AA\w\BB3A09FD\uploads\Reports\baseservices.exceptions\stackoverflow\stackoverflowtester\stackoverflowtester.output.txt
Raw output:
BEGIN EXECUTION
 "C:\h\w\B06C09AA\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  stackoverflowtester.dll 
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeat 43086 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeat 43113 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeat 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread+StartHelper.RunWorker()"
"   at System.Threading.Thread+StartHelper.Run()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow3 test()
Call number 50 to the Execute method
Call number 100 to the Execute method
Call number 150 to the Execute method
"Stack overflow."
""
Missing "Main" method frame at the last line
Expected: 100
Actual: 105
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:\cores since 7/15/2023 7:54:09 AM
Processing C:\cores\corerun.exe.2596.dmp
Invoking: C:\Program Files (x86)\Windows Kits\10\Debuggers\x86\cdb.exe -c "$<C:\h\w\B06C09AA\t\tmp01xfwp.tmp" -z "C:\cores\corerun.exe.2596.dmp"
stdout: 
Microsoft (R) Windows Debugger Version 10.0.18362.1 X86
Copyright (c) Microsoft Corporation. All rights reserved.


Loading Dump File [C:\cores\corerun.exe.2596.dmp]
User Mini Dump File with Full Memory: Only application data is available


************* Path validation summary **************
Response                         Time (ms)     Location
OK                                             C:\h\w\B06C09AA\p\PDB
Symbol search path is: C:\h\w\B06C09AA\p\PDB
Executable search path is: 
Windows 10 Version 14393 MP (4 procs) Free x86 compatible
Product: Server, suite: TerminalServer DataCenter SingleUserTS
10.0.14393.5125 (rs1_release.220429-1732)
Machine Name:
Debug session time: Sat Jul 15 07:54:45.000 2023 (UTC + 0:00)
System Uptime: 0 days 0:07:38.164

Stack trace:

   at baseservices_exceptions._stackoverflow_stackoverflowtester_stackoverflowtester_._stackoverflow_stackoverflowtester_stackoverflowtester_cmd()
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

@BruceForstall
Copy link
Member

Related: #46175

Test is disabled on Linux, for NativeAOT, and on mono.

BruceForstall added a commit to BruceForstall/runtime that referenced this issue Jul 18, 2023
@BruceForstall
Disable stackoverflowtester test for win-x86
970bb90 
Tracking: dotnet#84911
@BruceForstall BruceForstall mentioned this issue Jul 18, 2023
Merged
@BruceForstall
Copy link
Member

@mangod9

stephentoub pushed a commit that referenced this issue Jul 18, 2023
@BruceForstall
Disable stackoverflowtester test for win-x86 (#89062)
8e9222b 
Tracking: #84911
@stephentoub stephentoub added the disabled-test The test is disabled in source code against the issue label Jul 18, 2023
@BruceForstall BruceForstall removed the blocking-clean-ci-optional Blocking optional rolling runs label Jul 18, 2023
@mangod9 mangod9 removed the untriaged New issue has not been triaged by the area owner label Jul 24, 2023
@JulieLeeMSFT
Copy link
Member

Assigned to @janvorli because it is also blocking jit experimental pipeline. https://dev.azure.com/dnceng-public/public/_build?definitionId=137.

@JulieLeeMSFT JulieLeeMSFT added the blocking-clean-ci-optional Blocking optional rolling runs label Aug 5, 2024
@v-wenyuxu
Copy link
Author

Failed in: runtime-coreclr outerloop 20240807.4

Failed tests:

coreclr linux arm Checked @ (Alpine.316.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.17-helix-arm32v7
    - baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd

Error message:

 
Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
/root/helix/work/correlation/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174529 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeated 32793 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeated 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow3 test()
Call number 50 to the Execute method
Call number 100 to the Execute method
Call number 150 to the Execute method
Call number 200 to the Execute method
Call number 250 to the Execute method
Call number 300 to the Execute method
Call number 350 to the Execute method
Call number 400 to the Execute method
Call number 450 to the Execute method
Call number 500 to the Execute method
Call number 550 to the Execute method
Call number 600 to the Execute method
Call number 650 to the Execute method
Call number 700 to the Execute method
Call number 750 to the Execute method
Call number 800 to the Execute method
Call number 850 to the Execute method
Call number 900 to the Execute method
Call number 950 to the Execute method
Call number 1000 to the Execute method
"Stack overflow."
""
System.Exception: Missing "Main" method frame at the last line
   at TestStackOverflow.Program.TestStackOverflow3()
   at __GeneratedMainWrapper.Main()
Expected: 100
Actual: 101
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 8/7/2024 7:36:16 PM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

@v-wenyuxu
Copy link
Author

Failed in: runtime-coreclr outerloop 20240808.10

Failed tests:

coreclr osx x64 Checked @ OSX.1200.Amd64.Open
    - baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd

Error message:

 
cmdLine:/private/tmp/helix/working/AD970953/w/B08909A2/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 8/8/2024 10:28:57 PM, end: 8/8/2024 10:38:57 PM)

Return code:      -100
Raw output file:      /tmp/helix/working/AD970953/w/B08909A2/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/AD970953/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174562 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeated 32746 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeated 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow3 test()
Call number 50 to the Execute method
Call number 100 to the Execute method
Call number 150 to the Execute method
Call number 200 to the Execute method
Call number 250 to the Execute method
Call number 300 to the Execute method
Call number 350 to the Execute method
Call number 400 to the Execute method
Call number 450 to the Execute method
Call number 500 to the Execute method
Call number 550 to the Execute method
Call number 600 to the Execute method
Call number 650 to the Execute method
Call number 700 to the Execute method
Call number 750 to the Execute method
Call number 800 to the Execute method
Call number 850 to the Execute method
Call number 900 to the Execute method
Call number 950 to the Execute method
Call number 1000 to the Execute method
"Stack overflow."
"Repeated 1033 times:"
"--------------------------------"
"   at TestStackOverflow3.Program.Execute(System.String)"
"--------------------------------"
"   at TestStackOverflow3.Program.Main()"

cmdLine:/private/tmp/helix/working/AD970953/w/B08909A2/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 8/8/2024 10:28:57 PM, end: 8/8/2024 10:38:57 PM)
Printing stacktrace from '/cores/crashdump_13073.dmp

Stack trace:

   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

@mangod9
Copy link
Member

mangod9 commented Aug 9, 2024

Adding @kouvel as well.

@v-wenyuxu
Copy link
Author

Failed in: runtime-coreclr outerloop 20240811.3

Failed tests:

coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open
    - baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd

Error message:

 
cmdLine:/private/tmp/helix/working/B5ED09B3/w/BFF109B7/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 8/11/2024 10:27:16 PM, end: 8/11/2024 10:37:16 PM)

Return code:      -100
Raw output file:      /tmp/helix/working/B5ED09B3/w/BFF109B7/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/B5ED09B3/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174561 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeated 32746 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeated 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"

cmdLine:/private/tmp/helix/working/B5ED09B3/w/BFF109B7/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 8/11/2024 10:27:16 PM, end: 8/11/2024 10:37:16 PM)
Printing stacktrace from '/cores/crashdump_32426.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Errors while running llvm-symbolizer --pretty-print
System.ComponentModel.Win32Exception (2): An error occurred trying to start process 'llvm-symbolizer' with working directory '/private/tmp/helix/working/B5ED09B3/w/BFF109B7/e/baseservices/exceptions/baseservices-exceptions'. No such file or directory
   at System.Diagnostics.Process.ForkAndExecProcess(ProcessStartInfo startInfo, String resolvedFilename, String[] argv, String[] envp, String cwd, Boolean setCredentials, UInt32 userId, UInt32 groupId, UInt32[] groups, Int32& stdinFd, Int32& stdoutFd, Int32& stderrFd, Boolean usesTerminal, Boolean throwOnNoExec) in /_/src/libraries/System.Diagnostics.Process/src/System/Diagnostics/Process.Unix.cs:line 496
   at System.Diagnostics.Process.StartCore(ProcessStartInfo startInfo) in /_/src/libraries/System.Diagnostics.Process/src/System/Diagnostics/Process.Unix.cs:line 456
   at CoreclrTestLib.CoreclrTestWrapperLib.TryPrintStackTraceFr

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

@JulieLeeMSFT JulieLeeMSFT added os-linux Linux OS (any supported distro) arch-arm32 arch-arm64 labels Aug 13, 2024
@JulieLeeMSFT
Copy link
Member

Hit on linux x64, arm32, arm64 in https://dev.azure.com/dnceng/internal/_build/results?buildId=2504198&view=ms.vss-test-web.build-test-results-tab

Also in https://dev.azure.com/dnceng-public/public/_build/results?buildId=757891&view=ms.vss-test-web.build-test-results-tab

Hit again on Linux arm32, arm64, x64 in runtime-coreclr superpmi-collect/20240811.1

BEGIN EXECUTION
/root/helix/work/correlation/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
""
System.Exception: Exit code: 0x0000008B, expected 0x00000086
   at TestStackOverflow.Program.TestStackOverflow(String testName, String testArgs, List`1& stderrLines)
   at TestStackOverflow.Program.TestStackOverflowSmallFrameMainThread()
   at __GeneratedMainWrapper.Main()
Expected: 100
Actual: 101
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 8/11/2024 7:35:08 PM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh
   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

@JulieLeeMSFT JulieLeeMSFT added the Priority:1 Work that is critical for the release, but we could probably ship without label Aug 13, 2024
@v-wenyuxu
Copy link
Author

Failed in: runtime-coreclr outerloop 20240813.6

Failed tests:

coreclr osx x64 Checked @ OSX.1200.Amd64.Open
    - baseservices/exceptions/stackoverflow/stackoverflowtester/stackoverflowtester.cmd

Error message:

 
cmdLine:/private/tmp/helix/working/AEB20984/w/B8EB0A01/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 8/13/2024 10:30:15 PM, end: 8/13/2024 10:40:15 PM)

Return code:      -100
Raw output file:      /tmp/helix/working/AEB20984/w/B8EB0A01/uploads/stackoverflow/stackoverflowtester/output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/AEB20984/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true stackoverflowtester.dll ''
Running stackoverflow test(smallframe main)
"Stack overflow."
"Repeated 174562 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(largeframe main)
"Stack overflow."
"Repeated 42 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program.Main(System.String[])"
""
Running stackoverflow test(smallframe secondary)
"Stack overflow."
"Repeated 32746 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC()"
"   at TestStackOverflow.Program.InfiniteRecursionB()"
"   at TestStackOverflow.Program.InfiniteRecursionA()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"
""
Running stackoverflow test(largeframe secondary)
"Stack overflow."
"Repeated 8 times:"
"--------------------------------"
"   at TestStackOverflow.Program.InfiniteRecursionC2()"
"   at TestStackOverflow.Program.InfiniteRecursionB2()"
"   at TestStackOverflow.Program.InfiniteRecursionA2()"
"--------------------------------"
"   at TestStackOverflow.Program.Test(Boolean)"
"   at TestStackOverflow.Program+<>c__DisplayClass7_0.<SecondaryThreadsTest>b__0()"
"   at System.Threading.Thread.StartCallback()"

cmdLine:/private/tmp/helix/working/AEB20984/w/B8EB0A01/e/baseservices/exceptions/baseservices-exceptions/../stackoverflow/stackoverflowtester/stackoverflowtester.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 8/13/2024 10:30:15 PM, end: 8/13/2024 10:40:15 PM)
Printing stacktrace from '/cores/crashdump_84836.dmp.crashreport.json'
Invoking llvm-symbolizer --pretty-print
Errors while running llvm-symbolizer --pretty-print
System.ComponentModel.Win32Exception (2): An error occurred trying to start process 'llvm-symbolizer' with working directory '/private/tmp/helix/working/AEB20984/w/B8EB0A01/e/baseservices/exceptions/baseservices-exceptions'. No such file or directory
   at System.Diagnostics.Process.ForkAndExecProcess(ProcessStartInfo startInfo, String resolvedFilename, String[] argv, String[] envp, String cwd, Boolean setCredentials, UInt32 userId, UInt32 groupId, UInt32[] groups, Int32& stdinFd, Int32& stdoutFd, Int32& stderrFd, Boolean usesTerminal, Boolean throwOnNoExec) in /_/src/libraries/System.Diagnostics.Process/src/System/Diagnostics/Process.Unix.cs:line 498
   at System.Diagnostics.Process.StartCore(ProcessStartInfo startInfo) in /_/src/libraries/System.Diagnostics.Process/src/System/Diagnostics/Process.Unix.cs:line 456
   at Sy

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor134|0_135(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

kouvel added a commit to kouvel/runtime that referenced this issue Aug 14, 2024
@kouvel
Disable stackoverflowtester test for osx-x64
78de818 
Tracking: dotnet#84911
@kouvel kouvel mentioned this issue Aug 14, 2024
Merged
kouvel added a commit that referenced this issue Aug 14, 2024
@kouvel
Disable stackoverflowtester test for osx-x64 (#106411)
5df4214 
Tracking: #84911
@janvorli
Copy link
Member

I am taking over this issue as I've just got back from my vacation. The stack overflow tester app fails with SIGSEGV instead of stack overflow in the failure cases, so it seems like the stack overflow detection doesn't work in some edge cases.

@janvorli
Copy link
Member

It seems that in all the cases, it occurs when stack overflow was triggered on the main thread without stack probing.

@janvorli
Copy link
Member

The issue occurs with spmi only.

@jakobbotsch
Copy link
Member

@janvorli All the failures in the table above should be from innerloop pipelines. E.g. here's one from a rolling runtime run with an osx-x64 failure: https://dev.azure.com/dnceng-public/public/_build/results?buildId=772131&view=results

@janvorli
Copy link
Member

osx-x64 is a different story. It hangs waiting for the child process exit (the child exits, but the wait handle is never signaled). We had the same problem with unhandled exception tests on osx-x64. It is not clear why that happens yet.

The linux though is caused by a bug in the sigsegv handler and I am about to send a PR with a fix.

janvorli added a commit to janvorli/runtime that referenced this issue Aug 15, 2024
@janvorli
Fix stack overflow handling with SuperPMI
5747a13 
When SuperPMI shared library is loaded last, its SIGSEGV handler
is the first one that's executed. But since there is no coreclr runtime handler
installed for it, it returns from the SwitchStackAndExecuteHandler in case
of SIGSEGV. The remaining code in the SIGSEGV handler was not expecting that and
thought that there was no stack overflow and attempted to run the hardware exception
handler on the original stack of the thread, which obviously crashed since the original
stack overflowed.
The fix is to make sure that we only call the previously registered signal handler in
this case.

Close dotnet#84911
janvorli added a commit to janvorli/runtime that referenced this issue Aug 15, 2024
@janvorli
Fix stack overflow handling with SuperPMI
c9b8b43 
When SuperPMI shared library is loaded last, its SIGSEGV handler
is the first one that's executed. But since there is no coreclr runtime handler
installed for it, it returns from the SwitchStackAndExecuteHandler in case
of SIGSEGV. The remaining code in the SIGSEGV handler was not expecting that and
thought that there was no stack overflow and attempted to run the hardware exception
handler on the original stack of the thread, which obviously crashed since the original
stack overflowed.
The fix is to make sure that we only call the previously registered signal handler in
this case.

Close dotnet#84911
@janvorli janvorli mentioned this issue Aug 15, 2024
Merged
@dotnet-policy-service dotnet-policy-service bot added the in-pr There is an active PR which will close this issue when it is merged label Aug 15, 2024
@github-actions github-actions bot locked and limited conversation to collaborators Sep 16, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@janvorli janvorli

Labels
arch-arm32 arch-arm64 area-VM-coreclr blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' blocking-clean-ci-optional Blocking optional rolling runs disabled-test The test is disabled in source code against the issue in-pr There is an active PR which will close this issue when it is merged JitStress CLR JIT issues involving JIT internal stress modes Known Build Error Use this to report build issues in the .NET Helix tab os-linux Linux OS (any supported distro) os-windows Priority:1 Work that is critical for the release, but we could probably ship without
Projects
None yet
Milestone
9.0.0
Development

Successfully merging a pull request may close this issue.

Fix stack overflow handling with SuperPMI janvorli/runtime