Skip to content

Encountering BCL test failures in System.Numerics.Tests on Android when AOT + LLVM are enabled #1451

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
pjcollins opened this issue Mar 20, 2018 · 5 comments
Labels
Area: Unit Tests Issues with repo unit tests.

Comments

@pjcollins
Copy link
Member

pjcollins commented Mar 20, 2018

I'm seeing failures in the following new XUnit tests when AOT and LLVM are enabled. Failure messages and stack traces can be found in the test result xml linked at the bottom.

System.Numerics.Tests.Matrix4x4Tests.Matrix4x4CreateReflectionTest01
System.Numerics.Tests.Matrix4x4Tests.Matrix4x4CreateShadowTest02
System.Numerics.Tests.PlaneTests.PlaneConstructorTest
System.Numerics.Tests.PlaneTests.PlaneConstructorTest1
System.Numerics.Tests.PlaneTests.PlaneConstructorTest3
System.Numerics.Tests.PlaneTests.PlaneCreateFromVerticesTest
System.Numerics.Tests.PlaneTests.PlaneEqualityTest
System.Numerics.Tests.PlaneTests.PlaneEqualsNanTest
System.Numerics.Tests.PlaneTests.PlaneInequalityTest

Steps to Reproduce

  1. Download prebuilt .apk file, and run it on an armeabi-v8a device:

adb install 15-7-aotllvm-Xamarin.Android.Bcl_Tests-Signed.apk
adb shell am instrument -w Xamarin.Android.Bcl_Tests/xamarin.android.bcltests.XUnitInstrumentation

  1. Alternatively, a smaller repro which contains the relevant test source could likely be built and installed with AOT+LLVM enabled.

Details

Link to .apk file - https://microsoft-my.sharepoint.com/:u:/p/pecolli/EYrN-tuwhJFJmkrnwj5vAgIBzEQFPGZkCUcmSkNMJUYMUg?e=LBt3gv
Link to obj output - https://microsoft-my.sharepoint.com/:u:/p/pecolli/EXGoMM2LZURMhg8mPY8IUyoBgDudDiDsjXrLA86zaPjHSQ?e=3YL4a8

Version Information

Windows 10 w/ VS 15.7
Xamarin.Android SDK 8.3.0.5 (HEAD/1a8ed5388)

Log File

https://gist.githubusercontent.com/pjcollins/bdb1339e280e64e64cf9d9400f0640a4/raw/40416b509416840f94fe42e908ae427d320aa6e0/BclXUnit_release_aot_llvmTestResult.xml

@pjcollins
Copy link
Member Author

Adding to d15-7 as these failures occur in newly added tests in this release and it would be good to get some sort of assessment of severity that is not dependent on historical data before shipping.

@grendello
Copy link
Contributor

This is likely a duplicate of #1452 (and possibly #1444). The same assessment applies.

@luhenry
Copy link
Contributor

luhenry commented Apr 4, 2018

/cc @vargaz could you please take a look?

@pjcollins pjcollins removed this from the d15-7 milestone Apr 4, 2018
@pjcollins
Copy link
Member Author

I'm going to remove the d15-7 milestone at this point based on related severity/priority discussions.

@pjcollins
Copy link
Member Author

I'm no longer able to reproduce this with mono/2018-02. Resolving.

@ghost ghost locked as resolved and limited conversation to collaborators Jun 8, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Area: Unit Tests Issues with repo unit tests.
Projects
None yet
Development

No branches or pull requests

3 participants