Bifrost tests fail #20

nithyanandan · 2018-09-10T19:46:38Z

(EPIC-dev) t_nithyanandan@intrepid:/data3/t_nithyanandan/codes/others/python/Bifrost/JamesKent$ make test
#make -C src test
cd test && ./download_test_data.sh ; python -m unittest discover
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 3929k  100 3929k    0     0  4380k      0 --:--:-- --:--:-- --:--:-- 4400k
mv: cannot move 'for_test_suite' to 'data/for_test_suite': Directory not empty
WARNING: Install simplejson for better performance
WARNING: Install simplejson for better performance
WARNING: Install simplejson for better performance
..........................................rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/sequence0': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/in': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/sequence0': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/out': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/in': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/sequence0': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/out': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/in': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/sequence0': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/out': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/in': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/OfflineCaptureOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/OfflineCaptureOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/OfflineCaptureOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/OfflineCaptureOp/out': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/rings/gridandfft': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/rings/transpose': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/rings/fengine': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/rings/capture': Permission denied
.....#### DIFFERENCE: 0.104001 ####
E.....s...........................................................................................................................................s.............s..............F.................
======================================================================
ERROR: test_ntime_1024_nchan2_npol2_gridsize256_illumsize10_datasize256 (test_romein.RomeinTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_romein.py", line 132, in test_ntime_1024_nchan2_npol2_gridsize256_illumsize10_datasize256
    self.run_test(grid_size=256, illum_size=10, data_size=256, ntime=1024, npol=2, nchan=2)
  File "test_romein.py", line 117, in run_test
    raise ValueError("Large difference between naive romein and CUDA implementation.")
ValueError: Large difference between naive romein and CUDA implementation.

======================================================================
FAIL: test_read_write (test_binary_io.BinaryIOTest)
Read from a binary file, then write to another one
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_binary_io.py", line 82, in test_read_write
    np.testing.assert_almost_equal(self.s1, outdata1)
  File "/data3/t_nithyanandan/src/anaconda/envs/EPIC-dev/lib/python2.7/site-packages/numpy/testing/utils.py", line 573, in assert_almost_equal
    return assert_array_almost_equal(actual, desired, decimal, err_msg)
  File "/data3/t_nithyanandan/src/anaconda/envs/EPIC-dev/lib/python2.7/site-packages/numpy/testing/utils.py", line 979, in assert_array_almost_equal
    precision=decimal)
  File "/data3/t_nithyanandan/src/anaconda/envs/EPIC-dev/lib/python2.7/site-packages/numpy/testing/utils.py", line 747, in assert_array_compare
    raise AssertionError(msg)
AssertionError: 
Arrays are not almost equal to 7 decimals

(shapes (33554432,), (33292288,) mismatch)
 x: array([ 0.       ,  0.0399893,  0.0799147, ...,  0.7024202,  0.7856785,
        0.7856785], dtype=float32)
 y: array([ 0.       ,  0.0399893,  0.0799147, ...,  0.9955596,  0.9760557,
        0.9760557], dtype=float32)

----------------------------------------------------------------------
Ran 240 tests in 1001.039s

FAILED (failures=1, errors=1, skipped=3)
rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/sequence0': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/SaveOp/in': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/sequence0': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/out': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/MOFFCorrelatorOp/in': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/sequence0': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/out': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/TransposeOp/in': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/sequence0': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/out': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/FDomainOp/in': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/OfflineCaptureOp/perf': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/OfflineCaptureOp/size': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/OfflineCaptureOp/bind': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/OfflineCaptureOp/out': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/rings/gridandfft': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/rings/transpose': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/rings/fengine': Permission denied
rm: cannot remove '/dev/shm/bifrost/142615/rings/capture': Permission denied
Makefile:19: recipe for target 'test' failed
make: *** [test] Error 1

The text was updated successfully, but these errors were encountered:

adampbeardsley · 2018-09-10T19:58:54Z

This looks like the errors we get when we do user installs but don't copy over Jayce's proclog.cpp file. Did you copy that over before running the make commands?

jaycedowell · 2018-09-10T22:18:23Z

The proclog.cpp thing usually leads to ring-related errors. The two errors/failures here look to be something different. Both are accuracy errors, though, one from romein and one from binaryio. I may have seen the romein one before but not the io one.

adampbeardsley · 2018-09-10T22:28:48Z

Oh sorry, I just saw all the permission denieds. I got the io error in NM, and I think the answer was that two of us were running at the same time. I don't think anyone's running now though...

jaycedowell · 2018-09-10T22:43:18Z

Oh, binaryio fails for me on intrepid as well. I wonder what is causing that?

jaycedowell · 2018-09-11T14:26:40Z

I'm getting the same binaryio error on ADP as well. It can probably be ignored.

I have no clue about the romein one.

jaycedowell · 2018-09-11T15:15:52Z

I also get the romein error on ADP.

KentJames · 2018-09-15T04:19:49Z

The romein error is I think coming from my compare case using 64 bit arithmetic whereas Romein is using 32-bit, so there is some mismatch. The whole romein stuff in bifrost needs a lot of attention from me to stabilise it. It works, but can't say much more of it. jaycedowell <[email protected]> writes:

…

I also get the romein error on ADP. -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/nithyanandan/EPIC/issues/20#issuecomment-420310671

nithyanandan · 2018-09-18T17:29:55Z

So these are not show-stoppers?

jaycedowell · 2018-09-18T19:30:02Z

I think so.

KentJames · 2018-09-19T01:38:16Z

No they should not be. I am fairly sure its just floating point error thrown up in an extreme test case. When I rebuild the romein back-end in bifrost I will build a proper series of tests too, nithyanandan <[email protected]> writes:

…

So these are not show-stoppers? -- You are receiving this because you commented. Reply to this email directly or view it on GitHub: https://github.com/nithyanandan/EPIC/issues/20#issuecomment-422480086

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Bifrost tests fail #20

Bifrost tests fail #20

nithyanandan commented Sep 10, 2018

adampbeardsley commented Sep 10, 2018

jaycedowell commented Sep 10, 2018

adampbeardsley commented Sep 10, 2018

jaycedowell commented Sep 10, 2018

jaycedowell commented Sep 11, 2018

jaycedowell commented Sep 11, 2018

KentJames commented Sep 15, 2018 via email

nithyanandan commented Sep 18, 2018

jaycedowell commented Sep 18, 2018

KentJames commented Sep 19, 2018 via email

Bifrost tests fail #20

Bifrost tests fail #20

Comments

nithyanandan commented Sep 10, 2018

adampbeardsley commented Sep 10, 2018

jaycedowell commented Sep 10, 2018

adampbeardsley commented Sep 10, 2018

jaycedowell commented Sep 10, 2018

jaycedowell commented Sep 11, 2018

jaycedowell commented Sep 11, 2018

KentJames commented Sep 15, 2018 via email

nithyanandan commented Sep 18, 2018

jaycedowell commented Sep 18, 2018

KentJames commented Sep 19, 2018 via email