Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Run regression tests on Travis #35

Open
wants to merge 54 commits into
base: develop
Choose a base branch
from
Open

Run regression tests on Travis #35

wants to merge 54 commits into from

Commits on Jul 10, 2019

  1. Test mpirun and mpiexec commands

    @nightlark
    nightlark authored Jul 10, 2019
    Configuration menu
    Copy the full SHA
    aeef947 View commit details
    Browse the repository at this point in the history

  2. Install mpich on Travis

    @nightlark
    nightlark authored Jul 10, 2019
    Configuration menu
    Copy the full SHA
    8529034 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2019

  1. Run TraceR simulation on Travis

    @nightlark
    nightlark authored Jul 25, 2019
    Configuration menu
    Copy the full SHA
    2ddcb92 View commit details
    Browse the repository at this point in the history

  2. Test install TraceR on Travis

    @nightlark
    nightlark authored Jul 25, 2019
    Configuration menu
    Copy the full SHA
    2026548 View commit details
    Browse the repository at this point in the history

  3. Pass arguments to make install on Travis

    @nightlark
    nightlark authored Jul 25, 2019
    Configuration menu
    Copy the full SHA
    ee6280f View commit details
    Browse the repository at this point in the history

  4. Return to starting directory before running TraceR

    @nightlark
    nightlark authored Jul 25, 2019
    Configuration menu
    Copy the full SHA
    93c96c3 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2019

  1. Add baseline regression test output files

    @nightlark
    nightlark committed Aug 16, 2019
    Configuration menu
    Copy the full SHA
    399fa1e View commit details
    Browse the repository at this point in the history

  2. Bash script to compare output files with regression test files

    @nightlark
    nightlark committed Aug 16, 2019
    Configuration menu
    Copy the full SHA
    630c750 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #1 from nightlark/travis-test-mpirun 

    Run TraceR with a dfly network on the stencil4d-otf example on Travis
    @nightlark
    nightlark authored Aug 16, 2019
    Configuration menu
    Copy the full SHA
    c14fb6e View commit details
    Browse the repository at this point in the history

  4. Output files from dfly example run in tests/output folder

    @nightlark
    nightlark authored Aug 16, 2019
    Configuration menu
    Copy the full SHA
    25ac0f3 View commit details
    Browse the repository at this point in the history

  5. Run check files script to compare regression files against output fil… 

    …es for stencil4d dfly test
    @nightlark
    nightlark authored Aug 16, 2019
    Configuration menu
    Copy the full SHA
    063b7c4 View commit details
    Browse the repository at this point in the history

  6. Move check to its own entry under script (exit status needs to fail b… 

    …uild)
    @nightlark
    nightlark authored Aug 16, 2019
    Configuration menu
    Copy the full SHA
    6d661fd View commit details
    Browse the repository at this point in the history

  7. Create an output folder for results from running tests

    @nightlark
    nightlark authored Aug 16, 2019
    Configuration menu
    Copy the full SHA
    30478ba View commit details
    Browse the repository at this point in the history

  8. Output the diff for files that regression tests that don't match

    @nightlark
    nightlark authored Aug 16, 2019
    Configuration menu
    Copy the full SHA
    5e50139 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2019

  1. Switch to using git diff tool for word-level diff

    @nightlark
    nightlark committed Aug 23, 2019
    Configuration menu
    Copy the full SHA
    6d00002 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'ci-test' of https://github.com/nightlark/TraceR into ci… 

    …-test
    @nightlark
    nightlark committed Aug 23, 2019
    Configuration menu
    Copy the full SHA
    2065c81 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2019

  1. Check that removing the git diff header works on Travis

    @nightlark
    nightlark committed Aug 26, 2019
    Configuration menu
    Copy the full SHA
    c49cb9e View commit details
    Browse the repository at this point in the history

  2. Test out float val extraction

    @nightlark
    nightlark committed Aug 26, 2019
    Configuration menu
    Copy the full SHA
    7c35187 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2019

  1. Tweak the detection of allowable diff lines and extraction of floatin… 

    …g point time num
    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    17d3ac8 View commit details
    Browse the repository at this point in the history

  2. Switch to alternate form of checking if return code for diff was 0

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    d988019 View commit details
    Browse the repository at this point in the history

  3. Add floating point value check

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    fe96166 View commit details
    Browse the repository at this point in the history

  4. Set tolerance check to something that should fail

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    0467fe1 View commit details
    Browse the repository at this point in the history

  5. Change tolerance check to something that should pass

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    ad28bdb View commit details
    Browse the repository at this point in the history

  6. Clean-up recv_time check output

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    9bca43b View commit details
    Browse the repository at this point in the history

  7. Fix bash error on echo

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    83ffb93 View commit details
    Browse the repository at this point in the history

  8. Add missing closing quote

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    dd630d3 View commit details
    Browse the repository at this point in the history

  9. Tweak debug output for diff comparison

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    821d797 View commit details
    Browse the repository at this point in the history

  10. Bash debug output

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    f553136 View commit details
    Browse the repository at this point in the history

  11. Tweak one of the checks

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    0e87168 View commit details
    Browse the repository at this point in the history

  12. Fix up the logic for detecting non-recv_time diff

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    c9a51f6 View commit details
    Browse the repository at this point in the history

  13. Typo in variable name fix

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    98060d2 View commit details
    Browse the repository at this point in the history

  14. Turn off verbose debug output for file diff checking

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    a49fab6 View commit details
    Browse the repository at this point in the history

  15. Run test with other network configurations

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    b1ffc26 View commit details
    Browse the repository at this point in the history

  16. Use the right conf file for hypreX_expressMesh, and use mpirun exit c… 

    …ode for success/fail
    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    2ea7191 View commit details
    Browse the repository at this point in the history

  17. Update setting return value for multi-line steps to avoid premature s… 

    …cript exit
    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    3f871d8 View commit details
    Browse the repository at this point in the history

  18. Apply suggestions from ShellCheck.net

    @nightlark
    nightlark authored Aug 27, 2019
    Configuration menu
    Copy the full SHA
    f80bf19 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2019

  1. Check msg-stats file for CI tests

    @nightlark
    nightlark committed Sep 4, 2019
    Configuration menu
    Copy the full SHA
    63214f2 View commit details
    Browse the repository at this point in the history

  2. Tweak checking for failure

    @nightlark
    nightlark committed Sep 4, 2019
    Configuration menu
    Copy the full SHA
    0c7a9ad View commit details
    Browse the repository at this point in the history

  3. Fix failing for msg-stats file mismatches

    @nightlark
    nightlark committed Sep 4, 2019
    Configuration menu
    Copy the full SHA
    d1b7ef0 View commit details
    Browse the repository at this point in the history

  4. Refactor msg-stat checking to handle different types of time fields

    @nightlark
    nightlark committed Sep 4, 2019
    Configuration menu
    Copy the full SHA
    366e456 View commit details
    Browse the repository at this point in the history

  5. Add time tolerance check for very small variations on Travis

    @nightlark
    nightlark committed Sep 4, 2019
    Configuration menu
    Copy the full SHA
    1ebaac0 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2019

  1. Apply suggestions from ShellCheck.net

    @nightlark
    nightlark authored Sep 5, 2019
    Configuration menu
    Copy the full SHA
    ed87517 View commit details
    Browse the repository at this point in the history

  2. Switch line splitting to use read -a

    @nightlark
    nightlark authored Sep 5, 2019
    Configuration menu
    Copy the full SHA
    956c43b View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2019

  1. Add files for checking TraceR stdout simulation prints

    @nightlark
    nightlark committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    f21bf42 View commit details
    Browse the repository at this point in the history

  2. Create test output directory before writing to it

    @nightlark
    nightlark committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    79b443c View commit details
    Browse the repository at this point in the history

  3. Dump filtered output to log

    @nightlark
    nightlark committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    7a564e3 View commit details
    Browse the repository at this point in the history

  4. Try outputting directly to console after piping output

    @nightlark
    nightlark committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    6534c9c View commit details
    Browse the repository at this point in the history

  5. Test running set

    @nightlark
    nightlark committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    f8b3276 View commit details
    Browse the repository at this point in the history

  6. Remove early creation of output directory

    @nightlark
    nightlark committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    34cecb6 View commit details
    Browse the repository at this point in the history

  7. Reduce the set of lines checked

    @nightlark
    nightlark committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    8c5f8f2 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2019

  1. Update regression test output

    @nightlark
    nightlark committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    f87ebc3 View commit details
    Browse the repository at this point in the history

  2. Update std.out file for tests

    @nightlark
    nightlark committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    761e29e View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2019

  1. Update std.out for fattree

    @nightlark
    nightlark committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    7d015f2 View commit details
    Browse the repository at this point in the history

  2. Fix syntax error

    @nightlark
    nightlark authored Oct 2, 2019
    Configuration menu
    Copy the full SHA
    97f52b9 View commit details
    Browse the repository at this point in the history