SEACAS tests failing in ATDM builds on mutrino

Created by: fryeguy52

CC: @bartlettroscoe, @trilinos/seacas

Next Action Status

Switching from 'salloc' to 'sbatch' eliminated all but one of the failing tests and the remaining failing test SEACASExodus_exodus_unit_tests was disabled in commit d12ca4eb merged to 'develop' in PR #3011 on 6/26/2018.

Summary

The following tests are failing in the nightly jenkins jobs of the ATDM configuration on mutrino

SEACASAprepro_aprepro_command_line_include_test SEACASAprepro_aprepro_command_line_vars_test SEACASAprepro_aprepro_unit_test SEACASAprepro_lib_aprepro_lib_array_test SEACASAprepro_lib_aprepro_lib_unit_test SEACASExodus_exodus_unit_tests

The list of failures can be seen here on CDash

They are failing in both Trilinos-atdm-mutrino-intel-opt-openmp Trilinos-atdm-mutrino-intel-debug-openmp

It looks like they all have something like this in the error output:

TEST_2

Running: "diff" "-w" "/lscratch1/jenkins/mutrino-slave/workspace/Trilinos-atdm-mutrino-intel-opt-openmp/SRC_AND_BUILD/Trilinos/packages/seacas/libraries/aprepro_lib/test_standard.out" "/lscratch1/jenkins/mutrino-slave/workspace/Trilinos-atdm-mutrino-intel-opt-openmp/SRC_AND_BUILD/BUILD/packages/seacas/libraries/aprepro_lib/test.output"

--------------------------------------------------------------------------------

diff: /lscratch1/jenkins/mutrino-slave/workspace/Trilinos-atdm-mutrino-intel-opt-openmp/SRC_AND_BUILD/BUILD/packages/seacas/libraries/aprepro_lib/test.output: No such file or directory

--------------------------------------------------------------------------------

TEST_2: Return code = 2
TEST_2: Pass criteria = Zero return code [FAILED]
TEST_2: Result = FAILED

Steps to Reproduce

on mutrino clone Trilinos and run the following. This will automatically set up the environment.

$ cd <some_build_dir>/

$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh intel-opt-openmp

$ cmake \
  -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \
  -DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_SEACAS=ON \
  $TRILINOS_DIR

$ make -j16

$ salloc -N 1 -p standard -J $JOB_NAME ctest -j16

Environment

This is set up automatically in the instructions to reproduce above