KokkosKernels_graph tests timing out in ATDM builds
Created by: fryeguy52
CC: @trilinos/kokkoskernels, @kddevin (Trilinos Data Services Product Lead), @bartlettroscoe, @fryeguy52
??: Add label "ATDM"> ??: Add label "bug"?> ??: Add label for affected packages (e.g. "MueLu", "Tpetra", "Kokkos", etc.)> ??: Add milestone "Initial cleanup of new ATDM builds of Trilinos" or "Keep promoted ATDM builds of Trilinos clean"> ??: Once GitHub Issue is created, add entries for tests to TrilinosATDMStatus/*.csv files> ??: Add label "PA: ???Project Area???" (e.g. "PA: Linear Solvers", "PA: Data Services")>Next Action Status
Description
As shown in this query the tests:
- KokkosKernels_graph_openmp_MPI_1
- KokkosKernels_graph_serial_MPI_1
started timing out on 2019-04-07 in the builds:
- Trilinos-atdm-hansen-shiller-gnu-debug-serial
- Trilinos-atdm-waterman-cuda-9.2-debug
- Trilinos-atdm-white-ride-cuda-9.2-gnu-7.2.0-debug
- Trilinos-atdm-white-ride-gnu-7.2.0-openmp-debug
Current Status on CDash
Failures for the current testing day can be found here
Steps to Reproduce
One should be able to reproduce this failure on ride or white as described in:
More specifically, the commands given for ride or white are provided at:
The exact commands to reproduce this issue should be:
$ cd <some_build_dir>/
$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh Trilinos-atdm-white-ride-gnu-7.2.0-openmp-debug
$ cmake \
-GNinja \
-DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \
-DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_KokkosKernels=ON \
$TRILINOS_DIR
$ make NP=16
$ bsub -x -Is -q rhel7F -n 16 ctest -j16