MueLu: Tests failing on ATDM cuda 10 build

Created by: fryeguy52

Bug Report

CC: @trilinos/muelu, @srajama1 (Trilinos Linear Solvers Product Lead), @bartlettroscoe, @fryeguy52

Next Action Status

Description

As shown in this query the tests:

• MueLu_Maxwell3D-Epetra_MPI_4
• MueLu_ImportPerformance_Epetra_MPI_4
• MueLu_ImportPerformance_Tpetra_MPI_4

are failing in the build:

• Trilinos-atdm-white-ride-cuda-10.1-gnu-7.2.0-release-debug

this is common in the output:

MueLu_ImportPerformance.exe: sys/memtype_cache.c:90: ucs_memtype_cache_delete: Assertion `pgt_region != ((void *)0)' failed.

Current Status on CDash

Current failing MueLu tests on this build

Steps to Reproduce

One should be able to reproduce this failure on ride or white as described in:

• https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md

More specifically, the commands given for ride or white are provided at:

• https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#ridewhite

The exact commands to reproduce this issue should be:

$ cd <some_build_dir>/
$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh Trilinos-atdm-white-ride-cuda-10.1-gnu-7.2.0-release-debug
$ cmake \
 -GNinja \
 -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \
 -DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_MueLu=ON \
 $TRILINOS_DIR
$ make NP=16
$ bsub -x -Is -q rhel7F -n 16 ctest -j16