Stokhos build failure for CUDA 8.0 Debug build on white/ride

Created by: bartlettroscoe

CC: @trilinos/stokhos, @rppawlo (Trilinos Nonlinear Solvers Product Lead)

Next Action Status

PR #3100 merged on 7/13/2018 resulted in 100% clean build (but not tests), including Stokhos, on 7/14/2018.

Description

The creation of the Stokhos library libstokhos_muelu.a fails in the CUDA 8.0 debug build Trilinos-atdm-white-ride-cuda-debug-pt-all-at-once 'white' and 'ride'. The build error output for the build this morning shown here on 'white' shows:

/usr/bin/ar: packages/stokhos/src/libstokhos_muelu.a: File truncated

Steps to reproduce

This build error can reproduced on 'white' or 'ride' as described in the document:

• https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md

The specific instructions for 'white' or 'ride' are given at:

• https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#ridewhite

The one difference is that this build of all of the Primary Tested Trilinos packages (that includes more package than are being used by ATDM APPs currently) does not exclude any Trilinos packages and tweaks a few other settings so it uses the file Trilinos/cmake/std/atdm/ATDMDevEnvAllPtPackages.cmake instead of the file ATDMDevEnv.cmake.

After cloning Trilinos, the following commands should reproduce the build failure:

$ cd <some_build_dir>/

$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh cuda-debug

$ cmake \
  -GNinja \
  -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnvAllPtPackages.cmake \
  -DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_Stokhos=ON \
  $TRILINOS_DIR

$ make NP=16

I (@bartlettroscoe) just tired this on 'white' and I was able to reproduce the same build failure shown on CDash shown above.