Trilinos merge requestshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests2018-05-03T04:54:00Zhttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2671Use netlib BLAS and LAPACK instead of OpenBLAS 1.2.19 on white/ride (#2454)2018-05-03T04:54:00ZJames WillenbringUse netlib BLAS and LAPACK instead of OpenBLAS 1.2.19 on white/ride (#2454)*Created by: bartlettroscoe*
**CC:** @trilinos/belos , @trilinos/anasazi, @etphipp
## Description
This appears to fix almost all of the failing Belos and Anaszzi tests on 'white' (see #2454 2454)
## How Has This Been Tested?
...*Created by: bartlettroscoe*
**CC:** @trilinos/belos , @trilinos/anasazi, @etphipp
## Description
This appears to fix almost all of the failing Belos and Anaszzi tests on 'white' (see #2454 2454)
## How Has This Been Tested?
I tested this one 'white' using:
```
$ cd ~/Trilinos.base/BUILD/WHITE/CHECKIN/
$ bsub -x -I -q rhel7F -n 16 \
./checkin-test-atdm.sh all --enable-packages=Belos,Anasazi --local-do-all
```
This returned:
```
Build test results:
-------------------
0) MPI_RELEASE_DEBUG_SHARED_PT => Test case MPI_RELEASE_DEBUG_SHARED_PT was not run! => Does not affect push readiness! (-1.00 min)
1) gnu-debug-openmp => passed: passed=145,notpassed=0 (4.31 min)
2) gnu-opt-openmp => passed: passed=146,notpassed=0 (6.30 min)
3) cuda-debug => passed: passed=145,notpassed=0 (10.72 min)
4) cuda-opt => FAILED: passed=145,notpassed=1 => Not ready to push! (13.36 min)
```
The only failing test was the 'cuda-opt' test:
```
27 - Belos_pseudo_pcg_hb_0_MPI_4 (Failed)
```
That test was already failing so this is not a regression. We will fix that test next.
The detailed test results are shown below.
<details>
<summary>
<b>Detailed checkin-test-atdm.sh results:</b> (click to expand)
</summary>
```
FAILED (NOT READY TO PUSH): Trilinos: white24
Wed May 2 18:40:48 MDT 2018
Enabled Packages: Belos, Anasazi
Build test results:
-------------------
0) MPI_RELEASE_DEBUG_SHARED_PT => Test case MPI_RELEASE_DEBUG_SHARED_PT was not run! => Does not affect push readiness! (-1.00 min)
1) gnu-debug-openmp => passed: passed=145,notpassed=0 (4.31 min)
2) gnu-opt-openmp => passed: passed=146,notpassed=0 (6.30 min)
3) cuda-debug => passed: passed=145,notpassed=0 (10.72 min)
4) cuda-opt => FAILED: passed=145,notpassed=1 => Not ready to push! (13.36 min)
*** Commits for repo :
1) gnu-debug-openmp Results:
----------------------------
passed: Trilinos/gnu-debug-openmp: passed=145,notpassed=0
Wed May 2 18:10:00 MDT 2018
Enabled Packages: Belos, Anasazi
Hostname: white24
Source Dir: /home/rabartl/Trilinos.base/Trilinos/cmake/tribits/ci_support/../../..
Build Dir: /home/rabartl/Trilinos.base/BUILD/WHITE/CHECKIN/gnu-debug-openmp
CMake Cache Varibles: -GNinja -DTrilinos_TRIBITS_DIR:PATH=/home/rabartl/Trilinos.base/Trilinos/cmake/tribits -DTrilinos_ENABLE_TESTS:BOOL=ON -DTrilinos_TEST_CATEGORIES:STRING=BASIC -DTrilinos_ALLOW_NO_PACKAGES:BOOL=OFF -DDART_TESTING_TIMEOUT:STRING=600.0 -GNinja -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake -DTrilinos_TRACE_ADD_TEST=ON -DTrilinos_ENABLE_Belos:BOOL=ON -DTrilinos_ENABLE_Anasazi:BOOL=ON -DTrilinos_ENABLE_ALL_OPTIONAL_PACKAGES:BOOL=ON -DTrilinos_ENABLE_ALL_FORWARD_DEP_PACKAGES:BOOL=OFF
Make Options: -j 128
CTest Options: -j 16
Pull: Not Performed
Configure: Passed (0.76 min)
Build: Passed (2.75 min)
Test: Passed (0.81 min)
100% tests passed, 0 tests failed out of 145
Subproject Time Summary:
Anasazi = 329.01 sec*proc (74 tests)
Belos = 363.76 sec*proc (71 tests)
Total Test time (real) = 48.36 sec
Total time for gnu-debug-openmp = 4.31 min
2) gnu-opt-openmp Results:
--------------------------
passed: Trilinos/gnu-opt-openmp: passed=146,notpassed=0
Wed May 2 18:16:25 MDT 2018
Enabled Packages: Belos, Anasazi
Hostname: white24
Source Dir: /home/rabartl/Trilinos.base/Trilinos/cmake/tribits/ci_support/../../..
Build Dir: /home/rabartl/Trilinos.base/BUILD/WHITE/CHECKIN/gnu-opt-openmp
CMake Cache Varibles: -GNinja -DTrilinos_TRIBITS_DIR:PATH=/home/rabartl/Trilinos.base/Trilinos/cmake/tribits -DTrilinos_ENABLE_TESTS:BOOL=ON -DTrilinos_TEST_CATEGORIES:STRING=BASIC -DTrilinos_ALLOW_NO_PACKAGES:BOOL=OFF -DDART_TESTING_TIMEOUT:STRING=600.0 -GNinja -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake -DTrilinos_TRACE_ADD_TEST=ON -DTrilinos_ENABLE_Belos:BOOL=ON -DTrilinos_ENABLE_Anasazi:BOOL=ON -DTrilinos_ENABLE_ALL_OPTIONAL_PACKAGES:BOOL=ON -DTrilinos_ENABLE_ALL_FORWARD_DEP_PACKAGES:BOOL=OFF
Make Options: -j 128
CTest Options: -j 16
Pull: Not Performed
Configure: Passed (0.71 min)
Build: Passed (4.86 min)
Test: Passed (0.73 min)
100% tests passed, 0 tests failed out of 146
Subproject Time Summary:
Anasazi = 314.23 sec*proc (74 tests)
Belos = 316.64 sec*proc (72 tests)
Total Test time (real) = 43.52 sec
Total time for gnu-opt-openmp = 6.30 min
3) cuda-debug Results:
----------------------
passed: Trilinos/cuda-debug: passed=145,notpassed=0
Wed May 2 18:27:15 MDT 2018
Enabled Packages: Belos, Anasazi
Hostname: white24
Source Dir: /home/rabartl/Trilinos.base/Trilinos/cmake/tribits/ci_support/../../..
Build Dir: /home/rabartl/Trilinos.base/BUILD/WHITE/CHECKIN/cuda-debug
CMake Cache Varibles: -GNinja -DTrilinos_TRIBITS_DIR:PATH=/home/rabartl/Trilinos.base/Trilinos/cmake/tribits -DTrilinos_ENABLE_TESTS:BOOL=ON -DTrilinos_TEST_CATEGORIES:STRING=BASIC -DTrilinos_ALLOW_NO_PACKAGES:BOOL=OFF -DDART_TESTING_TIMEOUT:STRING=600.0 -GNinja -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake -DTrilinos_TRACE_ADD_TEST=ON -DTrilinos_ENABLE_Belos:BOOL=ON -DTrilinos_ENABLE_Anasazi:BOOL=ON -DTrilinos_ENABLE_ALL_OPTIONAL_PACKAGES:BOOL=ON -DTrilinos_ENABLE_ALL_FORWARD_DEP_PACKAGES:BOOL=OFF
Make Options: -j 128
CTest Options: -j 8
Pull: Not Performed
Configure: Passed (1.30 min)
Build: Passed (7.57 min)
Test: Passed (1.84 min)
100% tests passed, 0 tests failed out of 145
Subproject Time Summary:
Anasazi = 435.97 sec*proc (74 tests)
Belos = 400.05 sec*proc (71 tests)
Total Test time (real) = 110.43 sec
Total time for cuda-debug = 10.72 min
4) cuda-opt Results:
--------------------
FAILED: Trilinos/cuda-opt: passed=145,notpassed=1
Wed May 2 18:40:43 MDT 2018
Enabled Packages: Belos, Anasazi
Hostname: white24
Source Dir: /home/rabartl/Trilinos.base/Trilinos/cmake/tribits/ci_support/../../..
Build Dir: /home/rabartl/Trilinos.base/BUILD/WHITE/CHECKIN/cuda-opt
CMake Cache Varibles: -GNinja -DTrilinos_TRIBITS_DIR:PATH=/home/rabartl/Trilinos.base/Trilinos/cmake/tribits -DTrilinos_ENABLE_TESTS:BOOL=ON -DTrilinos_TEST_CATEGORIES:STRING=BASIC -DTrilinos_ALLOW_NO_PACKAGES:BOOL=OFF -DDART_TESTING_TIMEOUT:STRING=600.0 -GNinja -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake -DTrilinos_TRACE_ADD_TEST=ON -DTrilinos_ENABLE_Belos:BOOL=ON -DTrilinos_ENABLE_Anasazi:BOOL=ON -DTrilinos_ENABLE_ALL_OPTIONAL_PACKAGES:BOOL=ON -DTrilinos_ENABLE_ALL_FORWARD_DEP_PACKAGES:BOOL=OFF
Make Options: -j 128
CTest Options: -j 8
Pull: Not Performed
Configure: Passed (1.29 min)
Build: Passed (10.33 min)
Test: FAILED (1.74 min)
99% tests passed, 1 tests failed out of 146
Subproject Time Summary:
Anasazi = 421.83 sec*proc (74 tests)
Belos = 368.36 sec*proc (72 tests)
Total Test time (real) = 104.25 sec
The following tests FAILED:
27 - Belos_pseudo_pcg_hb_0_MPI_4 (Failed)
Errors while running CTest
Total time for cuda-opt = 13.36 min
```
</details>
## Checklist
- [ ] My commit messages mention the appropriate GitHub issue numbers.
- [ ] All new and existing tests passed.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2792Switch all builds on 'white' and 'ride' to use all-at-oce approch (TRIL-198)2018-05-22T18:18:46ZJames WillenbringSwitch all builds on 'white' and 'ride' to use all-at-oce approch (TRIL-198)*Created by: bartlettroscoe*
Given data from past runs, this should result in less frequent crashing of the
'bsub' command. This will also just speed up the build by about a factor of 2
and speed up running the tests by about 25%.
...*Created by: bartlettroscoe*
Given data from past runs, this should result in less frequent crashing of the
'bsub' command. This will also just speed up the build by about a factor of 2
and speed up running the tests by about 25%.
I tested this locally on 'white' with:
```
$ time env \
JOB_NAME=Trilinos-atdm-white-ride-cuda-debug \
WORKSPACE=$PWD \
Trilinos_PACKAGES=Kokkos,Teuchos \
CTEST_TEST_TYPE=Experimental \
CTEST_DO_SUBMIT=OFF \
CTEST_DO_UPDATES=OFF \
CTEST_START_WITH_EMPTY_BINARY_DIRECTORY=FALSE ~/Trilinos.base/Trilinos/cmake/ctest/drivers/atdm/smart-jenkins-driver.sh \
&> console.out
```
and it showed that it used the all-at-once approach.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2656Teko: Selective disable of single unit test in test Teko_testdriver_tpetra_MPI_12018-04-28T20:51:29ZJames WillenbringTeko: Selective disable of single unit test in test Teko_testdriver_tpetra_MPI_1*Created by: bartlettroscoe*
**CC:** @trilinos/teko, @eric-c-cyr, @fryeguy52
## Description
This PR defines a CMake var `Teko_DISABLE_LSCSTABALIZED_TPETRA_ALPAH_INV_D` and uses it to disable one unit test in the larger set of uni...*Created by: bartlettroscoe*
**CC:** @trilinos/teko, @eric-c-cyr, @fryeguy52
## Description
This PR defines a CMake var `Teko_DISABLE_LSCSTABALIZED_TPETRA_ALPAH_INV_D` and uses it to disable one unit test in the larger set of unit tests `Teko_testdriver_tpetra_MPI_1` and only for select RHEL6 ATDM Trilinos builds. This does not disable any test code for any platform where this test is currently passing. This addresses (at least for now) the failure in #2652.
This replaces the PR #2654.
As part of this PR, I also added commit 47be6fc to allow the checkin-test-atdm.sh script to test all of the supported builds for the RHEL6 ATDM Trilinos platform.
## How Has This Been Tested?
I verified that I could reproduce the failing tests on my CEE LAN RHEL6 machine `ceerws1113` and then verified that this PR branch fixes the tests by disabling just this one test.
Using a base version of 'develop', I tested this locally on ceerws1113 with:
```
$ ./checkin-test-atdm.sh all --enable-packages=Teko --local-do-all
```
this returned:
```
Enabled Packages: Teko
Build test results:
-------------------
0) MPI_RELEASE_DEBUG_SHARED_PT => Test case MPI_RELEASE_DEBUG_SHARED_PT was not run! => Does not affect push readiness! (-1.00 min)
1) gnu-debug-serial => FAILED: passed=18,notpassed=1 => Not ready to push! (1.52 min)
2) gnu-opt-serial => FAILED: passed=18,notpassed=1 => Not ready to push! (0.76 min)
3) gnu-debug-openmp => FAILED: passed=18,notpassed=1 => Not ready to push! (1.58 min)
4) gnu-opt-openmp => passed: passed=19,notpassed=0 (0.79 min)
5) intel-opt-openmp => FAILED: passed=18,notpassed=1 => Not ready to push! (1.18 min)
```
The failing tests where:
```
$ find -maxdepth 2 -name ctest.out -exec grep -H "[(]Failed[)]" {} \;
./gnu-debug-openmp/ctest.out: 4 - Teko_testdriver_tpetra_MPI_1 (Failed)
./gnu-opt-serial/ctest.out: 4 - Teko_testdriver_tpetra_MPI_1 (Failed)
./intel-opt-openmp/ctest.out: 4 - Teko_testdriver_tpetra_MPI_1 (Failed)
./gnu-debug-serial/ctest.out: 4 - Teko_testdriver_tpetra_MPI_1 (Failed)
```
Strange I did not reproduce the failure for the build `gnu-opt-openmp` on `ceerws1113`. I don't now why that is.
Using this updated branch in this PR, I tested this locally on ceerws113 with:
```
$ ./checkin-test-atdm.sh all --enable-packages=Teko --local-do-all
```
this returned:
```
Enabled Packages: Teko
Build test results:
-------------------
0) MPI_RELEASE_DEBUG_SHARED_PT => Test case MPI_RELEASE_DEBUG_SHARED_PT was not run! => Does not affect push readiness! (-1.00 min)
1) gnu-debug-serial => passed: passed=19,notpassed=0 (6.45 min)
2) gnu-opt-serial => passed: passed=19,notpassed=0 (0.43 min)
3) gnu-debug-openmp => passed: passed=19,notpassed=0 (7.31 min)
4) gnu-opt-openmp => passed: passed=19,notpassed=0 (6.37 min)
5) intel-opt-openmp => passed: passed=19,notpassed=0 (20.96 min)
```
The full output from the now passing test is shown below.
<details>
<summary>
<b>Full passing test Teko_testdriver_tpetra_MPI_1 output for build gnu-opt-serial:</b> (click to expand)
</summary>
```
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name ceerws1113 and rank 0!
Running test "SIMPLEPreconditionerFactory_tpetra"
"createPrec" ... PASSED
Teko: Begin debug MSG
SIMPLE Parameters:
inv type = ""
inv v type = "Ifpack2"
inv p type = "Ifpack2"
alpha = 1
use mass = 0
vel scaling = Lumped
SIMPLE Parameter list:
Explicit Velocity Inverse Type = Lumped
Inverse Pressure Type = Ifpack2
Inverse Velocity Type = Ifpack2
Teko: End debug MSG
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
"initializePrec(lumped)" ... PASSED
Teko: Begin debug MSG
SIMPLE Parameters:
inv type = ""
inv v type = "Ifpack2"
inv p type = "Ifpack2"
alpha = 1
use mass = 0
vel scaling = Diagonal
SIMPLE Parameter list:
Explicit Velocity Inverse Type = Diagonal
Inverse Pressure Type = Ifpack2
Inverse Velocity Type = Ifpack2
Teko: End debug MSG
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
"initializePrec(diag)" ... PASSED
Teko: Begin debug MSG
SIMPLE Parameters:
inv type = ""
inv v type = "Ifpack2"
inv p type = "Ifpack2"
alpha = 1
use mass = 0
vel scaling = AbsRowSum
SIMPLE Parameter list:
Explicit Velocity Inverse Type = AbsRowSum
Inverse Pressure Type = Ifpack2
Inverse Velocity Type = Ifpack2
Teko: End debug MSG
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
"initializePrec(absrowsum)" ... PASSED
"uninitializePrec" ... PASSED
"isCompatable" ... PASSED
"diagonal(diag)" ... PASSED
"result(diag)" ... PASSED
Test "SIMPLEPreconditionerFactory_tpetra" completed ... PASSED (8)
Running test "DiagonalPreconditionerFactory_tpetra"
"createPrec" ... PASSED
"initializePrec" ... PASSED
||Z-Y||/||Z|| = 0
"canApply" ... PASSED
Test "DiagonalPreconditionerFactory_tpetra" completed ... PASSED (3)
Running test "LU2x2PreconditionerFactory_tpetra"
"createPrec" ... PASSED
"initializePrec" ... PASSED
"uninitializePrec" ... PASSED
"isCompatable" ... PASSED
"identity" ... PASSED
"diagonal" ... PASSED
"result" ... PASSED
"alphabeta" ... PASSED
Test "LU2x2PreconditionerFactory_tpetra" completed ... PASSED (8)
Running test "LSCStablePreconditionerFactory_tpetra"
"createPrec" ... PASSED
Teko: LSCPrecFact::buildPO BuildStateTime = 0
Teko: LSCPrecFact::buildPO GetInvTime = 2.86102e-06
Teko: LSCPrecFact::buildPO TotalTime = 3.00407e-05
"initializePrec" ... PASSED
"uninitializePrec" ... PASSED
"isCompatable" ... PASSED
Teko: LSCPrecFact::buildPO BuildStateTime = 1.19209e-06
Teko: LSCPrecFact::buildPO GetInvTime = 9.53674e-07
Teko: LSCPrecFact::buildPO TotalTime = 2.00272e-05
"identity" ... PASSED
Teko: LSCPrecFact::buildPO BuildStateTime = 0
Teko: LSCPrecFact::buildPO GetInvTime = 1.90735e-06
Teko: LSCPrecFact::buildPO TotalTime = 4.00543e-05
"diagonal" ... PASSED
Teko: LSCPrecFact::buildPO BuildStateTime = 0
Teko: LSCPrecFact::buildPO GetInvTime = 9.53674e-07
Teko: LSCPrecFact::buildPO TotalTime = 2.5034e-05
"result" ... PASSED
Test "LSCStablePreconditionerFactory_tpetra" completed ... PASSED (7)
Running test "LSCStabilized_tpetra"
Teko: LSCPrecFact::buildPO BuildStateTime = 0
Teko: LSCPrecFact::buildPO GetInvTime = 9.53674e-07
Teko: LSCPrecFact::buildPO TotalTime = 4.1008e-05
"diagonal" ... PASSED
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: LSC::initializeState Build Scaling <mass> type "Diagonal"
Teko: Begin debug MSG
LSC Gamma Parameter = 0.237413
LSC Alpha Parameter = 0.667104
Teko: End debug MSG
Teko: LSC::buildState BuildOpsTime = 0.00371313
Teko: LSC::computeInverses Building inv(F)
Teko: LSC::computeInverses GetInvF = 8.70228e-05
Teko: LSC::computeInverses Building inv(BQBtmC)
Teko: LSC::computeInverses GetInvBQBt = 7.51019e-05
Teko: LSC::buildState BuildInvTime = 0.00018692
Teko: LSCPrecFact::buildPO BuildStateTime = 0.00390792
Teko: LSCPrecFact::buildPO GetInvTime = 1.90735e-06
Teko: LSCPrecFact::buildPO TotalTime = 0.00393581
"strategy" ... PASSED
Test "LSCStabilized_tpetra" completed ... PASSED (2)
Running test "Jacobi2x2PreconditionerFactory_tpetra"
"createPrec" ... PASSED
"initializePrec" ... PASSED
"uninitializePrec" ... PASSED
"isCompatable" ... PASSED
"identity" ... PASSED
"diagonal" ... PASSED
"result" ... PASSED
Teko: Begin debug MSG
Looked up "Block Jacobi"
Built Teuchos::RCP<Teko::PreconditionerFactory>{ptr=0x3cde558,node=0x3c9f0d0,strong_count=1,weak_count=0}
Teko: End debug MSG
Teko: JacobiPrecFact: Building default inverse "Ifpack2"
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: Begin debug MSG
Looked up "Block Jacobi"
Built Teuchos::RCP<Teko::PreconditionerFactory>{ptr=0x3cdcf08,node=0x3c9f0d0,strong_count=1,weak_count=0}
Teko: End debug MSG
Teko: JacobiPrecFact: Building default inverse "ML"
Teko: Inverse "ML" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: JacobiPrecFact: Building inverse 1 "Amesos"
Teko: Inverse "Amesos" is of type strat prec = 0, strat solv = 1, block prec = 0
Teko: JacobiPrecFact: Building inverse 3 "Ifpack"
Teko: Inverse "Ifpack" is of type strat prec = 1, strat solv = 0, block prec = 0
"initializeFromParameterList" ... PASSED
Test "Jacobi2x2PreconditionerFactory_tpetra" completed ... PASSED (8)
Running test "BlockJacobiPreconditionerFactory_tpetra"
"createPrec" ... PASSED
"initializePrec" ... PASSED
"uninitializePrec" ... PASSED
"isCompatible" ... PASSED
Test "BlockJacobiPreconditionerFactory_tpetra" completed ... PASSED (4)
Running test "BlockUpperTriInverseOp_tpetra"
"apply" ... PASSED
"alphabeta" ... PASSED
Test "BlockUpperTriInverseOp_tpetra" completed ... PASSED (2)
Running test "BlockLowerTriInverseOp_tpetra"
"apply" ... PASSED
"alphabeta" ... PASSED
Test "BlockLowerTriInverseOp_tpetra" completed ... PASSED (2)
Running test "tTpetraOperatorWrapper"
"functionality" ... PASSED
Test "tTpetraOperatorWrapper" completed ... PASSED (1)
Running test "InterlacedTpetra"
"buildSubMaps_num" ... PASSED
"buildSubMaps_vec" ... PASSED
"buildMaps" ... PASSED
"one2many" ... PASSED
"many2one" ... PASSED
Test "InterlacedTpetra" completed ... PASSED (5)
Running test "BlockingTpetra"
"buildMaps" ... PASSED
"one2many" ... PASSED
"many2one" ... PASSED
"buildSubBlock" ... PASSED
Test "BlockingTpetra" completed ... PASSED (4)
Running test "TpetraThyraConverter"
"blockThyraToTpetra" ... PASSED
"single_blockThyraToTpetra" ... PASSED
"blockTpetraToThyra" ... PASSED
"single_blockTpetraToThyra" ... PASSED
Test "TpetraThyraConverter" completed ... PASSED (4)
Running test "tGraphLaplacian_tpetra"
"single_array" ... PASSED
"multi_array" ... PASSED
Test "tGraphLaplacian_tpetra" completed ... PASSED (2)
Running test "tParallelInverse_tpetra"
Teko: Inverse "Belos" is of type strat prec = 0, strat solv = 1, block prec = 0
"inverse" ... PASSED
Test "tParallelInverse_tpetra" completed ... PASSED (1)
Running test "tExplicitOps_tpetra"
"mult_diagScaleMatProd" ... PASSED
"mult_diagScaling" ... PASSED
"add" ... PASSED
"mult_modScaleMatProd" ... PASSED
"add_mod" ... PASSED
Test "tExplicitOps_tpetra" completed ... PASSED (5)
Running test "LSCHIntegrationTest_tpetra"
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: LSC::initializeState Build Scaling <mass> type "Diagonal"
Teko: LSC::buildState BuildOpsTime = 0.000283957
Teko: LSC::computeInverses Building inv(F)
Teko: LSC::computeInverses GetInvF = 8.70228e-05
Teko: LSC::computeInverses Building inv(BQBtmC)
Teko: LSC::computeInverses GetInvBQBt = 8.79765e-05
Teko: LSC::computeInverses Building inv(BHBtmC)
Teko: LSC::computeInverses GetInvBHBt = 7.10487e-05
Teko: LSC::buildState BuildInvTime = 0.000277996
Teko: LSCPrecFact::buildPO BuildStateTime = 0.000571966
Teko: LSCPrecFact::buildPO GetInvTime = 1.90735e-06
Teko: LSCPrecFact::buildPO TotalTime = 0.000596046
"hScaling" ... PASSED
Test "LSCHIntegrationTest_tpetra" completed ... PASSED (1)
Running test "Lumping_tpetra"
"lumping" ... PASSED
"invLumping" ... PASSED
Test "Lumping_tpetra" completed ... PASSED (2)
Running test "AbsRowSum_tpetra"
"absRowSum" ... PASSED
"invAbsRowSum" ... PASSED
Test "AbsRowSum_tpetra" completed ... PASSED (2)
Running test "NeumannSeries_tpetra"
Teko: Inverse "Neumann" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: Inverse "Neumann" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
"test_simpleOp" ... PASSED
Teko: Inverse "Neumann" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
"test_scaledOp" ... PASSED
Test "NeumannSeries_tpetra" completed ... PASSED (2)
Running test "PCDStrategy_tpetra"
Teko: Inverse "Ifpack2" is of type strat prec = 1, strat solv = 0, block prec = 0
"PCDStrategy" ... PASSED
Test "PCDStrategy_tpetra" completed ... PASSED (1)
Running test "LSCIntegrationTest_tpetra"
Teko: LSC::initializeState Build Scaling <mass> type "Diagonal"
Teko: LSC::buildState BuildOpsTime = 0.00213313
Teko: LSC::computeInverses Building inv(F)
Teko: LSC::computeInverses GetInvF = 0.0080862
Teko: LSC::computeInverses Building inv(BQBtmC)
Teko: LSC::computeInverses GetInvBQBt = 0.00157905
Teko: LSC::buildState BuildInvTime = 0.00968599
Teko: LSCPrecFact::buildPO BuildStateTime = 0.0118351
Teko: LSCPrecFact::buildPO GetInvTime = 9.53674e-07
Teko: LSCPrecFact::buildPO TotalTime = 0.0118802
"withmassStable" ... PASSED
Teko: LSC::initializeState Build Scaling <F> type "Diagonal"
Teko: LSC::buildState BuildOpsTime = 0.003824
Teko: LSC::computeInverses Building inv(F)
Teko: LSC::computeInverses GetInvF = 0.00873494
Teko: LSC::computeInverses Building inv(BQBtmC)
Teko: LSC::computeInverses GetInvBQBt = 0.00154901
Teko: LSC::buildState BuildInvTime = 0.0103078
Teko: LSCPrecFact::buildPO BuildStateTime = 0.014163
Teko: LSCPrecFact::buildPO GetInvTime = 1.90735e-06
Teko: LSCPrecFact::buildPO TotalTime = 0.0141981
"nomassStable" ... PASSED
Teko: Begin debug MSG
Looked up "NS LSC"
Built Teuchos::RCP<Teko::PreconditionerFactory>{ptr=0x3e70d38,node=0x3dc1fb0,strong_count=1,weak_count=0}
Teko: End debug MSG
Teko: Building LSC strategy "Basic Inverse"
Teko: Begin debug MSG
LSC Inverse Strategy Parameters:
inv type = "Amesos"
inv v type = "Ifpack"
inv p type = "Ifpack"
bndry rows = 1
use ldu = 1
use mass = 0
use w-scaling = 0
assume stable = 0
scale type = Diagonal
LSC Inverse Strategy Parameter list:
Inverse Type = Amesos
Inverse Velocity Type = Ifpack
Inverse Pressure Type = Ifpack
Ignore Boundary Rows = 1
Use LDU = 1
Teko: End debug MSG
Teko: Inverse "Ifpack" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: Begin debug MSG
Looked up "NS LSC"
Built Teuchos::RCP<Teko::PreconditionerFactory>{ptr=0x3e458d8,node=0x3ed1290,strong_count=1,weak_count=0}
Teko: End debug MSG
Teko: Building LSC strategy "Basic Inverse"
Teko: Begin debug MSG
LSC Inverse Strategy Parameters:
inv type = "Amesos"
inv v type = "Ifpack"
inv p type = "Ifpack"
bndry rows = 1
use ldu = 1
use mass = 0
use w-scaling = 0
assume stable = 0
scale type = Diagonal
LSC Inverse Strategy Parameter list:
Inverse Type = Amesos
Inverse Velocity Type = Ifpack
Inverse Pressure Type = Ifpack
Ignore Boundary Rows = 1
Use LDU = 1
Teko: End debug MSG
Teko: Inverse "Ifpack" is of type strat prec = 1, strat solv = 0, block prec = 0
Teko: Begin debug MSG
Looked up "NS LSC"
Built Teuchos::RCP<Teko::PreconditionerFactory>{ptr=0x3e70d38,node=0x3dc1fb0,strong_count=1,weak_count=0}
Teko: End debug MSG
Teko: Building LSC strategy "The Cat"
LSC Construction failed: Strategy "The Cat" could not be constructed
Teko: Begin debug MSG
Looked up "NS LSC"
Built Teuchos::RCP<Teko::PreconditionerFactory>{ptr=0x3e70d38,node=0x3dc1fb0,strong_count=1,weak_count=0}
Teko: End debug MSG
LSC Construction failed: Strategy "The Cat" requires a "Strategy Settings" sublist
"plConstruction" ... PASSED
Test "LSCIntegrationTest_tpetra" completed ... PASSED (3)
Running test "tStridedTpetraOperator"
"numvars_constr" ... PASSED
"vector_constr" ... PASSED
"reorder(flat reorder)" ... PASSED
"reorder(composite reorder = 1)" ... PASSED
"reorder(composite reorder = 2)" ... PASSED
Test "tStridedTpetraOperator" completed ... PASSED (5)
Running test "tBlockedTpetraOperator"
"vector_constr" ... PASSED
"reorder(flat reorder)" ... PASSED
"reorder(composite reorder = 1)" ... PASSED
"reorder(composite reorder = 2)" ... PASSED
Test "tBlockedTpetraOperator" completed ... PASSED (4)
Tests Passed: 86, Tests Failed: 0
(Incidently, you want no failures)
```
</details>
## Checklist
- [x] My commit messages mention the appropriate GitHub issue numbers.
- [x] My code follows the code style of the affected package(s).
- [x] All new and existing tests passed.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2482Loose error tol from 5e-14 to 5.5e-14 for gnu-opt-serial on hansen/shiller (#...2018-03-30T15:44:14ZJames WillenbringLoose error tol from 5e-14 to 5.5e-14 for gnu-opt-serial on hansen/shiller (#2475)*Created by: bartlettroscoe*
CC: @trilinos/teko
This small increase in the error tolerance allows the
tDiagonallyScaledPreconditioner_application_test_row_tpetra_UnitTest unit test
to pass on the ATDM build Trilinos-atdm-hansen-sh...*Created by: bartlettroscoe*
CC: @trilinos/teko
This small increase in the error tolerance allows the
tDiagonallyScaledPreconditioner_application_test_row_tpetra_UnitTest unit test
to pass on the ATDM build Trilinos-atdm-hansen-shiller-gnu-opt-serial. See #2475.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2802Switch to all-at-once approach for 'toss3' builds on 'serrano' (TRIL-200, #2699)2018-05-22T23:29:10ZJames WillenbringSwitch to all-at-once approach for 'toss3' builds on 'serrano' (TRIL-200, #2699)*Created by: bartlettroscoe*
Now that the new testing-vm.sandia.gov site is sending out emails, I think
this is a safe thing to do. I am hoping this will help to avoid timeouts in
the sbatch command running the tests on 'serrano'.
...*Created by: bartlettroscoe*
Now that the new testing-vm.sandia.gov site is sending out emails, I think
this is a safe thing to do. I am hoping this will help to avoid timeouts in
the sbatch command running the tests on 'serrano'.
I did not test this. But this was a copy-and-paste from the other driver scripts for 'white'/'ride' that was tested and it is an extremely safe change. Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/24092407 fix safe as check power82018-03-19T14:24:17ZJames Willenbring2407 fix safe as check power8*Created by: bartlettroscoe*
**CC:** @trilinos/teuchos, @mhoemmen
## Description
This PR branch improves the outputting of some of the Teuchos type conversion code unit tests and it fixes a problem with a safeAs() test on power8 ...*Created by: bartlettroscoe*
**CC:** @trilinos/teuchos, @mhoemmen
## Description
This PR branch improves the outputting of some of the Teuchos type conversion code unit tests and it fixes a problem with a safeAs() test on power8 systems. This addresses issue #2407.
Now, building and running with:
```
./TeuchosCore_TypeConversions_UnitTest.exe --test=stringToReal --details=ALL
```
passes as shown below on two systems.
With this change, on my Linux machine crf450 the unit test output shows:
```
1. asSafe_stringToReal_UnitTest ...
minLD = -1.19e+4932
minusOneLD = -1
maxLD = 1.19e+4932
...
sizeof_long_double = 16
sizeof_double = 8
max_exponent10_long_double = 4932
max_exponent10_double = 308
Testing converting from 'long double' to 'double' that does not fit ...
Test that code {valD = asSafe<double>(valToString(minLD));} throws std::range_error: passed
Exception message for expected exception:
/ascldap/users/rabartl/Trilinos.base/Trilinos/packages/teuchos/core/src/Teuchos_as.hpp:558:
Throw number = 3
Throw test that evaluated to true: errno == ERANGE && (val != 0)
Teuchos::ValueTypeConversionTraits<double, std::string>::convert: The value in the given string "-1.189731495357231765021263853e+4932" overflows double.
valD = -1
Test that code {valD = asSafe<double>(valToString(maxLD));} throws std::range_error: passed
Exception message for expected exception:
/ascldap/users/rabartl/Trilinos.base/Trilinos/packages/teuchos/core/src/Teuchos_as.hpp:558:
Throw number = 4
Throw test that evaluated to true: errno == ERANGE && (val != 0)
Teuchos::ValueTypeConversionTraits<double, std::string>::convert: The value in the given string "1.189731495357231765021263853e+4932" overflows double.
valD = -1
Testing string -> long double conversions ...
...
[Passed] (0.000535 sec)
Total Time: 0.000829 sec
Summary: total = 116, run = 1, passed = 1, failed = 0
End Result: TEST PASSED
```
So it runs the unit tests `Testing converting from 'long double' to 'double' that does not fit` gets run since both the sizeof() and max_exponent10 values for long double are larger than for double. So these important tests run.
But when I run this unit test now on the power8 machine `ride` with the the `gnu-debug-openmp` build as shown above, it shows:
```
1. asSafe_stringToReal_UnitTest ...
minLD = -1.8e+308
minusOneLD = -1
maxLD = 1.8e+308
...
sizeof_long_double = 16
sizeof_double = 8
max_exponent10_long_double = 308
max_exponent10_double = 308
Testing string -> long double conversions ...
...
[Passed] (0.000418 sec)
Total Time: 0.000783 sec
Summary: total = 116, run = 1, passed = 1, failed = 0
End Result: TEST PASSED
```
See, that shows that on this machine `max_exponent10_long_double` = `max_exponent10_double` = `308` and the checks printed in the section `Testing converting from 'long double' to 'double' that does not fit` are skipped and instead it goes straight to `Testing string -> long double conversions`.
I think this is the right thing to do to fix these tests and it informs something about this system.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2747Promote Trilinos-atdm-toss3-intel-opt-openmp-panzer to "ATDM" CDash Track/Gro...2018-05-15T14:24:46ZJames WillenbringPromote Trilinos-atdm-toss3-intel-opt-openmp-panzer to "ATDM" CDash Track/Group (TRIL-200)*Created by: bartlettroscoe*
This build has been 100% clean and passing all Panzer tests the last 5 days, including today.
*Created by: bartlettroscoe*
This build has been 100% clean and passing all Panzer tests the last 5 days, including today.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2621Revert "Merge pull request #2501 from bartlettroscoe/2473-disable-random-fail...2018-04-24T17:25:08ZJames WillenbringRevert "Merge pull request #2501 from bartlettroscoe/2473-disable-random-failing-anasazi-tests" (#2473)*Created by: bartlettroscoe*
**CC:** @fryeguy52, @trilinos/anasazi
## Description
This reverts commit 2e9da0c931e8c11c60d194e8a64d13e6e8697213, reversing
changes made to c828f5ad7f9ccef1d148839aaf65d6236ca172d5.
The merge bra...*Created by: bartlettroscoe*
**CC:** @fryeguy52, @trilinos/anasazi
## Description
This reverts commit 2e9da0c931e8c11c60d194e8a64d13e6e8697213, reversing
changes made to c828f5ad7f9ccef1d148839aaf65d6236ca172d5.
The merge branch in PR #2517 should allow these tests to pass now.
This should resolve #2473. We will just need to to observe these tests passing.
Note that this just impacts the tests that run in the ATDM Trilinos builds and does not impact any actual code in Trilinos at all or any of the auto PR builds.
## How this was tested
I tested this on white with:
```
$ bsub -x -I -q rhel7F -n 16 \
./checkin-test-atdm.sh cuda-debug gnu-debug-openmp \
--enable-all-packages=off --no-enable-fwd-packages \
--enable-packages=Anasazi --local-do-all
...
PASSED (NOT READY TO PUSH): Trilinos: white24
Mon Apr 23 11:55:40 MDT 2018
Enabled Packages: Anasazi
Build test results:
-------------------
0) MPI_RELEASE_DEBUG_SHARED_PT => Test case MPI_RELEASE_DEBUG_SHARED_PT was not run! => Does not affect push readiness! (-1.00 min)
1) cuda-debug => passed: passed=74,notpassed=0 (14.77 min)
2) gnu-debug-openmp => passed: passed=74,notpassed=0 (3.84 min)
```
## Checklist
- [x] My commit messages mention the appropriate GitHub issue numbers.
- [x] My code follows the code style of the affected package(s).
- [ ] My change requires a change to the documentation.
- [ ] I have updated the documentation accordingly.
- [x] I have read the [code contribution guidelines](../blob/master/CONTRIBUTING.md) for this project.
- [ ] I have added tests to cover my changes.
- [x] All new and existing tests passed.
- [x] No new compiler warnings were introduced.
- [ ] These changes break backwards compatibility.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2729Move the mpiexec args before -np not after (#2699)2018-05-11T13:58:30ZJames WillenbringMove the mpiexec args before -np not after (#2699)*Created by: bartlettroscoe*
CC: @fryeguy52, @jmgate
The instructions on the 'serrano' support page say that these arguments should
go before the -np argument, not after the --n arugment. I am hoping this will fix
some of the fai...*Created by: bartlettroscoe*
CC: @fryeguy52, @jmgate
The instructions on the 'serrano' support page say that these arguments should
go before the -np argument, not after the --n arugment. I am hoping this will fix
some of the failures we are seeing as described in #2699.
Also, I changed the -np argument to --n to match exactly what the 'serrano'
support page says to do.
## How Has This Been Tested?
On serrano, I ran:
```
$ ./checkin-test-atdm.sh intel-opt-openmp --enable-packages=Rythmos,MueLu --configure --build
$ salloc -N1 --time=00:20:00 --account=fy150090 \
./checkin-test-atdm.sh intel-opt-openmp --enable-packages=Rythmos,MueLu --test
```
That returned:
```
PASSED (NOT READY TO PUSH): Trilinos: serrano-login5
Thu May 10 17:30:21 MDT 2018
Enabled Packages: Rythmos, MueLu
Build test results:
-------------------
0) MPI_RELEASE_DEBUG_SHARED_PT => Test case MPI_RELEASE_DEBUG_SHARED_PT was not run! => Does not affect push readiness! (-1.00 min)
1) intel-opt-openmp => passed: passed=125,notpassed=0 (1.06 min)
```
Now, all of the Rythmos tests were already passing for the `intel-opt-openmp` build. But the fact there were no failing MueLu tests is hopeful.
NOTE: I could not run the `intel-debug-openmp` build because it takes up too much disk space and bombs out my 50G disk quota before it completes the build. It would be nice to run that build because that is were we saw the most failures.
## Checklist
- [ ] All new and existing tests passed.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/3363Switch from OpenMPI 3.1.0 to 2.1.2 on 'waterman' (TRIL-213)2018-08-28T01:33:05ZJames WillenbringSwitch from OpenMPI 3.1.0 to 2.1.2 on 'waterman' (TRIL-213)*Created by: bartlettroscoe*
CC: @fryeguy52, @mhoemmen, @kddevin, @rppawlo
## Description
Switches from OpenMPI 3.1.0 to OpenMPI 2.1.2 env on Power9 'waterman'. We were told by @nmhamster today that OpenMPI 3.1 really does not w...*Created by: bartlettroscoe*
CC: @fryeguy52, @mhoemmen, @kddevin, @rppawlo
## Description
Switches from OpenMPI 3.1.0 to OpenMPI 2.1.2 env on Power9 'waterman'. We were told by @nmhamster today that OpenMPI 3.1 really does not work on the Power9 (and is a known issue apparently) and to use the OpenMPI 2.1.2 env instead.
## Motivation and Context
This appears to fix a bunch of failing tests including those in #3344, #3331 and perhaps others.
## How Has This Been Tested?
On 'white' I ran:
```
$ bsub -x -Is -n 20 \
./checkin-test-atdm.sh cuda-opt-Power9-Volta70 \
--enable-packages=Kokkos,Teuchos,Zoltan2,Ifpack2,Tpetra,SEACAS,Panzer \
--local-do-all
```
and it returned:
```
99% tests passed, 2 tests failed out of 645
Subproject Time Summary:
Ifpack2 = 646.49 sec*proc (36 tests)
Kokkos = 475.50 sec*proc (27 tests)
Panzer = 7880.59 sec*proc (158 tests)
SEACAS = 24.01 sec*proc (20 tests)
Teuchos = 207.66 sec*proc (129 tests)
Tpetra = 2326.59 sec*proc (173 tests)
Zoltan2 = 1269.06 sec*proc (102 tests)
Total Test time (real) = 1888.47 sec
The following tests FAILED:
619 - PanzerAdaptersSTK_CurlLaplacianExample-ConvTest-Quad-Order-4 (Failed)
623 - PanzerAdaptersSTK_MixedPoissonExample-ConvTest-Hex-Order-3 (Timeout)
```
This is worth trying on the full ATDM Trilinos build.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/3506Change parallel build level on white/ride from 128 to 64 (#2464)2018-09-26T01:22:01ZJames WillenbringChange parallel build level on white/ride from 128 to 64 (#2464)*Created by: bartlettroscoe*
From talking with Si Hammond, he suggests that you will not get any real
speedup going voer 64 build proceses on 'white' and 'ride' and this might help
to reduce the random 'bsub' crashes durring building ...*Created by: bartlettroscoe*
From talking with Si Hammond, he suggests that you will not get any real
speedup going voer 64 build proceses on 'white' and 'ride' and this might help
to reduce the random 'bsub' crashes durring building on white/ride (see #2464).
I did not test this at all but this change is so simple and basic I think it would be very hard for this to break anything on white/ride.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2501Disable 3 Anasazi tests that randomly fail in debug builds on white/ride (#2473)2018-04-04T01:34:24ZJames WillenbringDisable 3 Anasazi tests that randomly fail in debug builds on white/ride (#2473)*Created by: bartlettroscoe*
These tests randomly fail with massive diffs. Very strange behavior. See #2473 for history and more details.
*Created by: bartlettroscoe*
These tests randomly fail with massive diffs. Very strange behavior. See #2473 for history and more details.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/3236Increase KNL testing timeout from 5 to 9 hours (TRIL-196)2018-08-06T14:02:44ZJames WillenbringIncrease KNL testing timeout from 5 to 9 hours (TRIL-196)*Created by: bartlettroscoe*
@fryeguy52
## Description
The tests on the KNL build are taking an absurd amount of time but let's see
if we can get them to complete in 9 hours! AT the old timeout of 5 hours it
the debug build ra...*Created by: bartlettroscoe*
@fryeguy52
## Description
The tests on the KNL build are taking an absurd amount of time but let's see
if we can get them to complete in 9 hours! AT the old timeout of 5 hours it
the debug build ran 1504 out of 1801 tests so I am hopeful this will allow
them to complete.
This is only taking up one compute node on 'mutrino' so this is not such a
crime at this point.
This is being driven by [TRIL-196](https://software-sandbox.sandia.gov/jira/browse/TRIL-196)
## Motivation and Context
Want to see if we can get these tests to complete to see if there are errors. We can fix the runtime problem later.
## How Has This Been Tested?
I did not test this but the changes are simple and super safe and can only impact these two KNL build (which are just "Specialized" builds currently).
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/3516Disable PanzerAdaptersSTK_CurlLaplacianExample-ConvTest-Quad-Order-4 on water...2018-09-26T22:22:15ZJames WillenbringDisable PanzerAdaptersSTK_CurlLaplacianExample-ConvTest-Quad-Order-4 on waterman CUDA (#3340)*Created by: bartlettroscoe*
@trilinos/panzer
## Description
This test runs out of CUDA memory even when runs all on its own on 'waterman'.
We disabling this for now and the Panzer developers can then debug this
offline.
## ...*Created by: bartlettroscoe*
@trilinos/panzer
## Description
This test runs out of CUDA memory even when runs all on its own on 'waterman'.
We disabling this for now and the Panzer developers can then debug this
offline.
## Motivation and Context
There is little value in running tests every day that we know are going to fail (see #3340). This test can be fixed offline.
I was given the okay to disable this test in https://github.com/trilinos/Trilinos/issues/3340#issuecomment-424699362.
## How Has This Been Tested?
On 'waterman' I ran:
```
$ ./checkin-test-atdm.sh all --enable-packages=Panzer --configure
```
which returned:
```
PASSED (NOT READY TO PUSH): Trilinos: waterman11
Wed Sep 26 13:02:59 MDT 2018
Enabled Packages: Panzer
Build test results:
-------------------
0) MPI_RELEASE_DEBUG_SHARED_PT_OPENMP => Test case MPI_RELEASE_DEBUG_SHARED_PT_OPENMP was not run! => Does not affect push readiness! (-1.00 min)
1) gnu-debug-openmp-Power9-Volta70 => passed: configure-only passed => Not ready to push! (1.05 min)
2) gnu-opt-openmp-Power9-Volta70 => passed: configure-only passed => Not ready to push! (1.04 min)
3) cuda-debug-Power9-Volta70 => passed: configure-only passed => Not ready to push! (1.79 min)
4) cuda-opt-Power9-Volta70 => passed: configure-only passed => Not ready to push! (1.83 min)
```
I then verified that this test was correctly disabled in the correct builds with:
```
$ find . -maxdepth 2 -name configure.out \
-exec grep -nH PanzerAdaptersSTK_CurlLaplacianExample-ConvTest-Quad-Order-4_DISABLE {} \; \
| grep "NOT added"
./cuda-debug-Power9-Volta70/configure.out:851:-- PanzerAdaptersSTK_CurlLaplacianExample-ConvTest-Quad-Order-4: NOT added test because PanzerAdaptersSTK_CurlLaplacianExample-ConvTest-Quad-Order-4_DISABLE='ON'!
./cuda-opt-Power9-Volta70/configure.out:849:-- PanzerAdaptersSTK_CurlLaplacianExample-ConvTest-Quad-Order-4: NOT added test because PanzerAdaptersSTK_CurlLaplacianExample-ConvTest-Quad-Order-4_DISABLE='ON'!
```
The fact that it did not find this in the two GNU builds shows that the test is not disabled in those.
## Checklist
- [x] My commit messages mention the appropriate GitHub issue numbers.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2946Atdm mutrino use sbatch2018-06-15T12:56:05ZJames WillenbringAtdm mutrino use sbatch*Created by: fryeguy52*
## Description
This does a few small things for the ATDM configuration
1. Switch the mutrino jobs to use sbatch. This change seems to fix several of the failing seacas tests in #2815
2. promote the full ...*Created by: fryeguy52*
## Description
This does a few small things for the ATDM configuration
1. Switch the mutrino jobs to use sbatch. This change seems to fix several of the failing seacas tests in #2815
2. promote the full configuration jobs on `chama` to the ATDM CDash Group. Which are both passing all tests today as shown [here](https://testing-vm.sandia.gov/cdash/index.php?project=Trilinos&date=&filtercombine=and&filtercount=3&showfilters=1&filtercombine=and&field1=buildname&compare1=63&value1=Trilinos-atdm-chama&field2=buildname&compare2=64&value2=panzer&field3=buildstarttime&compare3=83&value3=Jun%2014%2C%202018)
3. Disable the test `Piro_MatrixFreeDecorator_UnitTests_MPI_4_DISABLE` on both `serrano` and `mutrino` because it is failing randomly as described in #2474
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/3081Fix ROL CUDA build failure (#3072)2018-07-10T01:37:34ZJames WillenbringFix ROL CUDA build failure (#3072)*Created by: bartlettroscoe*
CC: @trilinos/rol, @dridzal (ROL package lead)
## Description
Fixes the ROL CUDA build failure described in #3072. The fix was trivial (not sure why other compilers did not catch this or at least prov...*Created by: bartlettroscoe*
CC: @trilinos/rol, @dridzal (ROL package lead)
## Description
Fixes the ROL CUDA build failure described in #3072. The fix was trivial (not sure why other compilers did not catch this or at least prove a warning).
I also included a commit to add debug print info for `nvcc_wrapper` (see kokkos/nvcc_wrapper#19 and kokkos/nvcc_wrapper#20).
## Motivation and Context
ROL was not building for a CUDA build (see #3072). We wold like an auto PR CUDA build that includes all Primary Tested packages and ROL is a PT package (see #2464). Also, SPARC uses ROL and adding support for SPARC means testing ROL on all of the platforms where SPARC uses ROL and CUDA is an important build on many of those platforms.
## How Has This Been Tested?
I tested this on 'white' with:
```
$ cd ~/Trilinos.base/BUILD/WHITE/CUDA/CUDA-DEBUG/
$ source ~/Trilinos.base/Trilinos/cmake/std/atdm/load-env.sh cuda-debug
Hostname 'white11' matches known ATDM host 'white' and system 'ride'
ATDM_CONFIG_TRILNOS_DIR = /home/rabartl/Trilinos.base/Trilinos
Setting default compiler and build options for JOB_NAME='cuda-debug'
Using white/ride compiler stack CUDA to build DEBUG code with Kokkos node type CUDA
$ time cmake \
-GNinja
-DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnvAllPtPackages.cmake \
-DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_ROL=ON \
~/Trilinos.base/Trilinos \
&> configure.out
real 1m43.759s
user 0m58.268s
sys 0m17.081s
$ time make NP=16 &> make.out
real 54m28.573s
user 696m12.668s
sys 80m53.877s
$ time bsub -x -Is -q rhel7F -n 16 ctest -j16 --timeout 600 &> ctest.out
real 14m51.969s
user 0m0.032s
sys 0m0.035s
```
and the build passed and the test results were:
```
90% tests passed, 16 tests failed out of 156
Subproject Time Summary:
ROL = 11219.28 sec*proc (156 tests)
Total Test time (real) = 890.82 sec
The following tests FAILED:
32 - ROL_test_elementwise_TpetraMultiVector_MPI_4 (Failed)
130 - ROL_example_PDE-OPT_0ld_poisson_example_01_MPI_4 (Failed)
131 - ROL_example_PDE-OPT_0ld_stefan-boltzmann_example_03_MPI_4 (Failed)
134 - ROL_example_PDE-OPT_0ld_adv-diff-react_example_01_MPI_4 (Failed)
135 - ROL_example_PDE-OPT_0ld_adv-diff-react_example_02_MPI_4 (Timeout)
136 - ROL_example_PDE-OPT_0ld_stoch-adv-diff_example_01_MPI_4 (Timeout)
137 - ROL_example_PDE-OPT_poisson_example_01_MPI_4 (Failed)
139 - ROL_example_PDE-OPT_stefan-boltzmann_example_01_MPI_4 (Failed)
141 - ROL_example_PDE-OPT_stefan-boltzmann_example_03_MPI_4 (Failed)
142 - ROL_example_PDE-OPT_adv-diff-react_example_02_MPI_4 (Failed)
143 - ROL_example_PDE-OPT_navier-stokes_example_01_MPI_4 (Timeout)
144 - ROL_example_PDE-OPT_navier-stokes_example_02_MPI_4 (Failed)
145 - ROL_example_PDE-OPT_obstacle_example_01_MPI_4 (Failed)
150 - ROL_example_PDE-OPT_nonlinear-elliptic_example_01_MPI_4 (Failed)
151 - ROL_example_PDE-OPT_nonlinear-elliptic_example_02_MPI_4 (Failed)
152 - ROL_example_PDE-OPT_topo-opt_poisson_example_01_MPI_4 (Failed)
Errors while running CTest
```
Those are the same 16 tests already shown failing in the build `Trilinos-atdm-white-ride-cuda-debug-pt-all-at-once` for example shown [here](https://testing-vm.sandia.gov/cdash/viewTest.php?onlyfailed&buildid=3698659). (I will create a new GitHub issue for those failing tests once this PR is merge.)
## Checklist
- [x] My commit messages mention the appropriate GitHub issue numbers.
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/3395Disable piro test that is failing on waterman ATDM builds2018-09-06T22:05:31ZJames WillenbringDisable piro test that is failing on waterman ATDM builds*Created by: fryeguy52*
Disable the test:
Piro_MatrixFreeDecorator_UnitTests_MPI_4
On the builds:
Trilinos-atdm-waterman-gnu-opt-openmp
Trilinos-atdm-waterman-cuda-9.2-opt
@trilinos/framework, @bartlettroscoe
## Description...*Created by: fryeguy52*
Disable the test:
Piro_MatrixFreeDecorator_UnitTests_MPI_4
On the builds:
Trilinos-atdm-waterman-gnu-opt-openmp
Trilinos-atdm-waterman-cuda-9.2-opt
@trilinos/framework, @bartlettroscoe
## Description
the test `Piro_MatrixFreeDecorator_UnitTests_MPI_4` has been failing consistently on waterman builds and the agreed course of action is to disable the test for these two builds see issue: #2474
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/3481ATDM - rename the gnu waterman tweaks files2018-09-21T14:29:28ZJames WillenbringATDM - rename the gnu waterman tweaks files*Created by: fryeguy52*
@trilinos/framework @bartlettroscoe
## Description
There is a "tweaks" file for each ATDM build that needs to have a specific name. This fixes the names of those files for the gnu waterman builds.
## Rel...*Created by: fryeguy52*
@trilinos/framework @bartlettroscoe
## Description
There is a "tweaks" file for each ATDM build that needs to have a specific name. This fixes the names of those files for the gnu waterman builds.
## Related Issues
#2474
#3454
## How Has This Been Tested?
```
-- Reading in configuration options from cmake/std/atdm/ATDMDevEnv.cmake ...
-- ATDM_JOB_NAME_KEYS_STR='GNU-RELEASE-OPENMP-POWER9'
-- ATDM_TWEAKS_FILES='/ascldap/users/jfrye/Trilinos/cmake/std/atdm/waterman/tweaks/GNU-RELEASE-OPENMP-POWER9.cmake'
-- Including ATDM build treaks file /ascldap/users/jfrye/Trilinos/cmake/std/atdm/waterman/tweaks/GNU-RELEASE-OPENMP-POWER9.cmake ...
-- Setting default Piro_MatrixFreeDecorator_UnitTests_MPI_4_DISABLE=ON
```
```
Test project /ascldap/users/jfrye/test_build
Start 1: Piro_UnitTests_MPI_1
Start 2: Piro_Epetra_MatrixFreeOperator_UnitTests_MPI_4
Start 3: Piro_EvalModel_MPI_4
Start 4: Piro_ThyraSolver_MPI_4
Start 5: Piro_AnalysisDriver_MPI_4
Start 6: Piro_SecondOrderIntegrator_MPI_1
1/11 Test #2: Piro_Epetra_MatrixFreeOperator_UnitTests_MPI_4 ... Passed 1.42 sec
Start 7: Piro_NOXSolver_UnitTests_MPI_4
2/11 Test #3: Piro_EvalModel_MPI_4 ............................. Passed 1.42 sec
Start 8: Piro_LOCASolver_UnitTests_MPI_4
3/11 Test #6: Piro_SecondOrderIntegrator_MPI_1 ................. Passed 1.46 sec
4/11 Test #1: Piro_UnitTests_MPI_1 ............................. Passed 1.49 sec
Start 9: Piro_RythmosSolver_UnitTests_MPI_4
5/11 Test #5: Piro_AnalysisDriver_MPI_4 ........................ Passed 1.50 sec
Start 10: Piro_Epetra_RythmosSolver_UnitTests_MPI_4
6/11 Test #4: Piro_ThyraSolver_MPI_4 ........................... Passed 1.60 sec
Start 11: Piro_TempusSolver_UnitTests_MPI_4
7/11 Test #10: Piro_Epetra_RythmosSolver_UnitTests_MPI_4 ........ Passed 0.97 sec
8/11 Test #11: Piro_TempusSolver_UnitTests_MPI_4 ................ Passed 0.90 sec
9/11 Test #7: Piro_NOXSolver_UnitTests_MPI_4 ................... Passed 1.11 sec
10/11 Test #9: Piro_RythmosSolver_UnitTests_MPI_4 ............... Passed 1.10 sec
11/11 Test #8: Piro_LOCASolver_UnitTests_MPI_4 .................. Passed 1.35 sec
100% tests passed, 0 tests failed out of 11
```
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/3454Atdm waterman disables2018-09-19T14:54:06ZJames WillenbringAtdm waterman disables*Created by: fryeguy52*
@trilinos/framework, @bartlettroscoe
## Description
The following tests are being disabled in waterman builds where they are perpetually failing:
* Belos_Tpetra_PseudoBlockCG_hb_test_MPI_4
* Piro_MatrixFre...*Created by: fryeguy52*
@trilinos/framework, @bartlettroscoe
## Description
The following tests are being disabled in waterman builds where they are perpetually failing:
* Belos_Tpetra_PseudoBlockCG_hb_test_MPI_4
* Piro_MatrixFreeDecorator_UnitTests_MPI_4
* KokkosKernels_sparse_openmp_MPI_1
* TeuchosNumerics_LAPACK_test_MPI_1
## Motivation and Context
These tests are continually failing on waterman and are being disabled to get the waterman builds clean
## Related Issues
* #3173
* #2466
* #2474
* #2410
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/merge_requests/2759Tril 200 serrano fixups2018-05-17T15:14:51ZJames WillenbringTril 200 serrano fixups*Created by: bartlettroscoe*
@trilinos/<teamName>
## Description
This PR contains several fix-ups for the builds on 'serrano'. See the set of commits for what the changes are. There are good descriptions in the log messages in t...*Created by: bartlettroscoe*
@trilinos/<teamName>
## Description
This PR contains several fix-ups for the builds on 'serrano'. See the set of commits for what the changes are. There are good descriptions in the log messages in those.
However, the big things are:
* Disable the Panzer test `PanzerAdaptersSTK_MixedPoissonExample-ConvTest-Hex-Order-3` for intel-debug-openmp builds (#2751, commit 652a011)
* Try to fix failing tests by setting `KOKKOS_ARCH=BDW` (1a271e5) and switch to `mpiexec --bind-by socket` (e1944ed) (#2699)
* Enabled the usage of Ninja (297cf26)
## Related Issues
* Related to: #2751, #2699
## How Has This Been Tested?
I tested this locally on 'serrano' using:
```
$ ./checkin-test-atdm.sh intel-opt-openmp \
--enable-packages=Kokkos,Panzer --allow-no-pull --configure --build --send-email-to=
$ salloc -N1 --time=0:20:00 --account=fy150090 \
./checkin-test-atdm.sh intel-opt-openmp \
--enable-packages=Kokkos,Panzer --test
```
This gave the result:
```
PASSED (NOT READY TO PUSH): Trilinos: serrano-login5
Wed May 16 08:23:59 MDT 2018
Enabled Packages: Kokkos, Panzer
Build test results:
-------------------
0) MPI_RELEASE_DEBUG_SHARED_PT => Test case MPI_RELEASE_DEBUG_SHARED_PT was not run! => Does not affect push readiness! (-1.00 min)
1) intel-opt-openmp => passed: passed=180,notpassed=0 (2.68 min)
```
Unfortunately, I can't currently test the `intel-debug-openmp` build because it takes too much disk space and there is a quote of 50G in my home space on 'serrano'. I only have the disk space to test the `intel-opt-openmp` build.
## Checklist
- [x] My commit messages mention the appropriate GitHub issue numbers.
- [x] My change requires a change to the documentation.
- [x] I have updated the documentation accordingly.
- [x] All new and existing tests passed.
- [x] No new compiler warnings were introduced.
Initial cleanup of new ATDM builds of Trilinos