Trilinos issueshttps://gitlab.osti.gov/jmwille/Trilinos/-/issues2020-07-22T01:04:27Zhttps://gitlab.osti.gov/jmwille/Trilinos/-/issues/4853Tpetra: Deprecate "old" DistObject interface2020-07-22T01:04:27ZJames WillenbringTpetra: Deprecate "old" DistObject interface*Created by: mhoemmen*
@trilinos/tpetra
## Current Behavior
The following subclasses of `Tpetra::DistObject` currently implement the "old" DistObject interface (copyAndPermute, packAndPrepare, unpackAndCombine) instead of the "ne...*Created by: mhoemmen*
@trilinos/tpetra
## Current Behavior
The following subclasses of `Tpetra::DistObject` currently implement the "old" DistObject interface (copyAndPermute, packAndPrepare, unpackAndCombine) instead of the "new" DistObject interface (copyAndPermuteNew, packAndPrepareNew, unpackAndCombineNew):
- CrsGraph
- BlockMultiVector
## Motivation and Context
We want to deprecate and remove the "old" DistObject interface.
## Related Issues
* Is blocked by #4852
https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4861Tpetra: Make BlockMultiVector implement the "new" DistObject interface2020-07-22T01:04:27ZJames WillenbringTpetra: Make BlockMultiVector implement the "new" DistObject interface*Created by: mhoemmen*
@trilinos/tpetra
## Current Behavior
`Tpetra::BlockMultiVector` currently implements the "old" DistObject interface (copyAndPermute, packAndPrepare, unpackAndCombine) instead of the "new" DistObject interfa...*Created by: mhoemmen*
@trilinos/tpetra
## Current Behavior
`Tpetra::BlockMultiVector` currently implements the "old" DistObject interface (copyAndPermute, packAndPrepare, unpackAndCombine) instead of the "new" DistObject interface (copyAndPermuteNew, packAndPrepareNew, unpackAndCombineNew).
## Motivation and Context
This blocks deprecation and removal of the "old" DistObject interface.
## Definition of Done
- [ ] Implement copyAndPermuteNew, packAndPrepareNew, and unpackAndCombineNew
- [ ] Implement useNewInterface and have it return true
- [ ] Make sure all the tests pass
## Possible Solution
The "new" DistObject interface permits a host-only implementation, which is what BlockMultiVector currently has. This should be a mechanical change.
## Related Issues
* Blocks https://github.com/trilinos/Trilinos/issues/4853 https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4868MueLu: deprecate some adapters2020-07-22T01:04:27ZJames WillenbringMueLu: deprecate some adapters*Created by: lucbv*
@trilinos/muelu
## Expectations
The interface to create a preconditioner using MueLu should be simple and uniform for all users.
## Current Behavior
nullspace multivector and coordinates multivectors can be ...*Created by: lucbv*
@trilinos/muelu
## Expectations
The interface to create a preconditioner using MueLu should be simple and uniform for all users.
## Current Behavior
nullspace multivector and coordinates multivectors can be passed optionally to the preconditioner constructor. These inputs could actually be passed just as easily on the input parameter list as it is the case of other user defined parameters. This makes it awkward to pass them with additional user data.
## Motivation and Context
With the addition of the "user data" sublist to the MueLu parameter list, users have a unique and general way to provide data to MueLu. It would make sense to use this as the only mean of passing data to MueLu instead of maintaining multiple interfaces.
## Definition of Done
A single interface to MueLu exists and it allows user to pass any kind of data necessary.
## Possible Solution
Deprecate the special interfaces used to pass nullspace and coordinates.
## Related Issues
* Blocks
* Is blocked by
* Follows
* Precedes
* Related to
* Part of #4728
* Composed of
https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4870Tpetra::MultiVector::norm*: Prefer running on device2020-07-22T01:04:27ZJames WillenbringTpetra::MultiVector::norm*: Prefer running on device*Created by: mhoemmen*
@trilinos/tpetra
The `Tpetra::MultiVector::norm*` methods currently run where the MultiVector's data were most recently updated. Reports from @vbrunini running SPARC with vectors with 1.8 million local rows s...*Created by: mhoemmen*
@trilinos/tpetra
The `Tpetra::MultiVector::norm*` methods currently run where the MultiVector's data were most recently updated. Reports from @vbrunini running SPARC with vectors with 1.8 million local rows show that this can cause a slowdown, if running on host. We need to fix these methods so they prefer running on device unless the vector has too few rows to justify running on device.
https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4878Xpetra: In CUDA build, warning about missing return statement at end of non-v...2020-07-22T01:04:27ZJames WillenbringXpetra: In CUDA build, warning about missing return statement at end of non-void function*Created by: mhoemmen*
@trilinos/muelu @trilinos/xpetra
```
.../Trilinos/packages/xpetra/sup/Matrix/Xpetra_MatrixFactory.hpp(161): warning: missing return statement at end of non-void function "Xpetra::MatrixFactory2<double, int, int...*Created by: mhoemmen*
@trilinos/muelu @trilinos/xpetra
```
.../Trilinos/packages/xpetra/sup/Matrix/Xpetra_MatrixFactory.hpp(161): warning: missing return statement at end of non-void function "Xpetra::MatrixFactory2<double, int, int, Node>::BuildCopy [with Node=Xpetra::EpetraNode]"
detected during:
instantiation of "Teuchos::RCP<Xpetra::Matrix<double, int, int, Node>> Xpetra::MatrixFactory2<double, int, int, Node>::BuildCopy(Teuchos::RCP<const Xpetra::Matrix<double, int, int, Node>>) [with Node=Xpetra::EpetraNode]"
.../Trilinos/packages/muelu/src/Transfers/Energy-Minimization/Solvers/MueLu_CGSolver_def.hpp(75): here
instantiation of "void MueLu::CGSolver<Scalar, LocalOrdinal, GlobalOrdinal, Node>::Iterate(const MueLu::CGSolver<Scalar, LocalOrdinal, GlobalOrdinal, Node>::Matrix &, const MueLu::CGSolver<Scalar, LocalOrdinal, GlobalOrdinal, Node>::Constraint &, const MueLu::CGSolver<Scalar, LocalOrdinal, GlobalOrdinal, Node>::Matrix &, Teuchos::RCP<MueLu::CGSolver<Scalar, LocalOrdinal, GlobalOrdinal, Node>::Matrix> &) const [with Scalar=double, LocalOrdinal=int, GlobalOrdinal=int, Node=Kokkos_Compat_KokkosSerialWrapperNode]"
.../Trilinos/packages/muelu/src/Utils/MueLu_ETI_4arg.hpp(32): here
```
https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4891Unused var isInitializedLocalMap_ warning in Xpetra_EpetraMap.hpp triggering ...2020-07-22T01:04:27ZJames WillenbringUnused var isInitializedLocalMap_ warning in Xpetra_EpetraMap.hpp triggering build error in SPARC Trilinos Integration builds with -Werror*Created by: bartlettroscoe*
CC: @trilinos/xpetra , @kddevin (Trilinos Data Services Product Lead), @bartlettroscoe, @fryeguy52
<Checklist>
<???: Add label "client: ATDM">
<???: Add label "ATDM Sev: Blocker" (by default but could b...*Created by: bartlettroscoe*
CC: @trilinos/xpetra , @kddevin (Trilinos Data Services Product Lead), @bartlettroscoe, @fryeguy52
<Checklist>
<???: Add label "client: ATDM">
<???: Add label "ATDM Sev: Blocker" (by default but could be other "ATDM Sev: XXX")>
<???: Add label "type: bug"?>
<???: Add label for affected packages (e.g. "pkg: MueLu", "pkg: Tpetra", "pkg: Kokkos", etc.)>
<???: Add label "PA: ???Project Area???" (e.g. "PA: Linear Solvers", "PA: Data Services")>
<???: Add milestone "Initial cleanup of new ATDM ..." or "Keep promoted ATDM ...">
<???: Once GitHub Issue is created, add entries for tests to TrilinosATDMStatus/*.csv files>
## Next Action Status
<status-and-or-first-action>
## Description
The new unused var warning shown, for example, [here](https://testing.sandia.gov/cdash-dev-view/viewBuildError.php?type=1&buildid=4878569) in the build:
* `Trilinos-atdm-cee-rhel6_clang-5.0.1_openmpi-1.10.2_serial_static_opt`
in the build of MueLu which shows the warning:
```
[CTest: warning matched] /scratch/rabartl/Trilinos.base/NightlyBuilds/Trilinos-atdm-cee-rhel6_clang-5.0.1_openmpi-1.10.2_serial_static_opt/SRC_AND_BUILD/Trilinos/packages/xpetra/src/Map/Xpetra_EpetraMap.hpp:699:18: warning: private field 'isInitializedLocalMap_' is not used [-Wunused-private-field]
mutable bool isInitializedLocalMap_ = false; // It's OK to use C++11 when Tpetra is enabled
```
is triggering build errors for the `clang-5.0.1` and `gnu-7.2.0` SPARC Trilinos Integration builds that have `-Werror` set. One can see these build errors, for example, [here](http://compsim-dashboard.sandia.gov/cdash/viewBuildError.php?buildid=107482).
## Current Status on CDash
The status of these warnings can be seen in:
* [MueLu warning in Trilinos-atdm-cee-rhel6_clang-5.0.1_openmpi-1.10.2_serial_static_opt build over last 5 days](https://testing.sandia.gov/cdash-dev-view/index.php?project=Trilinos&date=2019-04-13&filtercount=3&showfilters=1&filtercombine=and&field1=subprojects&compare1=93&value1=MueLu&field2=buildname&compare2=61&value2=Trilinos-atdm-cee-rhel6_clang-5.0.1_openmpi-1.10.2_serial_static_opt&field3=buildstarttime&compare3=83&value3=5%20days%20ago).
Just click on the number (e.g. '5') under "Build | Warn" to see the warnings.
## Steps to Reproduce
One should be able to reproduce this failure on any CEE LAN RHEL6 machine as described in:
* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md
More specifically, the commands given for the system <supported-atdm-system> are provided at:
* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#cee-rhel6-environment
The exact commands to reproduce this issue should be:
```
$ cd <some_build_dir>/
$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh \
Trilinos-atdm-cee-rhel6_clang-5.0.1_openmpi-1.10.2_serial_static_opt
$ cmake \
-GNinja \
-DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \
-DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_MueLu=ON \
$TRILINOS_DIR
$ make NP=16
```
and one should see the warnings.
Keep promoted "ATDM" builds of Trilinos cleanhttps://gitlab.osti.gov/jmwille/Trilinos/-/issues/4857Tpetra: configure error using COMPLEX_DOUBLE and FLOAT types2020-07-22T01:04:27ZJames WillenbringTpetra: configure error using COMPLEX_DOUBLE and FLOAT types*Created by: ajpowel*
<!---
Replace <teamName> below with the appropriate Trilinos package/team name.
-->
@trilinos/Tpetra
## Expectations
We do not want to turn on Trilinos_ENABLE_COMPLEX_FLOAT if we are also using Tri...*Created by: ajpowel*
<!---
Replace <teamName> below with the appropriate Trilinos package/team name.
-->
@trilinos/Tpetra
## Expectations
We do not want to turn on Trilinos_ENABLE_COMPLEX_FLOAT if we are also using Trilinos_ENABLE_FLOAT and Trilinos_ENABLE_COMPLEX_DOUBLE. Is the current behavior (below) correct?
<!---
Tell us what you think should happen, how you think things should work, what
you would like to see in the documentation, etc.
-->
## Current Behavior
Processing enabled package: Tpetra (Classic, TSQR, Core)
-- Tpetra: Enabling deprecated code
-- Determine whether Tpetra will assume that MPI is CUDA aware:
-- - Tpetra_ENABLE_CUDA is OFF, so Tpetra will assume that MPI is not CUDA aware.
-- Tpetra execution space availability (ON means available):
-- - Serial: ON
-- - Threads: OFF
-- - OpenMP: OFF
-- - Cuda: OFF
CMake Error at packages/tpetra/CMakeLists.txt:986 (MESSAGE):
Tpetra: Tpetra_INST_COMPLEX_FLOAT is OFF (meaning that you want to disable
explicit instantiation and/or tests of Tpetra with Scalar =
std::complex<float>), but Teuchos_ENABLE_COMPLEX is ON and
Teuchos_ENABLE_FLOAT is ON. This will cause downstream link errors, likely
in Thyra or Stratimikos. See GitHub Issue 4080 for details. Best
practice: Do NOT set Tpetra_INST_COMPLEX_FLOAT, Teuchos_ENABLE_COMPLEX, or
Teuchos_ENABLE_FLOAT explicitly. Instead, set
Trilinos_ENABLE_COMPLEX_FLOAT explicitly. That will set defaults for
Teuchos and Tpetra correctly.
-- Configuring incomplete, errors occurred!
See also "/scratch/ajpowel/code_032119/fix_trilly/CMakeFiles/CMakeOutput.log".
See also "/scratch/ajpowel/code_032119/fix_trilly/CMakeFiles/CMakeError.log".
<!---
Tell us how the current behavior fails to meet your expectations in some way.
-->
## Motivation and Context
Sierra-Trilinos integration
<!---
How has this expectation failure affected you? What are you trying to
accomplish? Why do we need to address this? What does it have to do with
anything? Providing context helps us come up with a solution that is most
useful in the real world.
-->
## Steps to Reproduce
cmake -DTrilinos_ENABLE_Tpetra=ON -DTrilinos_ENABLE_COMPLEX_DOUBLE=ON -DTrilinos_ENABLE_FLOAT=ON -DTrilinos_ENABLE_Teuchos=ON $PATH_TO_MY_SOURCE_CODE
<!---
Provide a link to a live example, or an unambiguous set of steps to reproduce
this issue. Include code to reproduce, if relevant.
1. Do this.
1. Do that.
1. Shake fist angrily at computer.
-->https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4904Piro compilation error due to missing Optipack_Config.h file2020-07-22T01:04:27ZJames WillenbringPiro compilation error due to missing Optipack_Config.h file*Created by: ikalash*
Trilinos failed to compile in the Albany nightlies due to the following error in Piro:
```
repos/Trilinos/packages/piro/src/Piro_PerformAnalysis.hpp:53:10: fatal error: OptiPack_Config.h: No such file or direct...*Created by: ikalash*
Trilinos failed to compile in the Albany nightlies due to the following error in Piro:
```
repos/Trilinos/packages/piro/src/Piro_PerformAnalysis.hpp:53:10: fatal error: OptiPack_Config.h: No such file or directory
```
Did OptiPack_Config.h get removed? Is it still needed? Here is the more detailed error message:
http://cdash.sandia.gov/CDash-2-3-0/viewBuildError.php?buildid=83699
@trilinos/piro
Keep promoted "ATDM" builds of Trilinos cleanhttps://gitlab.osti.gov/jmwille/Trilinos/-/issues/4913Tpetra configure warning about only one global ordinal type2020-07-22T01:04:27ZJames WillenbringTpetra configure warning about only one global ordinal type*Created by: bartlettroscoe*
@trilinos/tpetra
I just noticed that all of the ATDM Trilinos builds, for example as shown [here](https://testing.sandia.gov/cdash-dev-view/viewConfigure.php?buildid=4892727), are generating the followin...*Created by: bartlettroscoe*
@trilinos/tpetra
I just noticed that all of the ATDM Trilinos builds, for example as shown [here](https://testing.sandia.gov/cdash-dev-view/viewConfigure.php?buildid=4892727), are generating the following configure warning:
```
CMake Warning at packages/tpetra/CMakeLists.txt:1176 (MESSAGE):
Tpetra requires only one global ordinal, but more than one are set:
{int;long long}. Building with more than one global ordinal type in Tpetra
is deprecated.
```
How do we avoid this in the ATDM Trilinos builds?
https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4930Albany compilation error due to MueLu2020-07-22T01:04:27ZJames WillenbringAlbany compilation error due to MueLu*Created by: ikalash*
It looks like MueLu broke some of our Albany builds last night. Here is the error, which occurs when building Albany against an install of Trilinos:
```
[ 99%] Built target PartitionTest [ 99%] Built target u...*Created by: ikalash*
It looks like MueLu broke some of our Albany builds last night. Here is the error, which occurs when building Albany against an install of Trilinos:
```
[ 99%] Built target PartitionTest [ 99%] Built target utSurfaceElement /.../test/TrilinosInstall/lib/libmuelu.a(MueLu_AggregationExportFactory.cpp.o): In function `MueLu::AggregationExportFactory >::Build(MueLu::Level&, MueLu::Level&) const': MueLu_AggregationExportFactory.cpp:(.text._ZNK5MueLu24AggregationExportFactoryIdixN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6SerialENS1_9HostSpaceEEEE5BuildERNS_5LevelES9_[_ZNK5MueLu24AggregationExportFactoryIdixN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6SerialENS1_9HostSpaceEEEE5BuildERNS_5LevelES9_]+0xaa8): undefined reference to `MueLu::AmalgamationInfo >::UnamalgamateAggregates(MueLu::Aggregates > const&, Teuchos::ArrayRCP&, Teuchos::ArrayRCP&) const' /.../test/TrilinosInstall/lib/libmuelu.a(MueLu_AggregationExportFactory.cpp.o): In function `MueLu::AggregationExportFactory >::Build(MueLu::Level&, MueLu::Level&) const':
``
http://cdash.sandia.gov/CDash-2-3-0/viewBuildError.php?buildid=83739 (SRN)
https://my.cdash.org/viewBuildError.php?buildid=1637579 (SON)
Could someone please look at / resolve the problem?
@trilinos/muelu
https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4925MueLu: undefined symbols in static build2020-07-22T01:04:27ZJames WillenbringMueLu: undefined symbols in static build*Created by: jhux2*
@bathmatt has reported undefined symbols in a clang static build of EMPIRE. @rstumin has reported similar issues for SPARC. Both are using MueLu from Trilinos develop. This is due to the recent split of MueLu's li...*Created by: jhux2*
@bathmatt has reported undefined symbols in a clang static build of EMPIRE. @rstumin has reported similar issues for SPARC. Both are using MueLu from Trilinos develop. This is due to the recent split of MueLu's library, PR #4905.
The fix is to duplicate the libraries on the link line.https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4929Link problems with libmuelu breaking most ATDM Trilinos builds starting 4/17/...2020-07-22T01:04:27ZJames WillenbringLink problems with libmuelu breaking most ATDM Trilinos builds starting 4/17/2019*Created by: bartlettroscoe*
CC: @trilinos/muelu , @srajama1 (Trilinos Linear Solvers Product Lead), @bartlettroscoe, @fryeguy52
<Checklist>
<???: Add label "client: ATDM">
<???: Add label "ATDM Sev: Blocker" (by default but could ...*Created by: bartlettroscoe*
CC: @trilinos/muelu , @srajama1 (Trilinos Linear Solvers Product Lead), @bartlettroscoe, @fryeguy52
<Checklist>
<???: Add label "client: ATDM">
<???: Add label "ATDM Sev: Blocker" (by default but could be other "ATDM Sev: XXX")>
<???: Add label "type: bug"?>
<???: Add label for affected packages (e.g. "pkg: MueLu", "pkg: Tpetra", "pkg: Kokkos", etc.)>
<???: Add label "PA: ???Project Area???" (e.g. "PA: Linear Solvers", "PA: Data Services")>
<???: Add milestone "Initial cleanup of new ATDM ..." or "Keep promoted ATDM ...">
<???: Once GitHub Issue is created, add entries for tests to TrilinosATDMStatus/*.csv files>
## Next Action Status
<status-and-or-first-action>
## Description
As shown in [this query](https://testing.sandia.gov/cdash-dev-view/index.php?project=Trilinos&date=2019-04-17&filtercount=1&showfilters=1&field1=buildname&compare1=65&value1=Trilinos-atdm-) there are link errors related to the muelu library. For example, as shown [here](https://testing.sandia.gov/cdash-dev-view/viewBuildError.php?buildid=4904861) it shows link errors like:
```
packages/muelu/src/libmuelu.a(MueLu_CoalesceDropFactory.cpp.o):(.rodata._ZTVN5MueLu7LWGraphIixN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6OpenMPENS1_9HostSpaceEEEEE[_ZTVN5MueLu7LWGraphIixN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6OpenMPENS1_9HostSpaceEEEEE]+0xa8): undefined reference to `MueLu::LWGraph<int, long long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::OpenMP, Kokkos::HostSpace> >::print(Teuchos::basic_FancyOStream<char, std::char_traits<char> >&, int) const'
packages/muelu/src/libmuelu.a(MueLu_CoalesceDropFactory.cpp.o):(.rodata._ZTVN5MueLu5GraphIixN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6OpenMPENS1_9HostSpaceEEEEE[_ZTVN5MueLu5GraphIixN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6OpenMPENS1_9HostSpaceEEEEE]+0xa8): undefined reference to `MueLu::Graph<int, long long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::OpenMP, Kokkos::HostSpace> >::print(Teuchos::basic_FancyOStream<char, std::char_traits<char> >&, int) const'
packages/muelu/src/libmuelu.a(MueLu_CoalesceDropFactory.cpp.o):(.rodata._ZTVN5MueLu7LWGraphIiiN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6OpenMPENS1_9HostSpaceEEEEE[_ZTVN5MueLu7LWGraphIiiN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6OpenMPENS1_9HostSpaceEEEEE]+0xa8): undefined reference to `MueLu::LWGraph<int, int, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::OpenMP, Kokkos::HostSpace> >::print(Teuchos::basic_FancyOStream<char, std::char_traits<char> >&, int) const'
packages/muelu/src/libmuelu.a(MueLu_CoalesceDropFactory.cpp.o):(.rodata._ZTVN5MueLu5GraphIiiN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6OpenMPENS1_9HostSpaceEEEEE[_ZTVN5MueLu5GraphIiiN6Kokkos6Compat23KokkosDeviceWrapperNodeINS1_6OpenMPENS1_9HostSpaceEEEEE]+0xa8): undefined reference to `MueLu::Graph<int, int, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::OpenMP, Kokkos::HostSpace> >::print(Teuchos::basic_FancyOStream<char, std::char_traits<char> >&, int) const'
collect2: error: ld returned 1 exit status
```
## Steps to Reproduce
One should be able to reproduce this failure on many of the systems as described in:
* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md
Keep promoted "ATDM" builds of Trilinos cleanhttps://gitlab.osti.gov/jmwille/Trilinos/-/issues/4934EXTERNAL] Fwd: [trilinos/Trilinos] ifpack2: build error with scalar=FLOAT and...2020-07-22T01:04:27ZJames WillenbringEXTERNAL] Fwd: [trilinos/Trilinos] ifpack2: build error with scalar=FLOAT and COMPLEX_DOUBLE enabled (#4858) --> still not fixed!*Created by: ajpowelsnl*
<!---
Provide a general summary of the issue in the Title above. If this issue
pertains to a particular package in Trilinos, it's worthwhile to start the
title with "PackageName: ".
-->
Trilinos configu...*Created by: ajpowelsnl*
<!---
Provide a general summary of the issue in the Title above. If this issue
pertains to a particular package in Trilinos, it's worthwhile to start the
title with "PackageName: ".
-->
Trilinos configure failed (again) using the "develop" branch.
<!---
Replace <teamName> below with the appropriate Trilinos package/team name.
-->
@trilinos/<Sierra DevOps>
<!---
Assignees: If you know anyone who should likely tackle this issue, select them
from the Assignees drop-down on the right.
-->
Mark Hoemmen and Kyungjoo Kim
## Current Behavior
<!---
Tell us how the current behavior fails to meet your expectations in some way.
-->
I will email you the log.
## Steps to Reproduce
<!---
Provide a link to a live example, or an unambiguous set of steps to reproduce
this issue. Include code to reproduce, if relevant.
1. Clone a new Sierra project (master)
2. rm -fr TPLs_src/Trilinos
3. git clone https://github.com/trilinos/Trilinos.git TPLs_src/Trilinos
4. cd TPLs_src/Trilinos
5. git checkout develop
6. cd ${SIERRA_CODE_PROJECT_ROOT}
7. bake
## Your Environment
<!---
Include relevant details about your environment such that we can replicate this
issue.
-->
% module list
Currently Loaded Modulefiles:
1) sierra-python/2.7 4) sierra-compiler/gcc/7.2.0 7) sntools/local
2) sierra-git/2.6.1 5) sierra-mpi/openmpi/1.10.2
3) sierra-cmake/3.12.2 6) sierra-devel/gcc-7.2.0-openmpi-1.10.2
cee-build011 1164 %
cee-build011 1164 %
cee-build011 1164 % echo $SIERRA_SNTOOLS_PATH
/sierra/dev/ajpowel/toolset
cee-build011 1165 %
cee-build011 1165 %
cee-build011 1165 % type -a mpicc
mpicc is /projects/sierra/linux_rh6/SDK/mpi/openmpi/1.10.2-gcc-7.2.0-RHEL6/bin/mpicc
cee-build011 1166 %
cee-build011 1166 %
cee-build011 1166 % type -a mpicxx
mpicxx is /projects/sierra/linux_rh6/SDK/mpi/openmpi/1.10.2-gcc-7.2.0-RHEL6/bin/mpicxx
cee-build011 1167 %
cee-build011 1167 % mpicc --version
gcc (GCC) 7.2.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
cee-build011 1168 %
cee-build011 1168 %
cee-build011 1168 % mpicxx --version
g++ (GCC) 7.2.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
cee-build011 1169 % mpiexec --version
mpiexec (OpenRTE) 1.10.2
cat /etc/redhat-release
Red Hat Enterprise Linux Server release 6.9 (Santiago)
## Related Issues
<!---
If applicable, let us know how this bug is related to any other open issues:
-->
] Fwd: [trilinos/Trilinos] ifpack2: build error with scalar=FLOAT and COMPLEX_DOUBLE enabled (#4858)
https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4931Panzer: Enabling cuda aware mpi causes test failures on sierra2020-07-22T01:04:27ZJames WillenbringPanzer: Enabling cuda aware mpi causes test failures on sierra*Created by: bathmatt*
<!---
Provide a general summary of the issue in the Title above. If this issue
pertains to a particular package in Trilinos, it's worthwhile to start the
title with "PackageName: ".
-->
Many of the panz...*Created by: bathmatt*
<!---
Provide a general summary of the issue in the Title above. If this issue
pertains to a particular package in Trilinos, it's worthwhile to start the
title with "PackageName: ".
-->
Many of the panzer tests fail with cuda aware mpi using gcc+cuda-10.1+spectrum mpi. Has anyone actually tried this? ANy experience on this?
<!---
Note that anything between these delimiters is a comment that will not appear
in the issue description once created. Click on the Preview tab to see what
everything will look like when you submit.
-->
<!---
Feel free to delete anything from this template that is not applicable to the
issue you are submitting.
-->
<!---
Replace <teamName> below with the appropriate Trilinos package/team name.
-->
@trilinos/<teamName>
<!---
Assignees: If you know anyone who should likely tackle this issue, select them
from the Assignees drop-down on the right.
-->
<!---
Lables: Choose any applicable package names from the Labels drop-down on the
right. Additionally, choose a label to indicate the type of issue, for
instance, bug, build, documentation, enhancement, etc.
-->
## Expectations
<!---
Tell us what you think should happen, how you think things should work, what
you would like to see in the documentation, etc.
-->
## Current Behavior
<!---
Tell us how the current behavior fails to meet your expectations in some way.
-->
## Motivation and Context
<!---
How has this expectation failure affected you? What are you trying to
accomplish? Why do we need to address this? What does it have to do with
anything? Providing context helps us come up with a solution that is most
useful in the real world.
-->
## Definition of Done
<!---
Tell us what needs to happen. If necessary, give us a task list along the
lines of:
- [ ] First do this.
- [ ] Then do that.
- [ ] Also this other thing.
-->
## Possible Solution
<!---
Not obligatory, but suggest a fix for the bug or documentation, or suggest
ideas on how to implement the addition or change.
-->
## Steps to Reproduce
<!---
Provide a link to a live example, or an unambiguous set of steps to reproduce
this issue. Include code to reproduce, if relevant.
1. Do this.
1. Do that.
1. Shake fist angrily at computer.
-->
## Your Environment
<!---
Include relevant details about your environment such that we can replicate this
issue.
-->
- **Relevant repo SHA1s:**
- **Relevant configure flags or configure script:**
- **Operating system and version:**
- **Compiler and TPL versions:**
## Related Issues
<!---
If applicable, let us know how this bug is related to any other open issues:
-->
* Blocks
* Is blocked by
* Follows
* Precedes
* Related to
* Part of
* Composed of
## Additional Information
<!---
Anything else that might be helpful for us to know in addressing this issue:
* Configure log file:
* Build log file:
* Test log file:
* When was the last time everything worked (date/time; SHA1s; etc.)?
* What did you do that made the bug rear its ugly head?
* Have you tried turning it off and on again?
-->
https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4943Xpetra broke Albany nightly builds2020-07-22T01:04:27ZJames WillenbringXpetra broke Albany nightly builds*Created by: ikalash*
The Albany builds are still broken but in a new way since yesterday. Now Trilinos doesn't compile due to an Xpetra problem:
```
[ 68%] Building CXX object packages/xpetra/src/CMakeFiles/xpetra.dir/BlockedCrsMa...*Created by: ikalash*
The Albany builds are still broken but in a new way since yesterday. Now Trilinos doesn't compile due to an Xpetra problem:
```
[ 68%] Building CXX object packages/xpetra/src/CMakeFiles/xpetra.dir/BlockedCrsMatrix/Xpetra_BlockReorderManager.cpp.o
In file included from repos/Trilinos/packages/xpetra/src/Map/Xpetra_MapFactory.hpp:53,
from repos/Trilinos/packages/xpetra/src/CrsMatrix/Xpetra_EpetraCrsMatrix.hpp:69,
from repos/Trilinos/packages/xpetra/src/CrsMatrix/Xpetra_EpetraCrsMatrix.cpp:47:
/.../repos/Trilinos/packages/xpetra/src/Map/Xpetra_TpetraMap.hpp: In constructor 'Xpetra::TpetraMap >::TpetraMap(Xpetra::global_size_t, size_t, Xpetra::TpetraMap >::GlobalOrdinal, const Teuchos::RCP >&, const Teuchos::RCP >&)':
repos/Trilinos/packages/xpetra/src/Map/Xpetra_TpetraMap.hpp:460:71: error: call of overloaded 'TpetraMap(Xpetra::global_size_t&, size_t&, Xpetra::TpetraMap >::GlobalOrdinal&, const Teuchos::RCP >&)' is ambiguous
: TpetraMap(numGlobalElements, numLocalElements, indexBase, comm)
```
http://cdash.sandia.gov/CDash-2-3-0/viewBuildError.php?buildid=83774
@trilinos/xpetra
https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4962Tpetra broke Albany nightly build on waterman2020-07-22T01:04:27ZJames WillenbringTpetra broke Albany nightly build on waterman*Created by: ikalash*
Looks like Trilinos failed to compile in the Albany nightly build on waterman due to Tpetra. Here is the error:
```
76%] Building CXX object packages/tpetra/core/src/CMakeFiles/tpetra.dir/Tpetra_EpetraRowMat...*Created by: ikalash*
Looks like Trilinos failed to compile in the Albany nightly build on waterman due to Tpetra. Here is the error:
```
76%] Building CXX object packages/tpetra/core/src/CMakeFiles/tpetra.dir/Tpetra_EpetraRowMatrix.cpp.o
/.../repos/Trilinos/packages/tpetra/core/src/Tpetra_Details_normImpl.cpp(67): error: function "Tpetra::Details::normImpl(MagnitudeType *, const Kokkos::View &, Tpetra::Details::EWhichNorm, const Teuchos::ArrayView &, __nv_bool, __nv_bool, const Teuchos::Comm *) [with ValueType=int, ArrayLayout=Kokkos::LayoutLeft, DeviceType=Kokkos::Device, MagnitudeType=int]" explicitly instantiated more than once
```
http://cdash.sandia.gov/CDash-2-3-0/viewBuildError.php?buildid=83824
@trilinos/tpetra https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4964Tempus: Output After Passing Output Time2020-07-22T01:04:27ZJames WillenbringTempus: Output After Passing Output Time*Created by: ccober6*
Would like to output when the timestep steps over the output time, and do not adjust the timestep size to exactly "land" on the output time.*Created by: ccober6*
Would like to output when the timestep steps over the output time, and do not adjust the timestep size to exactly "land" on the output time.https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4963Intrepid2 and Panzer build errors in new cuda-10.1 builds on 'white'2020-07-22T01:04:27ZJames WillenbringIntrepid2 and Panzer build errors in new cuda-10.1 builds on 'white'*Created by: bartlettroscoe*
CC: @trilinos/intrepid2, @trilinos/panzer @mperego (Trilinos Discretizations Product Lead), @bartlettroscoe, @fryeguy52
<Checklist>
<???: Add label "client: ATDM">
<???: Add label "ATDM Sev: Blocker" (...*Created by: bartlettroscoe*
CC: @trilinos/intrepid2, @trilinos/panzer @mperego (Trilinos Discretizations Product Lead), @bartlettroscoe, @fryeguy52
<Checklist>
<???: Add label "client: ATDM">
<???: Add label "ATDM Sev: Blocker" (by default but could be other "ATDM Sev: XXX")>
<???: Add label "type: bug"?>
<???: Add label for affected packages (e.g. "pkg: MueLu", "pkg: Tpetra", "pkg: Kokkos", etc.)>
<???: Add label "PA: ???Project Area???" (e.g. "PA: Linear Solvers", "PA: Data Services")>
<???: Add milestone "Initial cleanup of new ATDM ..." or "Keep promoted ATDM ...">
<???: Once GitHub Issue is created, add entries for tests to TrilinosATDMStatus/*.csv files>
## Next Action Status
<status-and-or-first-action>
## Description
As shown [here on CDash](https://testing.sandia.gov/cdash-dev-view/index.php?project=Trilinos&parentid=4917892), there are many build failures in Intrepid2 and Panzer shown in the new build:
* `Trilinos-atdm-white-ride-cuda-10.1-gnu-7.2.0-release-debug`
that as been set up on 'white' (see [TRIL-245](https://sems-atlassian-son.sandia.gov/jira/browse/TRIL-245)).
This starts with build errors in Intrepid2 as shown [here](https://testing.sandia.gov/cdash-dev-view/viewBuildError.php?buildid=4917897) that look like:
```
/home/jenkins/white/workspace/Trilinos-atdm-white-ride-cuda-10.1-gnu-7.2.0-release-debug/SRC_AND_BUILD/Trilinos/packages/intrepid2/src/Discretization/Basis/Intrepid2_HCURL_TET_In_FEMDef.hpp:451:64: error: invalid conversion from ‘Intrepid2::ordinal_type* {aka int*}’ to ‘Intrepid2::ordinal_type {aka int}’ [-fpermissive]
tags[i_card+1][0] = 2; // face dof
```
The build errors in Panzer look to be these same errors coming from Intrepid2.
## Current Status on CDash
* [Trilinos-atdm-white-ride-cuda-10.1-gnu-7.2.0-release-debug Intrepid2 build summary last 5 days](https://testing.sandia.gov/cdash-dev-view/index.php?project=Trilinos&date=2019-04-19&filtercount=3&showfilters=1&filtercombine=and&field1=subprojects&compare1=93&value1=Intrepid2&field2=buildname&compare2=61&value2=Trilinos-atdm-white-ride-cuda-10.1-gnu-7.2.0-release-debug&field3=buildstarttime&compare3=83&value3=5%20days%20ago)
## Steps to Reproduce
One should be able to reproduce this failure on the machine 'white' as described in:
* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md
More specifically, the commands given for the system 'white' are provided at:
* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#ridewhite
The exact commands on 'white' to reproduce this issue should be:
```
$ cd <some_build_dir>/
$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh \
Trilinos-atdm-white-ride-cuda-10.1-gnu-7.2.0-release-debug
$ cmake \
-GNinja \
-DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \
-DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_Intrepid2=ON \
$TRILINOS_DIR
$ make NP=16
```
Initial cleanup of new ATDM builds of Trilinoshttps://gitlab.osti.gov/jmwille/Trilinos/-/issues/4970Tempus: Add accessor to WrapperModelEvaluator2020-07-22T01:04:27ZJames WillenbringTempus: Add accessor to WrapperModelEvaluator*Created by: ccober6*
## Enhancement
@trilinos/tempus
For a segregated linear solve, EMPIRE needs access to the WrapperModelEvaluator to get to alpha and beta. Adding simple accessors to it.*Created by: ccober6*
## Enhancement
@trilinos/tempus
For a segregated linear solve, EMPIRE needs access to the WrapperModelEvaluator to get to alpha and beta. Adding simple accessors to it.https://gitlab.osti.gov/jmwille/Trilinos/-/issues/4973Trilinos seacas build issue on mayer with ARM compiler2020-07-22T01:04:26ZJames WillenbringTrilinos seacas build issue on mayer with ARM compiler*Created by: ikalash*
I'm encountering a build error when trying to build Trilinos develop on mayer with the ARM compiler (module load devpack-arm/20190201). Here is the error:
```
[ 41%] Building CXX object packages/seacas/libraries...*Created by: ikalash*
I'm encountering a build error when trying to build Trilinos develop on mayer with the ARM compiler (module load devpack-arm/20190201). Here is the error:
```
[ 41%] Building CXX object packages/seacas/libraries/ioss/src/CMakeFiles/Ioss.dir/Ioss_Node.C.o
[ 41%] Linking CXX executable nem_slice
Scanning dependencies of target mapvar
[ 41%] Building Fortran object packages/seacas/applications/mapvar/CMakeFiles/mapvar.dir/getbnd.f.o
[ 41%] Building Fortran object packages/seacas/applications/mapvar/CMakeFiles/mapvar.dir/mapvar.f.o
F90-S-0029-Illegal hexadecimal constant: Seehttps://github.com/gsjaardema/seacas/packages (/mscratch/albany/mayer/nightlyCDashTrilinos/repos/Trilinos/packages/seacas/applications/mapvar/mapvar.f: 417)
F90-S-0034-Syntax error at or near non-decimal constant 0 (/mscratch/albany/mayer/nightlyCDashTrilinos/repos/Trilinos/packages/seacas/applications/mapvar/mapvar.f: 417)
F90-S-0029-Illegal hexadecimal constant: Seehttps://github.com/gsjaardema/seacas/packages (/mscratch/albany/mayer/nightlyCDashTrilinos/repos/Trilinos/packages/seacas/applications/mapvar/mapvar.f: 428)
F90-S-0034-Syntax error at or near non-decimal constant 0 (/mscratch/albany/mayer/nightlyCDashTrilinos/repos/Trilinos/packages/seacas/applications/mapvar/mapvar.f: 428)
0 inform, 0 warnings, 4 severes, 0 fatal for mapvar
[ 41%] Building Fortran object packages/seacas/applications/mapvar/CMakeFiles/mapvar.dir/mklstv.f.o
[ 41%] Built target nem_slice
[ 41%] Building Fortran object packages/seacas/applications/mapvar/CMakeFiles/mapvar.dir/mkrnk.f.o
[ 41%] Building Fortran object packages/seacas/applications/mapvar/CMakeFiles/mapvar.dir/rank.f.o
[ 41%] Building Fortran object packages/seacas/applications/mapvar/CMakeFiles/mapvar.dir/srchge.f.o
[ 41%] Building Fortran object packages/seacas/applications/mapvar/CMakeFiles/mapvar.dir/srchgt.f.o
Scanning dependencies of target mapvar-kd
[ 41%] Building Fortran object packages/seacas/applications/mapvar-kd/CMakeFiles/mapvar-kd.dir/mapvar-kd.f.o
F90-S-0029-Illegal hexadecimal constant: Seehttps://github.com/gsjaardema/seacas/packages (/mscratch/albany/mayer/nightlyCDashTrilinos/repos/Trilinos/packages/seacas/applications/mapvar-kd/mapvar-kd.f: 285)
F90-S-0034-Syntax error at or near non-decimal constant 0 (/mscratch/albany/mayer/nightlyCDashTrilinos/repos/Trilinos/packages/seacas/applications/mapvar-kd/mapvar-kd.f: 285)
```
According to my colleague @jewatkins, the build worked just fine on April 9. Our configure script is attached.
[do-cmake-trilinos-arm-serial.txt](https://github.com/trilinos/Trilinos/files/3099602/do-cmake-trilinos-arm-serial.txt)
@trilinos/seacas