... | ... | @@ -16,25 +16,25 @@ Nightly builds test branches that are updated at the same time each day (9 p.m. |
|
|
|
|
|
Links to main Trilinos CDash dashboard results and query tools:
|
|
|
|
|
|
+ [Main projects dashboard page for the current day](https://testing.sandia.gov/cdash)
|
|
|
+ [Subprojects (packages) dashboard page for Trilinos for the current day](https://testing.sandia.gov/cdash/viewSubProjects.php?project=Trilinos) [**Warning**: can be slow to come up]
|
|
|
+ [Main projects dashboard page for the current day](https://testing-vm.sandia.gov/cdash)
|
|
|
+ [Subprojects (packages) dashboard page for Trilinos for the current day](https://testing-vm.sandia.gov/cdash/viewSubProjects.php?project=Trilinos) [**Warning**: can be slow to come up]
|
|
|
+ Tip: To get a quick summary for all the packages that had configure, build, or test failures, sort the packages in descending order by holding down the Shift key and then click twice on the column headers **Configure: Error, Build: Error**, then **Test: Fail**.
|
|
|
+ [Subproject (package) dashboard page Trilinos package Teuchos for the current day](https://testing.sandia.gov/cdash/index.php?project=Trilinos&subproject=Teuchos)
|
|
|
+ [Subproject (package) dashboard page Trilinos package Teuchos for the current day](https://testing-vm.sandia.gov/cdash/index.php?project=Trilinos&subproject=Teuchos)
|
|
|
+ Tip: To query other packages change 'Teuchos' in the URL to some another package name (e.g. 'Epetra', 'Tpetra', etc.)
|
|
|
+ [Summary of Trilinos builds for the current day](https://testing.sandia.gov/cdash/index.php?project=Trilinos&display=project)
|
|
|
+ [Summary of Trilinos builds for the current day](https://testing-vm.sandia.gov/cdash/index.php?project=Trilinos&display=project)
|
|
|
+ Tip: To get a quick summary for all the build groups that had configure, build, or test failures, sort the build group rows in descending order by holding down the Shift key and then click twice on the column headers **Configure: Error, Build: Error**, then **Test: Fail**.
|
|
|
+ Tip: To see the individual package builds/tests, click on the name of the build in the **Build Name** field.
|
|
|
+ Tip: To see what files got updated, click the number in the **Update** field.
|
|
|
+ Tip: To exclude bad packages (i.e. packages with build and/or test failures) from the build summaries, click [Show Filters] and then select the filter ('Subprojects', 'exclude', '<BAD_PACKAGE_NAME>').
|
|
|
+ Test query page:
|
|
|
+ [All tests for current day](https://testing.sandia.gov/cdash/queryTests.php?project=Trilinos&showfilters=1) [**Warning**: very slow to come up]
|
|
|
+ [Failing tests for current day](https://testing.sandia.gov/cdash/queryTests.php?project=Trilinos&filtercount=1&showfilters=1&field1=status&compare1=62&value1=Passed) [Comes up fast]
|
|
|
+ [All tests for current day](https://testing-vm.sandia.gov/cdash/queryTests.php?project=Trilinos&showfilters=1) [**Warning**: very slow to come up]
|
|
|
+ [Failing tests for current day](https://testing-vm.sandia.gov/cdash/queryTests.php?project=Trilinos&filtercount=1&showfilters=1&field1=status&compare1=62&value1=Passed) [Comes up fast]
|
|
|
+ Tip: To see all runs for a given test `<TestName>`, use filter ('Test Name', 'starts with', '`<TestName>`')
|
|
|
+ Tip: To query results for `<PACKAGEX>`, select the filter ('Test Name', 'starts with', '`PACKAGEX_`')
|
|
|
+ Tip: To query passing tests, select the filter ('Status', 'is', 'passed') [Note the lower case 'passed')
|
|
|
+ Tip: To query failing tests, select the filter ('Status', 'is', 'failed') [Note the lower case 'failed')
|
|
|
+ Tip: To see tests for the last two weeks, select the filter ('Build Time', 'is after', '2 weeks ago')
|
|
|
+ [Current coverage results](https://testing.sandia.gov/extended/cdash/index.php?project=Trilinos&display=project&filtercount=2&showfilters=1&filtercombine=and&field1=buildstarttime/date&compare1=83&value1=7%20days%20ago&field2=buildname/string&compare2=66&value2=_COV) (as of last Saturday)
|
|
|
+ [Current coverage results](https://testing-vm.sandia.gov/extended/cdash/index.php?project=Trilinos&display=project&filtercount=2&showfilters=1&filtercombine=and&field1=buildstarttime/date&compare1=83&value1=7%20days%20ago&field2=buildname/string&compare2=66&value2=_COV) (as of last Saturday)
|
|
|
+ Tip: Click on the Build Name for the MPI or Serial build under 'Nightly' and then go to 'Coverage' to the coverage results for each Trilinos package.
|
|
|
|
|
|
<a name="categories_of_tests"/>
|
... | ... | @@ -86,7 +86,7 @@ The main purposes for having a post-push CI server running in addition to pre-pu |
|
|
|
|
|
<a name="nightly_regression_testing"/>
|
|
|
|
|
|
**Nightly Regression Testing**: Secondary Tested Code [[Nightly Regression Dashboard](https://testing.sandia.gov/cdash/index.php?project=Trilinos&filtercount=1&showfilters=1&field1=groupname&compare1=61&value1=Nightly)]
|
|
|
**Nightly Regression Testing**: Secondary Tested Code [[Nightly Regression Dashboard](https://testing-vm.sandia.gov/cdash/index.php?project=Trilinos&filtercount=1&showfilters=1&field1=groupname&compare1=61&value1=Nightly)]
|
|
|
|
|
|
Each night starting at 12 Midnight MST/MDT, a wide range of configurations of Trilinos are tested on a variety of different platforms for [Secondary Tested (PT) Code](http://trac.trilinos.org/wiki/TribitsLifecycleModelOverview#test_categories). MPI and SERIAL are varied along with DEBUG and RELEASE. Different compilers are used. Builds are performed with shared or static libraries.
|
|
|
|
... | ... | @@ -94,7 +94,7 @@ The test category set for nightly testing is `Trilinos_TEST_CATEGORIES=NIGHTLY` |
|
|
|
|
|
<a name="performance_testing"/>
|
|
|
|
|
|
**Performance Testing**: Secondary Tested Code [[Nightly Performance Dashboard](https://testing.sandia.gov/cdash/index.php?project=Trilinos&display=project&filtercount=2&showfilters=1&filtercombine=and&field1=buildname/string&compare1=63&value1=PERF&field2=groupname/string&compare2=61&value2=Nightly)]
|
|
|
**Performance Testing**: Secondary Tested Code [[Nightly Performance Dashboard](https://testing-vm.sandia.gov/cdash/index.php?project=Trilinos&display=project&filtercount=2&showfilters=1&filtercombine=and&field1=buildname/string&compare1=63&value1=PERF&field2=groupname/string&compare2=61&value2=Nightly)]
|
|
|
|
|
|
!!! **NOTE: PERFORMANCE TESTING IS CURRENTLY DISABLED** !!!
|
|
|
|
... | ... | @@ -118,7 +118,7 @@ The first build can be based directly on a git clone, rather than a release-like |
|
|
|
|
|
<a name="experimental_testing"/>
|
|
|
|
|
|
**Experimental Testing**: Experimental Code [[Experimental Dashboard](https://testing.sandia.gov/cdash/index.php?project=Trilinos&filtercount=1&showfilters=1&field1=groupname&compare1=61&value1=Experimental)]
|
|
|
**Experimental Testing**: Experimental Code [[Experimental Dashboard](https://testing-vm.sandia.gov/cdash/index.php?project=Trilinos&filtercount=1&showfilters=1&field1=groupname&compare1=61&value1=Experimental)]
|
|
|
|
|
|
The experimental dashboard contains a host of experimental builds where no emails are sent out for failed builds. Some of these experimental builds are run by cron jobs every night. Regularly scheduled builds that are run as experimental builds usually have some issues that result in several failed package builds or test failures and are not ready for "prime time" yet. The goal is to get these builds to a state where they can be moved over to regular "Nightly" builds where emails will be sent out reporting failures.
|
|
|
|
... | ... | @@ -128,7 +128,7 @@ By default, the test category set for experimental testing is `Trilinos_TEST_CAT |
|
|
|
|
|
<a name="coverage_testing"/>
|
|
|
|
|
|
**Coverage Testing**: Secondary Tested Code [[Current coverage results](https://testing.sandia.gov/extended/cdash/index.php?project=Trilinos&display=project&filtercount=2&showfilters=1&filtercombine=and&field1=buildstarttime/date&compare1=83&value1=7%20days%20ago&field2=buildname/string&compare2=66&value2=_COV) (as of last Saturday)]
|
|
|
**Coverage Testing**: Secondary Tested Code [[Current coverage results](https://testing-vm.sandia.gov/extended/cdash/index.php?project=Trilinos&display=project&filtercount=2&showfilters=1&filtercombine=and&field1=buildstarttime/date&compare1=83&value1=7%20days%20ago&field2=buildname/string&compare2=66&value2=_COV) (as of last Saturday)]
|
|
|
|
|
|
!!!**NOTE: REGULAR COVERAGE TESTING IS CURRENTLY DISABLED** !!!
|
|
|
|
... | ... | @@ -142,7 +142,7 @@ Note that coverage results are reported to a separate dashboard. Developers requ |
|
|
|
|
|
<a name="memory_testing"/>
|
|
|
|
|
|
**Memory Testing**: Most Secondary Tested Code [ [Current Memory testing Results](https://testing.sandia.gov/cdash/index.php?project=Trilinos&display=project&filtercount=2&showfilters=1&filtercombine=and&field1=buildname/string&compare1=66&value1=_MEMCHECK&field2=buildstarttime/date&compare2=83&value2=1%20days%20ago&collapse=0)]
|
|
|
**Memory Testing**: Most Secondary Tested Code [ [Current Memory testing Results](https://testing-vm.sandia.gov/cdash/index.php?project=Trilinos&display=project&filtercount=2&showfilters=1&filtercombine=and&field1=buildname/string&compare1=66&value1=_MEMCHECK&field2=buildstarttime/date&compare2=83&value2=1%20days%20ago&collapse=0)]
|
|
|
|
|
|
!!! **NOTE: REGULAR MEMORY/VALGRIND TESTING IS CURRENTLY DISABLED** !!!
|
|
|
|
... | ... | |