Trilinos auto PR tester stability issues
Created by: bartlettroscoe
@trilinos/framework
Description
Over the last few weeks and months, the Trilinos auto PR tester has seen several cases where one or more PR builds for a given PR testing iteration failed to produce results on CDash or showed build or test failures that were not related to the changes on that particular PR.
This Story is to log these fails and keep track of them in order to provide some statistics about these cases in order to inform how to address them. This should replace making comments in individual PRs that exhibit these types of problems like #3260 and #3213.
PR Builds Showing Random Failures
Below are a few examples of the stability problems (but are not all of the problems).
| PR ID | Num PR Builds to reach passing | First test trigger | Start first test | Passing test | Merge PR |
|---|---|---|---|---|---|
| #3258 | 2 | 8/8/2018 2:35 PM ET | 8/8/2018 2:44 PM | 8/8/2018 9:15 PM ET | Not merged |
| #3260 | 4 | 8/8/2018 5:22 PM ET | 8/8/2018 6:31 PM ET | 8/10/2018 4:13 AM ET | 8/10/2018 8:25 AM |
| #3213 | 3 | 7/31/2018 4:30 PM ET | 7/31/2018 4:57 PM ET | 8/1/2018 9:48 AM ET | 8/1/2018 9:53 AM ET |
| #3098 | 4 | 7/12/2018 12:52 PM ET | 7/12/2018 1:07 PM ET | 7/13/2018 11:12 PM ET | 7/14/2018 10:59 PM ET |
| #3369 | 6 | 8/29/2018 9:08 AM ET | 8/29/2018 9:16 AM ET | 8/31/2018 6:09 AM ET | 8/31/2018 8:33 AM ET |