xref: /llvm-project/llvm/utils/lit/tests/googletest-sanitizer-error.py (revision e97b2d413849d3dbc8b49740ce5a07ed0382309c)
1*e97b2d41SYuanfang Chen# Check the output is expected when tests pass but sanitizer fails.
2*e97b2d41SYuanfang Chen# Note that there is only one shard which has only one sub-test. However, the summary
3*e97b2d41SYuanfang Chen# has one pass for the sub-test and one fail for the shard failure due to sanitizer
4*e97b2d41SYuanfang Chen# reported errors.
5*e97b2d41SYuanfang Chen
6*e97b2d41SYuanfang Chen# RUN: not %{lit} -v --order=random %{inputs}/googletest-sanitizer-error > %t.out
7*e97b2d41SYuanfang Chen# FIXME: Temporarily dump test output so we can debug failing tests on
8*e97b2d41SYuanfang Chen# buildbots.
9*e97b2d41SYuanfang Chen# RUN: cat %t.out
10*e97b2d41SYuanfang Chen# RUN: FileCheck < %t.out %s
11*e97b2d41SYuanfang Chen#
12*e97b2d41SYuanfang Chen# END.
13*e97b2d41SYuanfang Chen
14*e97b2d41SYuanfang Chen# CHECK: -- Testing:
15*e97b2d41SYuanfang Chen# CHECK: FAIL: googletest-sanitizer-error :: [[PATH:[Dd]ummy[Ss]ub[Dd]ir/]][[FILE:OneTest\.py]]/0
16*e97b2d41SYuanfang Chen# CHECK: *** TEST 'googletest-sanitizer-error :: [[PATH]][[FILE]]/0{{.*}} FAILED ***
17*e97b2d41SYuanfang Chen# CHECK-NEXT: Script(shard):
18*e97b2d41SYuanfang Chen# CHECK-NEXT: --
19*e97b2d41SYuanfang Chen# CHECK-NEXT: GTEST_OUTPUT=json:{{[^[:space:]]*}} GTEST_SHUFFLE=1 GTEST_TOTAL_SHARDS={{[1-6]}} GTEST_SHARD_INDEX=0 GTEST_RANDOM_SEED=123 {{.*}}[[FILE]]
20*e97b2d41SYuanfang Chen# CHECK-NEXT: --
21*e97b2d41SYuanfang Chen# CHECK-EMPTY:
22*e97b2d41SYuanfang Chen# CHECK-EMPTY:
23*e97b2d41SYuanfang Chen# CHECK:      [ RUN      ] FirstTest.subTestA
24*e97b2d41SYuanfang Chen# CHECK-NEXT: [       OK ] FirstTest.subTestA (8 ms)
25*e97b2d41SYuanfang Chen# CHECK:      --
26*e97b2d41SYuanfang Chen# CHECK-NEXT: exit: 1
27*e97b2d41SYuanfang Chen# CHECK-NEXT: --
28*e97b2d41SYuanfang Chen# CHECK:      Failed Tests (1):
29*e97b2d41SYuanfang Chen# CHECK-NEXT:   googletest-sanitizer-error :: [[PATH]][[FILE]]/0/1
30*e97b2d41SYuanfang Chen# CHECK: Passed{{ *}}: 1
31*e97b2d41SYuanfang Chen# CHECK: Failed{{ *}}: 1
32