xref: /llvm-project/llvm/utils/lit/tests/googletest-no-sharding.py (revision 44d4b30ca30b11f29fdb7819e94dcc54ac8a979a)
16eee2389SHaowei# Check the various features of the GoogleTest format.
26eee2389SHaowei
3*44d4b30cSHaowei# RUN: not %{lit} -v --no-gtest-sharding --order=random %{inputs}/googletest-no-sharding > %t.out
46eee2389SHaowei# FIXME: Temporarily dump test output so we can debug failing tests on
56eee2389SHaowei# buildbots.
66eee2389SHaowei# RUN: cat %t.out
76eee2389SHaowei# RUN: FileCheck < %t.out %s
86eee2389SHaowei#
96eee2389SHaowei# END.
106eee2389SHaowei
116eee2389SHaowei# CHECK: -- Testing:
126eee2389SHaowei# CHECK: FAIL: googletest-no-sharding :: [[PATH:[Dd]ummy[Ss]ub[Dd]ir/]][[FILE:OneTest\.py]]
136eee2389SHaowei# CHECK: *** TEST 'googletest-no-sharding :: [[PATH]][[FILE]]' FAILED ***
146eee2389SHaowei# CHECK-NEXT: Script(shard):
156eee2389SHaowei# CHECK-NEXT: --
166eee2389SHaowei# CHECK-NEXT: GTEST_OUTPUT=json:{{[^[:space:]]*}} GTEST_SHUFFLE=1 GTEST_RANDOM_SEED=123 {{.*}}[[FILE]]
176eee2389SHaowei# CHECK-NEXT: --
186eee2389SHaowei# CHECK-EMPTY:
196eee2389SHaowei# CHECK-NEXT: Script:
206eee2389SHaowei# CHECK-NEXT: --
216eee2389SHaowei# CHECK-NEXT: [[FILE]] --gtest_filter=FirstTest.subTestB
226eee2389SHaowei# CHECK-NEXT: --
236eee2389SHaowei# CHECK-NEXT: I am subTest B output
246eee2389SHaowei# CHECK-EMPTY:
256eee2389SHaowei# CHECK-NEXT: I am subTest B, I FAIL
266eee2389SHaowei# CHECK-NEXT: And I have two lines of output
276eee2389SHaowei# CHECK-EMPTY:
286eee2389SHaowei# CHECK: Script:
296eee2389SHaowei# CHECK-NEXT: --
306eee2389SHaowei# CHECK-NEXT: [[FILE]] --gtest_filter=FirstTest.subTestD
316eee2389SHaowei# CHECK-NEXT: --
326eee2389SHaowei# CHECK-NEXT: unresolved test result
336eee2389SHaowei# CHECK: ***
346eee2389SHaowei# CHECK: ***
356eee2389SHaowei# CHECK: Unresolved Tests (1):
366eee2389SHaowei# CHECK-NEXT:   googletest-no-sharding :: FirstTest/subTestD
376eee2389SHaowei# CHECK: ***
386eee2389SHaowei# CHECK-NEXT: Failed Tests (1):
396eee2389SHaowei# CHECK-NEXT:   googletest-no-sharding :: FirstTest/subTestB
406eee2389SHaowei# CHECK: Skipped{{ *}}: 1
416eee2389SHaowei# CHECK: Passed{{ *}}: 3
426eee2389SHaowei# CHECK: Unresolved{{ *}}: 1
436eee2389SHaowei# CHECK: Failed{{ *}}: 1
44