Lines Matching full:suite
1 test-suite Guide
41 2. Check out the `test-suite` module with:
44 % git clone https://github.com/llvm/llvm-test-suite.git test-suite
47 3. Create a build directory and use CMake to configure the suite. Use the
52 % mkdir test-suite-build
53 % cd test-suite-build
55 -C../test-suite/cmake/caches/O3.cmake \
56 ../test-suite
78 PASS: test-suite :: MultiSource/Applications/ALAC/decode/alacconvert-decode.test (1 of 474)
79 ********** TEST 'test-suite :: MultiSource/Applications/ALAC/decode/alacconvert-decode.test' RESULTS **********
85 PASS: test-suite :: MultiSource/Applications/ALAC/encode/alacconvert-encode.test (2 of 474)
98 % test-suite/utils/compare.py results.json
100 % test-suite/utils/compare.py results_a.json results_b.json
107 The test-suite contains benchmark and test programs. The programs come with
108 reference outputs so that their correctness can be checked. The suite comes
112 The test-suite is divided into several directories:
133 distributed with the test-suite. The most prominent members of this
165 | FreeBench | C | Benchmark suite | Raytracer, four in a row, neural network, file compressor, Fast Fourier/Cosine/Sine Transform |
168 | MallocBench | C | Benchmark suite | cfrac, espresso, gawk, gs, make, p2c, perl |
169 | McCat | C | Benchmark suite | Quicksort, bubblesort, eigenvalues |
170 | mediabench | C | Benchmark suite | adpcm, g721, gsm, jpeg, mpeg2 |
171 | MiBench | C | Embedded benchmark suite | Automotive, consumer, office, security, telecom apps |
177 | Prolangs-C++ | C++ | Benchmark suite | city, employ, life, NP, ocean, primes, simul, vcirc |
178 | Prolangs-C | C | Benchmark suite | agrep, archie-client, bison, gnugo, unix-smail |
179 | Ptrdist | C | Pointer-Intensive Benchmark Suite | |
185 | TSVC | C | Vectorization benchmark | Test Suite for Vectorizing Compilers (TSVC) |
186 | VersaBench | C | Benchmark suite | 8b10b, beamformer, bmm, dbms, ecbdes |
194 The test-suite has configuration options to customize building and running the
198 % cd test-suite-build
223 required unless running the Fortran Test Suite.
251 build parts of the test-suite or to include external suites. This option
268 comes with the test-suite. The `perf` is usually available on linux systems.
282 - `-Ctest-suite/cmake/caches/<cachefile.cmake>`
284 Use a CMake cache. The test-suite comes with several CMake caches which
299 % test-suite/utils/compare.py baseline.json
300 Warning: 'test-suite :: External/SPEC/CINT2006/403.gcc/403.gcc.test' has No metrics!
323 % test-suite/utils/compare.py -m compile_time baseline.json
324 % test-suite/utils/compare.py -m size.__text baseline.json
330 % test-suite/utils/compare.py --filter-short baseline.json experiment.json
344 % test-suite/utils/compare.py base0.json base1.json base2.json vs exp0.json exp1.json exp2.json
360 - placing (or linking) them into the `test-suite/test-suite-externals/xxx` directory (example: `test-suite/test-suite-externals/speccpu2000`)
364 `test-suite/External/SPEC/README`.
372 llvm-test-suite, a lot more of potentially vectorizable code gets compiled
377 available.) The integration into llvm-test-suite doesn't run the projects'
381 `llvm-test-suite/External` for further details.
387 You can build custom suites using the test-suite infrastructure. A custom suite
389 picked up automatically if placed into a subdirectory of the test-suite or when
393 % cmake -DTEST_SUITE_SUBDIRS=path/to/my/benchmark-suite ../test-suite
411 ../test-suite
441 `test-suite/cmake/caches/target-target-*-iphoneos-internal.cmake` CMake cache
459 -C ../test-suite/cmake/caches/target-arm64-iphoneos-internal.cmake \
462 ../test-suite
473 Running the test-suite via LNT
476 The LNT tool can run the test-suite. Use this when submitting test results to
478 [https://llvm.org/docs/lnt/tests.html#llvm-cmake-test-suite](https://llvm.org/docs/lnt/tests.html#llvm-cmake-test-suite)
481 Running the test-suite via Makefiles (deprecated)
484 **Note**: The test-suite comes with a set of Makefiles that are considered
489 [test-suite Makefile Guide](TestSuiteMakefileGuide).