1 Testing 2 ======= 3 4 Zstandard CI testing is split up into three sections: 5 short, medium, and long tests. 6 7 Short Tests 8 ----------- 9 Short tests run on CircleCI for new commits on every branch and pull request. 10 They consist of the following tests: 11 - Compilation on all supported targets (x86, x86_64, ARM, AArch64, PowerPC, and PowerPC64) 12 - Compilation on various versions of gcc, clang, and g++ 13 - `tests/playTests.sh` on x86_64, without the tests on long data (CLI tests) 14 - Small tests (`tests/legacy.c`, `tests/longmatch.c`) on x64_64 15 16 Medium Tests 17 ------------ 18 Medium tests run on every commit and pull request to `dev` branch, on TravisCI. 19 They consist of the following tests: 20 - The following tests run with UBsan and Asan on x86_64 and x86, as well as with 21 Msan on x86_64 22 - `tests/playTests.sh --test-large-data` 23 - Fuzzer tests: `tests/fuzzer.c`, `tests/zstreamtest.c`, and `tests/decodecorpus.c` 24 - `tests/zstreamtest.c` under Tsan (streaming mode, including multithreaded mode) 25 - Valgrind Test (`make -C tests test-valgrind`) (testing CLI and fuzzer under `valgrind`) 26 - Fuzzer tests (see above) on ARM, AArch64, PowerPC, and PowerPC64 27 28 Long Tests 29 ---------- 30 Long tests run on all commits to `release` branch, 31 and once a day on the current version of `dev` branch, 32 on TravisCI. 33 They consist of the following tests: 34 - Entire test suite (including fuzzers and some other specialized tests) on: 35 - x86_64 and x86 with UBsan and Asan 36 - x86_64 with Msan 37 - ARM, AArch64, PowerPC, and PowerPC64 38 - Streaming mode fuzzer with Tsan (for the `zstdmt` testing) 39 - ZlibWrapper tests, including under valgrind 40 - Versions test (ensuring `zstd` can decode files from all previous versions) 41 - `pzstd` with asan and tsan, as well as in 32-bits mode 42 - Testing `zstd` with legacy mode off 43 - Entire test suite and make install on macOS 44