derek.holloway
7502bf64a4
CodeQL / Analyze (actions) (push) Canceled after 0s
CodeQL / Analyze (python) (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Multi-Arch CI / setup (push) Canceled after 0s
Publish build_manylinux_x86_64 images / publish_build_manylinux_x86_64 (push) Canceled after 0s
Setup (Multi-Arch) / setup (push) Canceled after 0s
Multi-Arch CI / Linux::${{ fromJSON(needs.setup.outputs.linux_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubi10 image / publish_no_rocm_image_ubi10 (push) Canceled after 0s
Multi-Arch CI / Windows::${{ fromJSON(needs.setup.outputs.windows_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Multi-Arch CI / Manifest Diff (push) Canceled after 0s
TheRock Manifest Diff Report / Generate Manifest Diff Report (push) Canceled after 0s
Multi-Arch CI / CI Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_ocl_rt images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_rocgdb images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Unit Tests / Unit Tests :: ubuntu-24.04 (push) Canceled after 0s
Unit Tests / Unit Tests :: windows-2022 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_media (push) Canceled after 0s
Unit Tests / Unit Tests Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_openmpi (push) Canceled after 0s
190 lines
7.4 KiB
Python
190 lines
7.4 KiB
Python
# Check the various features of the ShTest format.
|
|
|
|
# RUN: rm -f %t.xml
|
|
# RUN: not %{lit} -v %{inputs}/shtest-format --xunit-xml-output %t.xml > %t.out
|
|
# RUN: FileCheck < %t.out %s
|
|
# RUN: FileCheck --check-prefix=XUNIT < %t.xml %s
|
|
|
|
# END.
|
|
|
|
# CHECK: -- Testing:
|
|
|
|
# CHECK: FAIL: shtest-format :: external_shell/fail.txt
|
|
# CHECK-NEXT: *** TEST 'shtest-format :: external_shell/fail.txt' FAILED ***
|
|
# CHECK: Command Output (stdout):
|
|
# CHECK-NEXT: --
|
|
# CHECK-NEXT: line 1: failed test output on stdout
|
|
# CHECK-NEXT: line 2: failed test output on stdout
|
|
# CHECK: Command Output (stderr):
|
|
# CHECK-NEXT: --
|
|
# CHECK-NOT: --
|
|
# CHECK: cat{{(_64)?(\.exe)?}}: {{(cannot open does-not-exist|.*does-not-exist.*: No such file or directory)}}
|
|
# CHECK: --
|
|
|
|
# CHECK: FAIL: shtest-format :: external_shell/fail_with_bad_encoding.txt
|
|
# CHECK-NEXT: *** TEST 'shtest-format :: external_shell/fail_with_bad_encoding.txt' FAILED ***
|
|
# CHECK: Command Output (stdout):
|
|
# CHECK-NEXT: --
|
|
# CHECK-NEXT: a line with bad encoding:
|
|
# CHECK: --
|
|
|
|
# CHECK: FAIL: shtest-format :: external_shell/fail_with_control_chars.txt
|
|
# CHECK-NEXT: *** TEST 'shtest-format :: external_shell/fail_with_control_chars.txt' FAILED ***
|
|
# CHECK: Command Output (stdout):
|
|
# CHECK-NEXT: --
|
|
# CHECK-NEXT: a line with {{.*}}control characters{{.*}}.
|
|
# CHECK: --
|
|
|
|
# CHECK: PASS: shtest-format :: external_shell/pass.txt
|
|
|
|
# CHECK: FAIL: shtest-format :: fail.txt
|
|
# CHECK-NEXT: *** TEST 'shtest-format :: fail.txt' FAILED ***
|
|
# CHECK-NEXT: Exit Code: 1
|
|
# CHECK-EMPTY:
|
|
# CHECK-NEXT: Command Output (stdout):
|
|
# CHECK-NEXT: --
|
|
# CHECK-NEXT: # RUN: at line 1
|
|
# CHECK-NEXT: printf "line 1: failed test output on stdout\nline 2: failed test output on stdout"
|
|
# CHECK-NEXT: executed command: printf 'line 1: failed test output on stdout\nline 2: failed test output on stdout'
|
|
# CHECK-NEXT: # .---command stdout------------
|
|
# CHECK-NEXT: # | line 1: failed test output on stdout
|
|
# CHECK-NEXT: # | line 2: failed test output on stdout
|
|
# CHECK-NEXT: # `-----------------------------
|
|
# CHECK-NEXT: # RUN: at line 2
|
|
# CHECK-NEXT: false
|
|
# CHECK-NEXT: # executed command: false
|
|
# CHECK-NEXT: # note: command had no output on stdout or stderr
|
|
# CHECK-NEXT: # error: command failed with exit status: 1
|
|
# CHECK-EMPTY:
|
|
# CHECK-NEXT: --
|
|
|
|
|
|
# CHECK: UNRESOLVED: shtest-format :: no-test-line.txt
|
|
# CHECK: PASS: shtest-format :: pass.txt
|
|
# CHECK: UNSUPPORTED: shtest-format :: requires-missing.txt
|
|
# CHECK: PASS: shtest-format :: requires-present.txt
|
|
# CHECK: UNRESOLVED: shtest-format :: requires-star.txt
|
|
# CHECK: PASS: shtest-format :: requires-triple.txt
|
|
# CHECK: PASS: shtest-format :: unsupported-expr-false.txt
|
|
# CHECK: UNSUPPORTED: shtest-format :: unsupported-expr-true.txt
|
|
# CHECK: UNRESOLVED: shtest-format :: unsupported-star.txt
|
|
# CHECK: UNSUPPORTED: shtest-format :: unsupported_dir/some-test.txt
|
|
# CHECK: PASS: shtest-format :: xfail-expr-false.txt
|
|
# CHECK: XFAIL: shtest-format :: xfail-expr-true.txt
|
|
# CHECK: XFAIL: shtest-format :: xfail-feature.txt
|
|
# CHECK: XFAIL: shtest-format :: xfail-target.txt
|
|
# CHECK: XFAIL: shtest-format :: xfail.txt
|
|
|
|
# CHECK: XPASS: shtest-format :: xpass.txt
|
|
# CHECK-NEXT: *** TEST 'shtest-format :: xpass.txt' FAILED ***
|
|
# CHECK-NEXT: Exit Code: 0
|
|
# CHECK-EMPTY:
|
|
# CHECK-NEXT: Command Output (stdout):
|
|
# CHECK-NEXT: --
|
|
# CHECK-NEXT: # RUN: at line 1
|
|
# CHECK-NEXT: true
|
|
# CHECK-NEXT: # executed command: true
|
|
# CHECK-EMPTY:
|
|
# CHECK-NEXT: --
|
|
|
|
# CHECK: Failed Tests (4)
|
|
# CHECK: shtest-format :: external_shell/fail.txt
|
|
# CHECK: shtest-format :: external_shell/fail_with_bad_encoding.txt
|
|
# CHECK: shtest-format :: external_shell/fail_with_control_chars.txt
|
|
# CHECK: shtest-format :: fail.txt
|
|
|
|
# CHECK: Unexpectedly Passed Tests (1)
|
|
# CHECK: shtest-format :: xpass.txt
|
|
|
|
# CHECK: Testing Time:
|
|
# CHECK: Unsupported : 3
|
|
# CHECK: Passed : 7
|
|
# CHECK: Expectedly Failed : 4
|
|
# CHECK: Unresolved : 3
|
|
# CHECK: Failed : 4
|
|
# CHECK: Unexpectedly Passed: 1
|
|
|
|
|
|
# XUNIT: <?xml version="1.0" encoding="UTF-8"?>
|
|
# XUNIT-NEXT: <testsuites time="{{[0-9.]+}}">
|
|
# XUNIT-NEXT: <testsuite name="shtest-format" tests="22" failures="8" skipped="3" time="{{[0-9.]+}}">
|
|
|
|
# XUNIT: <testcase classname="shtest-format.external_shell" name="fail.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT: <failure{{[ ]*}}>
|
|
# XUNIT: </failure>
|
|
# XUNIT-NEXT: </testcase>
|
|
|
|
|
|
# XUNIT: <testcase classname="shtest-format.external_shell" name="fail_with_bad_encoding.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT: <failure{{[ ]*}}>
|
|
# XUNIT: </failure>
|
|
# XUNIT-NEXT: </testcase>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.external_shell" name="fail_with_control_chars.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT: <failure><![CDATA[Exit Code: 1
|
|
# XUNIT-EMPTY:
|
|
# XUNIT-NEXT: Command Output (stdout):
|
|
# XUNIT-NEXT: --
|
|
# XUNIT-NEXT: a line with [2;30;41mcontrol characters[0m.
|
|
# XUNIT-EMPTY:
|
|
# XUNIT-NEXT: --
|
|
# XUNIT: ]]></failure>
|
|
# XUNIT-NEXT: </testcase>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.external_shell" name="pass.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="fail.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT: <failure{{[ ]*}}>
|
|
# XUNIT: </failure>
|
|
# XUNIT-NEXT: </testcase>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="no-test-line.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT: <failure{{[ ]*}}>
|
|
# XUNIT: </failure>
|
|
# XUNIT-NEXT: </testcase>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="pass.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="requires-missing.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT:<skipped message="Missing required feature(s): a-missing-feature"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="requires-present.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="requires-star.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT: <failure{{[ ]*}}>
|
|
# XUNIT: </failure>
|
|
# XUNIT-NEXT: </testcase>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="requires-triple.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="unsupported-expr-false.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="unsupported-expr-true.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT:<skipped message="Unsupported configuration"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="unsupported-star.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT: <failure{{[ ]*}}>
|
|
# XUNIT: </failure>
|
|
# XUNIT-NEXT: </testcase>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.unsupported_dir" name="some-test.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT:<skipped message="Unsupported configuration"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="xfail-expr-false.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="xfail-expr-true.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="xfail-feature.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="xfail-target.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="xfail.txt" time="{{[0-9]+\.[0-9]+}}"/>
|
|
|
|
# XUNIT: <testcase classname="shtest-format.shtest-format" name="xpass.txt" time="{{[0-9]+\.[0-9]+}}">
|
|
# XUNIT-NEXT: <failure{{[ ]*}}>
|
|
# XUNIT: </failure>
|
|
# XUNIT-NEXT: </testcase>
|
|
|
|
# XUNIT: </testsuite>
|
|
# XUNIT-NEXT: </testsuites>
|