derek.holloway
7502bf64a4
CodeQL / Analyze (actions) (push) Canceled after 0s
CodeQL / Analyze (python) (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Multi-Arch CI / setup (push) Canceled after 0s
Publish build_manylinux_x86_64 images / publish_build_manylinux_x86_64 (push) Canceled after 0s
Setup (Multi-Arch) / setup (push) Canceled after 0s
Multi-Arch CI / Linux::${{ fromJSON(needs.setup.outputs.linux_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubi10 image / publish_no_rocm_image_ubi10 (push) Canceled after 0s
Multi-Arch CI / Windows::${{ fromJSON(needs.setup.outputs.windows_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Multi-Arch CI / Manifest Diff (push) Canceled after 0s
TheRock Manifest Diff Report / Generate Manifest Diff Report (push) Canceled after 0s
Multi-Arch CI / CI Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_ocl_rt images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_rocgdb images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Unit Tests / Unit Tests :: ubuntu-24.04 (push) Canceled after 0s
Unit Tests / Unit Tests :: windows-2022 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_media (push) Canceled after 0s
Unit Tests / Unit Tests Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_openmpi (push) Canceled after 0s
285 lines
9.9 KiB
MLIR
285 lines
9.9 KiB
MLIR
// RUN: mlir-opt %s -split-input-file -verify-diagnostics
|
|
|
|
// -----
|
|
// Invalid type.
|
|
// expected-error@+1 {{unknown quantized type foobar}}
|
|
!qalias = !quant.foobar
|
|
|
|
// -----
|
|
// Unrecognized token: illegal token
|
|
// expected-error@+1 {{unknown quantized type __}}
|
|
!qalias = !quant.__
|
|
|
|
// -----
|
|
// Unrecognized token: trailing
|
|
// expected-error@+1 {{expected '>'}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f32, 0.99872:127 23>
|
|
|
|
// -----
|
|
// Unrecognized token: missing storage type maximum
|
|
// expected-error@+1 {{expected ':'}}
|
|
!qalias = !quant.uniform<i8<16>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Unrecognized token: missing closing angle bracket
|
|
// expected-error@+1 {{unbalanced '<' character in pretty dialect name}}
|
|
!qalias = !quant<uniform<i8<-4:3:f32, 0.99872:127>>
|
|
|
|
// -----
|
|
// Unrecognized token: missing type colon
|
|
// expected-error@+1 {{expected ':'}}
|
|
!qalias = !quant.uniform<i8<-4:3>f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Unrecognized token: missing comma
|
|
// expected-error@+1 {{expected ','}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f32 0.99872:127>
|
|
|
|
// -----
|
|
// Unrecognized storage type: illegal prefix
|
|
// expected-error@+1 {{illegal storage type prefix}}
|
|
!qalias = !quant.uniform<int8<-4:3>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Unrecognized storage type: no width
|
|
// expected-error@+1 {{illegal storage type prefix}}
|
|
!qalias = !quant.uniform<i<-4:3>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Unrecognized storage type: storage size > 32
|
|
// expected-error@+1 {{illegal storage type size: 33}}
|
|
!qalias = !quant.uniform<i33:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Unrecognized storage type: storage size < 0
|
|
// expected-error@+1 {{illegal storage type prefix}}
|
|
!qalias = !quant.uniform<i-1<-4:3>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Unrecognized storage type: storage size
|
|
// expected-error@+1 {{invalid integer width}}
|
|
!qalias = !quant.uniform<i123123123120<-4:3>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal storage min/max: max - min < 0
|
|
// expected-error@+1 {{illegal storage min and storage max: (2:1)}}
|
|
!qalias = !quant.uniform<i8<2:1>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal storage min/max: max - min == 0
|
|
// expected-error@+1 {{illegal storage min and storage max: (1:1)}}
|
|
!qalias = !quant.uniform<i8<1:1>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal storage min/max: max > defaultMax
|
|
// expected-error@+1 {{illegal storage type maximum: 9}}
|
|
!qalias = !quant.uniform<i4<-1:9>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal storage min/max: min < defaultMin
|
|
// expected-error@+1 {{illegal storage type minimum: -9}}
|
|
!qalias = !quant.uniform<i4<-9:1>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal uniform params: invalid scale
|
|
// expected-error@+1 {{expected floating point literal}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f32, abc:127>
|
|
|
|
// -----
|
|
// Illegal uniform params: invalid zero point separator
|
|
// expected-error@+1 {{expected '>'}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f32, 0.1abc>
|
|
|
|
// -----
|
|
// Illegal uniform params: missing zero point
|
|
// expected-error@+1 {{expected integer value}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f32, 0.1:>
|
|
|
|
// -----
|
|
// Illegal uniform params: invalid zero point
|
|
// expected-error@+1 {{expected integer value}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f32, 0.1:abc>
|
|
|
|
// -----
|
|
// Illegal expressed type: f33
|
|
// expected-error@+1 {{expected non-function type}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f33, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal scale: negative
|
|
// expected-error@+1 {{scale -1.000000e+00 out of expressed type range}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f32, -1.0:127>
|
|
|
|
// -----
|
|
// Illegal uniform params: missing quantized dimension
|
|
// expected-error@+1 {{expected integer value}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f32:, {2.000000e+02:-19.987200e-01:1}>
|
|
|
|
// -----
|
|
// Illegal uniform params: unspecified quantized dimension, when multiple scales
|
|
// provided.
|
|
// expected-error@+1 {{expected floating point literal}}
|
|
!qalias = !quant.uniform<i8<-4:3>:f32, {2.000000e+02,-19.987200e-01:1}>
|
|
|
|
// -----
|
|
// Illegal negative axis in per-axis quantization
|
|
// expected-error@+1 {{illegal quantized dimension: -1}}
|
|
!qalias = !quant.uniform<i8:f32:-1, {2.0,3.0:1}>
|
|
|
|
// -----
|
|
// Scale f16 underflow
|
|
// expected-error@+1 {{scale 5.800000e-08 out of expressed type range}}
|
|
!qalias = !quant.uniform<i8:f16, 5.8e-8>
|
|
|
|
// -----
|
|
// Scale f16 overflow
|
|
// expected-error@+1 {{scale 6.600000e+04 out of expressed type range}}
|
|
!qalias = !quant.uniform<i8:f16, 6.6e4>
|
|
|
|
// -----
|
|
// Scale f16 underflow in per-axis quantization
|
|
// expected-error@+1 {{scale 5.800000e-08 out of expressed type range}}
|
|
!qalias = !quant.uniform<i8:f16:1, {2.0,5.8e-8}>
|
|
|
|
// -----
|
|
// Scale f16 overflow in per-axis quantization
|
|
// expected-error@+1 {{scale 6.600000e+04 out of expressed type range}}
|
|
!qalias = !quant.uniform<i8:f16:1, {2.0,6.6e4}>
|
|
|
|
// -----
|
|
// Illegal negative axis in sub-channel quantization
|
|
// expected-error@+1 {{illegal quantized dimension: -1}}
|
|
!qalias = !quant.uniform<u8:f32:{0:1,-1:2},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Illegal zero block-size in sub-channel quantization
|
|
// expected-error@+1 {{illegal block size: 0}}
|
|
!qalias = !quant.uniform<u8:f32:{0:0,1:2},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Illegal negative block-size in sub-channel quantization
|
|
// expected-error@+1 {{illegal block size: -1}}
|
|
!qalias = !quant.uniform<u8:f32:{0:-1,1:2},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Missing block size in sub-channel quantization
|
|
// expected-error@+1 {{expected ':'}}
|
|
!qalias = !quant.uniform<u8:f32:{0,1:2},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Missing quantization dimension in sub-channel quantization
|
|
// expected-error@+1 {{expected integer value}}
|
|
!qalias = !quant.uniform<u8:f32:{:1,1:2},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Invalid tensor literal structure in sub-channel quantization
|
|
// expected-error@+2 {{expected '>'}}
|
|
!qalias = !quant.uniform<u8:f32:{0:1,1:2},
|
|
{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}>
|
|
|
|
// -----
|
|
// Ragged tensor literal in sub-channel quantization
|
|
// expected-error@+2 {{ranks are not consistent between elements}}
|
|
!qalias = !quant.uniform<u8:f32:{0:1,1:2},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02}}>
|
|
|
|
// -----
|
|
// Missing braces around block-size information in sub-channel quantization
|
|
// expected-error@+1 {{expected ','}}
|
|
!qalias = !quant.uniform<u8:f32:0:1,1:2,
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Missing right-brace around block-size information in sub-channel quantization
|
|
// expected-error@+1 {{unbalanced '{' character}}
|
|
!qalias = !quant.uniform<u8:f32:{0:1,1:2,
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Missing left-brace around block-size information in sub-channel quantization
|
|
// expected-error@+1 {{unbalanced '<' character}}
|
|
!qalias = !quant.uniform<u8:f32:0:1,1:2},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Missing Axis:BlockSize pair
|
|
// expected-error@+1 {{expected integer value}}
|
|
!qalias = !quant.uniform<u8:f32:{0:1,},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Missing Scale:ZeroPoint pair
|
|
// expected-error@+2 {{expected floating point literal}}
|
|
!qalias = !quant.uniform<u8:f32:{0:1,1:2},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,}}>
|
|
|
|
// -----
|
|
// Missing ZeroPoint in Scale:ZeroPoint pair
|
|
// expected-error@+2 {{expected integer value}}
|
|
!qalias = !quant.uniform<u8:f32:{0:1,1:2},
|
|
{{2.000000e+02:120,9.987200e-01:127}, {2.000000e+02,9.987200e-01:}}>
|
|
|
|
// -----
|
|
// Empty quantization paramaters in sub-channel quantization
|
|
// expected-error@+1 {{expected floating point literal}}
|
|
!qalias = !quant.uniform<u8:f32:{0:1, 1:2}, {}>
|
|
|
|
// -----
|
|
// Scale out of expressed type range in sub-channel quantization
|
|
// expected-error@+2 {{scale 6.600000e+04 out of expressed type range}}
|
|
!qalias = !quant.uniform<i8:f16:{0:1,1:2},
|
|
{{6.6e4:120,9.987200e-01:127}, {2.000000e+02:256,9.987200e-01}}>
|
|
|
|
// -----
|
|
// Illegal storage min/max: max > defaultMax
|
|
// expected-error@+1 {{illegal storage type maximum: 60000}}
|
|
!qalias = !quant.uniform<f8E5M2<-57344:60000>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal storage min/max: min < defaultMin
|
|
// expected-error@+1 {{illegal storage type minimum: -60000}}
|
|
!qalias = !quant.uniform<f8E5M2<-60000:57344>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal storage min/max: max > defaultMax
|
|
// expected-error@+1 {{illegal storage type maximum: 500}}
|
|
!qalias = !quant.uniform<f8E4M3FN<-448:500>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal storage min/max: min < defaultMin
|
|
// expected-error@+1 {{illegal storage type minimum: -500}}
|
|
!qalias = !quant.uniform<f8E4M3FN<-500:448>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal storage min/max: max > defaultMax
|
|
// expected-error@+1 {{illegal storage type maximum: 10}}
|
|
!qalias = !quant.uniform<f4E2M1FN<-6:10>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
// Illegal storage min/max: min < defaultMin
|
|
// expected-error@+1 {{illegal storage type minimum: -10}}
|
|
!qalias = !quant.uniform<f4E2M1FN<-10:6>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
|
|
// Invalid LUT size: 16 values but explicit range 6:10 has only 5 representable values.
|
|
// expected-error@+1 {{quantile LUT size (16) must equal the number of representable storage values (5)}}
|
|
!qalias = !quant.uniform<!quant.quantile<f4E2M1FN:f16, {-1.0000,-0.8667,-0.7333,-0.6000,-0.4667,-0.3333,-0.2000,-0.0667,0.0667,0.2000,0.3333,0.4667,0.6000,0.7333,0.8667,1.0000}, <6:10>>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
|
|
// Quantile storage range: min must be strictly less than max.
|
|
// expected-error@+1 {{storage min must be less than storage max}}
|
|
!qalias = !quant.uniform<!quant.quantile<f4E2M1FN:f16,{-1.0000,-0.8667,-0.7333,-0.6000,-0.4667,-0.3333,-0.2000,-0.0667,0.0667,0.2000,0.3333,0.4667,0.6000,0.7333,0.8667,1.0000}, <5:3>>:f32, 0.99872:127>
|
|
|
|
// -----
|
|
|
|
// Quantile LUT size (3) does not match the 16 representable values of f4E2M1FN's default range.
|
|
// expected-error@+1 {{quantile LUT size (3) must equal the number of representable storage values (16)}}
|
|
!qalias = !quant.uniform<!quant.quantile<f4E2M1FN:f16, {-1.0,0.0,1.0}>:f32, 0.99872:127>
|