derek.holloway
7502bf64a4
CodeQL / Analyze (actions) (push) Canceled after 0s
CodeQL / Analyze (python) (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Multi-Arch CI / setup (push) Canceled after 0s
Publish build_manylinux_x86_64 images / publish_build_manylinux_x86_64 (push) Canceled after 0s
Setup (Multi-Arch) / setup (push) Canceled after 0s
Multi-Arch CI / Linux::${{ fromJSON(needs.setup.outputs.linux_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubi10 image / publish_no_rocm_image_ubi10 (push) Canceled after 0s
Multi-Arch CI / Windows::${{ fromJSON(needs.setup.outputs.windows_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Multi-Arch CI / Manifest Diff (push) Canceled after 0s
TheRock Manifest Diff Report / Generate Manifest Diff Report (push) Canceled after 0s
Multi-Arch CI / CI Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_ocl_rt images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_rocgdb images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Unit Tests / Unit Tests :: ubuntu-24.04 (push) Canceled after 0s
Unit Tests / Unit Tests :: windows-2022 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_media (push) Canceled after 0s
Unit Tests / Unit Tests Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_openmpi (push) Canceled after 0s
163 lines
6.3 KiB
YAML
163 lines
6.3 KiB
YAML
# REQUIRES: aarch64-registered-target
|
||
# REQUIRES: asserts
|
||
|
||
# RUN: llc -o /dev/null %s -mtriple=aarch64 -mattr=+fuse-address \
|
||
# RUN: -run-pass machine-scheduler -debug-only=machine-scheduler 2>&1 \
|
||
# RUN: | FileCheck %s
|
||
# RUN: llc -o /dev/null %s -mtriple=aarch64-apple-macos -mcpu=apple-m5 \
|
||
# RUN: -run-pass machine-scheduler -debug-only=machine-scheduler 2>&1 \
|
||
# RUN: | FileCheck %s
|
||
|
||
#------------------------------------------------------------------------------
|
||
# Test macro fusion conflicts with other macro fusions and with ld/st clustering.
|
||
#
|
||
# Conflict matrix (conflict-source × which-SU-is-clustered):
|
||
#
|
||
# | first-clustered | second-clustered | both-clustered
|
||
# -----------------+-----------------+------------------+----------------
|
||
# fusion-fusion | TEST | (a) | (a)
|
||
# load-fusion | (b) | TEST | TEST
|
||
# store-fusion | (b) | TEST | TEST
|
||
#
|
||
# Unconstructible cases:
|
||
# (a) fusion-fusion second/both-clustered: the anchor (SecondSU) is visited
|
||
# exactly once in the fusion loop. It can only be pre-clustered by ld/st
|
||
# clustering (a different mutation), never by a prior fusion iteration.
|
||
# both-clustered requires SecondSU to be fusion-clustered, same issue.
|
||
# (b) load/store-fusion first-clustered: ADRP is not a load/store, so it
|
||
# cannot be ld/st clustered. The only way ADRP gets clustered is via a
|
||
# prior fusion, making it identical to fusion-fusion first-clustered.
|
||
# There are currently no other fusions with loads/stores on AArch64.
|
||
#------------------------------------------------------------------------------
|
||
|
||
#------------------------------------------------------------------------------
|
||
# Fusion-fusion conflicts
|
||
#------------------------------------------------------------------------------
|
||
|
||
# Fusion-fusion, first-clustered: ADRP fans out to two loads at non-adjacent
|
||
# offsets (so they are NOT clustered by LoadClusterDAGMutation). Both ADRP→LDR
|
||
# pairs are valid address fusion pairs. SU(0)→SU(1) fuses first; when
|
||
# SU(0)→SU(2) is attempted, SU(0) is already clustered.
|
||
---
|
||
name: fusion-fusion-first-clustered
|
||
tracksRegLiveness: true
|
||
body: |
|
||
bb.0:
|
||
; CHECK-LABEL: fusion-fusion-first-clustered
|
||
; CHECK: Macro fuse: SU(0) - SU(1) / ADRP - LDRXui
|
||
; CHECK: Fusion conflict: cannot fuse SU(0) and SU(2)
|
||
; CHECK-NEXT: SU(0) already clustered
|
||
; CHECK: SU(0): $x0 = ADRP 0
|
||
; CHECK: SU(1): $x1 = LDRXui $x0, 5 :: (load (s64))
|
||
; CHECK: SU(2): $x2 = LDRXui $x0, 10 :: (load (s64))
|
||
$x0 = ADRP 0
|
||
$x1 = LDRXui $x0, 5 :: (load (s64))
|
||
$x2 = LDRXui $x0, 10 :: (load (s64))
|
||
RET_ReallyLR
|
||
...
|
||
|
||
#------------------------------------------------------------------------------
|
||
# Load-fusion conflicts
|
||
#------------------------------------------------------------------------------
|
||
|
||
# Load-fusion, second-clustered: two adjacent loads get clustered by
|
||
# LoadClusterDAGMutation. Then address fusion (ADRP + LDRXui) is attempted
|
||
# but the load SUnit is already clustered.
|
||
---
|
||
name: load-fusion-second-clustered
|
||
tracksRegLiveness: true
|
||
body: |
|
||
bb.0:
|
||
; CHECK-LABEL: load-fusion-second-clustered
|
||
; CHECK: Cluster ld/st SU(1) - SU(2)
|
||
; CHECK: Fusion conflict: cannot fuse SU(0) and SU(1)
|
||
; CHECK-NEXT: SU(1) already clustered
|
||
; CHECK: SU(0): $x0 = ADRP 0
|
||
; CHECK: SU(1): $x1 = LDRXui $x0, 0 :: (load (s64))
|
||
; CHECK: SU(2): $x2 = LDRXui $x0, 1 :: (load (s64))
|
||
$x0 = ADRP 0
|
||
$x1 = LDRXui $x0, 0 :: (load (s64))
|
||
$x2 = LDRXui $x0, 1 :: (load (s64))
|
||
RET_ReallyLR
|
||
...
|
||
|
||
# Load-fusion, both-clustered: LDR2 and LDR3 get ld/st clustered (adjacent
|
||
# offsets), then ADRP fuses with LDR1 (non-adjacent offset). When fusion tries
|
||
# ADRP + LDR2, both are already clustered.
|
||
---
|
||
name: load-fusion-both-clustered
|
||
tracksRegLiveness: true
|
||
body: |
|
||
bb.0:
|
||
; CHECK-LABEL: load-fusion-both-clustered
|
||
; CHECK: Cluster ld/st SU(2) - SU(3)
|
||
; CHECK: Macro fuse: SU(0) - SU(1) / ADRP - LDRXui
|
||
; CHECK: Fusion conflict: cannot fuse SU(0) and SU(2)
|
||
; CHECK-NEXT: SU(0) already clustered
|
||
; CHECK-NEXT: SU(2) already clustered
|
||
; CHECK: SU(0): $x0 = ADRP 0
|
||
; CHECK: SU(1): $x1 = LDRXui $x0, 5 :: (load (s64))
|
||
; CHECK: SU(2): $x2 = LDRXui $x0, 0 :: (load (s64))
|
||
; CHECK: SU(3): $x3 = LDRXui $x0, 1 :: (load (s64))
|
||
$x0 = ADRP 0
|
||
$x1 = LDRXui $x0, 5 :: (load (s64))
|
||
$x2 = LDRXui $x0, 0 :: (load (s64))
|
||
$x3 = LDRXui $x0, 1 :: (load (s64))
|
||
RET_ReallyLR
|
||
...
|
||
|
||
#------------------------------------------------------------------------------
|
||
# Store-fusion conflicts
|
||
#------------------------------------------------------------------------------
|
||
|
||
# Store-fusion, second-clustered: two adjacent stores get clustered by
|
||
# StoreClusterDAGMutation (runs before AArch64 macro fusion). Then address
|
||
# fusion (ADRP + STRXui) is attempted but the store SUnit is already
|
||
# clustered.
|
||
---
|
||
name: store-fusion-second-clustered
|
||
tracksRegLiveness: true
|
||
body: |
|
||
bb.0:
|
||
liveins: $x0
|
||
|
||
; CHECK-LABEL: store-fusion-second-clustered
|
||
; CHECK: Cluster ld/st SU(1) - SU(2)
|
||
; CHECK: Fusion conflict: cannot fuse SU(0) and SU(1)
|
||
; CHECK-NEXT: SU(1) already clustered
|
||
; CHECK: SU(0): $x1 = ADRP 0
|
||
; CHECK: SU(1): STRXui $x0, $x1, 0 :: (store (s64))
|
||
; CHECK: SU(2): STRXui $x0, $x1, 1 :: (store (s64))
|
||
$x1 = ADRP 0
|
||
STRXui $x0, $x1, 0 :: (store (s64))
|
||
STRXui $x0, $x1, 1 :: (store (s64))
|
||
RET_ReallyLR
|
||
...
|
||
|
||
# Store-fusion, both-clustered: STR2 and STR3 get ld/st clustered (adjacent
|
||
# offsets), then ADRP fuses with STR1 (non-adjacent offset). When fusion tries
|
||
# ADRP + STR2, both are already clustered.
|
||
---
|
||
name: store-fusion-both-clustered
|
||
tracksRegLiveness: true
|
||
body: |
|
||
bb.0:
|
||
liveins: $x0
|
||
|
||
; CHECK-LABEL: store-fusion-both-clustered
|
||
; CHECK: Cluster ld/st SU(2) - SU(3)
|
||
; CHECK: Macro fuse: SU(0) - SU(1) / ADRP - STRXui
|
||
; CHECK: Fusion conflict: cannot fuse SU(0) and SU(2)
|
||
; CHECK-NEXT: SU(0) already clustered
|
||
; CHECK-NEXT: SU(2) already clustered
|
||
; CHECK: SU(0): $x1 = ADRP 0
|
||
; CHECK: SU(1): STRXui $x0, $x1, 5 :: (store (s64))
|
||
; CHECK: SU(2): STRXui $x0, $x1, 0 :: (store (s64))
|
||
; CHECK: SU(3): STRXui $x0, $x1, 1 :: (store (s64))
|
||
$x1 = ADRP 0
|
||
STRXui $x0, $x1, 5 :: (store (s64))
|
||
STRXui $x0, $x1, 0 :: (store (s64))
|
||
STRXui $x0, $x1, 1 :: (store (s64))
|
||
RET_ReallyLR
|
||
...
|