CodeQL / Analyze (actions) (push) Canceled after 0s
CodeQL / Analyze (python) (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Multi-Arch CI / setup (push) Canceled after 0s
Publish build_manylinux_x86_64 images / publish_build_manylinux_x86_64 (push) Canceled after 0s
Setup (Multi-Arch) / setup (push) Canceled after 0s
Multi-Arch CI / Linux::${{ fromJSON(needs.setup.outputs.linux_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubi10 image / publish_no_rocm_image_ubi10 (push) Canceled after 0s
Multi-Arch CI / Windows::${{ fromJSON(needs.setup.outputs.windows_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Multi-Arch CI / Manifest Diff (push) Canceled after 0s
TheRock Manifest Diff Report / Generate Manifest Diff Report (push) Canceled after 0s
Multi-Arch CI / CI Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_ocl_rt images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_rocgdb images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Unit Tests / Unit Tests :: ubuntu-24.04 (push) Canceled after 0s
Unit Tests / Unit Tests :: windows-2022 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_media (push) Canceled after 0s
Unit Tests / Unit Tests Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_openmpi (push) Canceled after 0s
155 lines
4.7 KiB
Python
155 lines
4.7 KiB
Python
"""
|
|
Generic kpack transformation API.
|
|
|
|
This module provides format-agnostic versions of the kpack transformation
|
|
functions. They automatically detect whether the input binary is ELF or
|
|
PE/COFF and dispatch to the appropriate implementation.
|
|
|
|
Usage:
|
|
from rocm_kpack import kpack_offload_binary, read_kpack_ref_marker
|
|
|
|
# Works with both ELF and PE/COFF binaries
|
|
result = kpack_offload_binary(input_path, output_path, ...)
|
|
marker = read_kpack_ref_marker(binary_path)
|
|
"""
|
|
|
|
from pathlib import Path
|
|
|
|
from .format_detect import detect_binary_format, UnsupportedBinaryFormat
|
|
|
|
|
|
class NotFatBinaryError(ValueError):
|
|
"""Raised when kpack_offload_binary is called on a binary without device code.
|
|
|
|
This is not necessarily an error condition - callers should catch this
|
|
and skip processing for non-fat binaries.
|
|
"""
|
|
|
|
pass
|
|
|
|
|
|
def kpack_offload_binary(
|
|
input_path: Path,
|
|
output_path: Path,
|
|
kpack_search_paths: list[str] | None = None,
|
|
kernel_name: str | None = None,
|
|
verbose: bool = False,
|
|
) -> dict:
|
|
"""Transform a fat binary for kpack use (format auto-detected).
|
|
|
|
This function automatically detects whether the input binary is ELF or
|
|
PE/COFF format and delegates to the appropriate implementation.
|
|
|
|
The transformation:
|
|
1. Adds kpack marker section (if params provided)
|
|
2. Updates wrapper pointers to point to marker section
|
|
3. Rewrites HIPF->HIPK magic
|
|
4. Zero-pages the fat binary section
|
|
|
|
Args:
|
|
input_path: Path to input binary
|
|
output_path: Path for output binary
|
|
kpack_search_paths: List of kpack file paths relative to binary.
|
|
If None, assumes marker section already exists.
|
|
kernel_name: Kernel identifier for TOC lookup.
|
|
Required if kpack_search_paths is provided.
|
|
verbose: Print progress information
|
|
|
|
Returns:
|
|
Dictionary with transformation results:
|
|
- format: "elf" or "coff"
|
|
- wrappers_found: Number of wrappers found and rewritten
|
|
- bytes_zeroed: Number of bytes zeroed in fat binary section
|
|
- original_size: Original file size
|
|
- new_size: New file size
|
|
|
|
Raises:
|
|
NotFatBinaryError: If binary doesn't contain device code
|
|
UnsupportedBinaryFormat: If binary is neither ELF nor PE/COFF
|
|
"""
|
|
fmt = detect_binary_format(input_path)
|
|
|
|
if fmt == "elf":
|
|
from .elf.kpack_transform import kpack_offload_binary as elf_impl
|
|
|
|
result = elf_impl(
|
|
input_path,
|
|
output_path,
|
|
kpack_search_paths,
|
|
kernel_name,
|
|
verbose,
|
|
)
|
|
result["format"] = "elf"
|
|
return result
|
|
else:
|
|
from .coff.kpack_transform import kpack_offload_binary as coff_impl
|
|
|
|
result = coff_impl(
|
|
input_path,
|
|
output_path,
|
|
kpack_search_paths,
|
|
kernel_name,
|
|
verbose,
|
|
)
|
|
result["format"] = "coff"
|
|
return result
|
|
|
|
|
|
def read_kpack_ref_marker(binary_path: Path) -> dict | None:
|
|
"""Read kpack marker section from a binary (format auto-detected).
|
|
|
|
This function automatically detects whether the binary is ELF or PE/COFF
|
|
format and reads the marker section using the appropriate implementation.
|
|
|
|
Args:
|
|
binary_path: Path to binary with marker section
|
|
|
|
Returns:
|
|
Marker data dictionary with keys:
|
|
- kpack_search_paths: list[str] of relative paths to kpack files
|
|
- kernel_name: str kernel identifier for TOC lookup
|
|
Returns None if section doesn't exist.
|
|
|
|
Raises:
|
|
RuntimeError: If section exists but cannot be read or parsed
|
|
UnsupportedBinaryFormat: If binary is neither ELF nor PE/COFF
|
|
"""
|
|
fmt = detect_binary_format(binary_path)
|
|
|
|
if fmt == "elf":
|
|
from .elf.kpack_transform import read_kpack_ref_marker as elf_impl
|
|
|
|
return elf_impl(binary_path)
|
|
else:
|
|
from .coff.kpack_transform import read_kpack_ref_marker as coff_impl
|
|
|
|
return coff_impl(binary_path)
|
|
|
|
|
|
def is_fat_binary(binary_path: Path) -> bool:
|
|
"""Check if a binary contains HIP fat binary sections.
|
|
|
|
Fast-path: reads only headers (ELF section header table or PE section
|
|
headers), not the full binary. Works for both ELF and PE/COFF.
|
|
|
|
Args:
|
|
binary_path: Path to binary
|
|
|
|
Returns:
|
|
True if binary contains a .hip_fatbin (ELF) or .hip_fat (COFF)
|
|
section, False otherwise (including non-ELF/non-PE files).
|
|
"""
|
|
try:
|
|
fmt = detect_binary_format(binary_path)
|
|
except UnsupportedBinaryFormat:
|
|
return False
|
|
|
|
if fmt == "elf":
|
|
from .elf.surgery import ElfSurgery
|
|
|
|
return ElfSurgery.has_fatbin_section(binary_path)
|
|
else:
|
|
from .coff.surgery import CoffSurgery
|
|
|
|
return CoffSurgery.has_fatbin_section(binary_path)
|