derek.holloway
7502bf64a4
CodeQL / Analyze (actions) (push) Canceled after 0s
CodeQL / Analyze (python) (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Multi-Arch CI / setup (push) Canceled after 0s
Publish build_manylinux_x86_64 images / publish_build_manylinux_x86_64 (push) Canceled after 0s
Setup (Multi-Arch) / setup (push) Canceled after 0s
Multi-Arch CI / Linux::${{ fromJSON(needs.setup.outputs.linux_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubi10 image / publish_no_rocm_image_ubi10 (push) Canceled after 0s
Multi-Arch CI / Windows::${{ fromJSON(needs.setup.outputs.windows_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Multi-Arch CI / Manifest Diff (push) Canceled after 0s
TheRock Manifest Diff Report / Generate Manifest Diff Report (push) Canceled after 0s
Multi-Arch CI / CI Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_ocl_rt images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_rocgdb images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Unit Tests / Unit Tests :: ubuntu-24.04 (push) Canceled after 0s
Unit Tests / Unit Tests :: windows-2022 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_media (push) Canceled after 0s
Unit Tests / Unit Tests Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_openmpi (push) Canceled after 0s
25 lines
1.3 KiB
ReStructuredText
25 lines
1.3 KiB
ReStructuredText
.. meta::
|
|
:description: An introduction to the hipBLASLt library that provides GEMM operations with flexible APIs and extends functionalities beyond the traditional BLAS library
|
|
:keywords: hipBLASLt, ROCm, library, API, tool
|
|
|
|
.. _what-is-hipblaslt:
|
|
|
|
What is hipBLASLt?
|
|
====================
|
|
|
|
hipBLASLt is a library that provides GEMM operations with flexible APIs and extends functionality beyond the traditional BLAS library.
|
|
hipBLASLt provides APIs in the :doc:`HIP programming language<hip:index>` with an underlying optimized generator as a backend kernel provider.
|
|
|
|
The library adds flexibility for matrix data layouts, input types, and compute types and
|
|
for choosing the algorithmic implementations and heuristics through parameter programmability.
|
|
After identifying a set of options for the intended GEMM operations, you can repeatedly use these options for different inputs.
|
|
|
|
The GEMM operation of hipBLASLt is performed by :ref:`hipblasltmatmul` using this equation:
|
|
|
|
.. math::
|
|
|
|
D = Activation(alpha \cdot op(A) \cdot op(B) + beta \cdot op(C) + bias)
|
|
|
|
where :math:`op(A)/op(B)` refers to in-place operations such as transpose/non-transpose and :math:`alpha` and :math:`beta` are the scalars.
|
|
The :math:`Activation` function supports Gelu, Relu, Swish (SiLU), and Clamp. The :math:`Bias` vector matches matrix :math:`D` rows and broadcasts to all :math:`D` columns.
|