derek.holloway
7502bf64a4
CodeQL / Analyze (actions) (push) Canceled after 0s
CodeQL / Analyze (python) (push) Canceled after 0s
pre-commit / pre-commit (push) Canceled after 0s
Multi-Arch CI / setup (push) Canceled after 0s
Publish build_manylinux_x86_64 images / publish_build_manylinux_x86_64 (push) Canceled after 0s
Setup (Multi-Arch) / setup (push) Canceled after 0s
Multi-Arch CI / Linux::${{ fromJSON(needs.setup.outputs.linux_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubi10 image / publish_no_rocm_image_ubi10 (push) Canceled after 0s
Multi-Arch CI / Windows::${{ fromJSON(needs.setup.outputs.windows_build_config || '{}').build_variant_label || 'skip' }} (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Multi-Arch CI / Manifest Diff (push) Canceled after 0s
TheRock Manifest Diff Report / Generate Manifest Diff Report (push) Canceled after 0s
Multi-Arch CI / CI Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_ocl_rt images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04_rocgdb images / publish_no_rocm_image_ubuntu24_04_rocgdb (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_ocl_rt (push) Canceled after 0s
Publish TheRock Docker image / build-and-push-image (push) Canceled after 0s
Unit Tests / Unit Tests :: ubuntu-24.04 (push) Canceled after 0s
Unit Tests / Unit Tests :: windows-2022 (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_media (push) Canceled after 0s
Unit Tests / Unit Tests Summary (push) Canceled after 0s
Publish no_rocm_image_ubuntu24_04 images / publish_no_rocm_image_ubuntu24_04_openmpi (push) Canceled after 0s
88 lines
3.1 KiB
C
88 lines
3.1 KiB
C
/*
|
|
* Copyright 2021-2022 NVIDIA Corporation
|
|
*
|
|
* Licensed under the Apache License, Version 2.0 (the "License");
|
|
* you may not use this file except in compliance with the License.
|
|
* You may obtain a copy of the License at
|
|
*
|
|
* http://www.apache.org/licenses/LICENSE-2.0
|
|
*
|
|
* Unless required by applicable law or agreed to in writing, software
|
|
* distributed under the License is distributed on an "AS IS" BASIS,
|
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
* See the License for the specific language governing permissions and
|
|
* limitations under the License.
|
|
*/
|
|
|
|
/**
|
|
* \file
|
|
* Utilities for CUDA dynamic parallelism.
|
|
*/
|
|
|
|
#pragma once
|
|
|
|
#include <cub/config.cuh>
|
|
|
|
#include <cub/detail/detect_cuda_runtime.cuh>
|
|
|
|
#include <nv/target>
|
|
|
|
/**
|
|
* \def THRUST_CDP_DISPATCH
|
|
*
|
|
* If CUDA Dynamic Parallelism / CUDA Nested Parallelism is available, always
|
|
* run the parallel implementation. Otherwise, run the parallel implementation
|
|
* when called from the host, and fallback to the sequential implementation on
|
|
* the device.
|
|
*
|
|
* `par_impl` and `seq_impl` are blocks of C++ statements enclosed in
|
|
* parentheses, similar to NV_IF_TARGET blocks:
|
|
*
|
|
* \code
|
|
* THRUST_CDP_DISPATCH((launch_parallel_kernel();), (run_serial_impl();));
|
|
* \endcode
|
|
*/
|
|
|
|
#if defined(CUB_DETAIL_CDPv1)
|
|
|
|
// Special case for NVCC -- need to inform the device path about the kernels
|
|
// that are launched from the host path.
|
|
# if defined(__CUDACC__) && defined(__CUDA_ARCH__)
|
|
|
|
// seq_impl only used on platforms that do not support device synchronization.
|
|
# define THRUST_CDP_DISPATCH(par_impl, seq_impl) \
|
|
if (false) \
|
|
{ /* Without this, the device pass won't compile any kernels. */ \
|
|
NV_IF_TARGET(NV_ANY_TARGET, par_impl); \
|
|
} \
|
|
NV_IF_TARGET(NV_PROVIDES_SM_90, seq_impl, par_impl)
|
|
|
|
# else // NVCC device pass
|
|
|
|
// seq_impl only used on platforms that do not support device synchronization.
|
|
# define THRUST_CDP_DISPATCH(par_impl, seq_impl) NV_IF_TARGET(NV_PROVIDES_SM_90, seq_impl, par_impl)
|
|
|
|
# endif // NVCC device pass
|
|
|
|
#else // CDPv1 unavailable. Always fallback to serial on device:
|
|
|
|
// Special case for NVCC -- need to inform the device path about the kernels
|
|
// that are launched from the host path.
|
|
# if defined(__CUDACC__) && defined(__CUDA_ARCH__)
|
|
|
|
// Device-side launch not supported, fallback to sequential in device code.
|
|
# define THRUST_CDP_DISPATCH(par_impl, seq_impl) \
|
|
if (false) \
|
|
{ /* Without this, the device pass won't compile any kernels. */ \
|
|
NV_IF_TARGET(NV_ANY_TARGET, par_impl); \
|
|
} \
|
|
NV_IF_TARGET(NV_IS_HOST, par_impl, seq_impl)
|
|
|
|
# else // !(NVCC device pass):
|
|
|
|
# define THRUST_CDP_DISPATCH(par_impl, seq_impl) NV_IF_TARGET(NV_IS_HOST, par_impl, seq_impl)
|
|
|
|
# endif // NVCC device pass
|
|
|
|
#endif // CDP version
|