Description
Runs ONNX machine-learning models with CUDA acceleration and AVX2 CPU optimizations. It helps applications choose faster inference paths on systems with compatible NVIDIA GPUs and modern CPUs.
Hardware-specific optimization can change performance and numerical behavior. Test models on the target machine before relying on results or latency guarantees.