NVIDIA Releases TensorRT Model Connect in Public Preview: Hugging Face Checkpoint to Native C++ Inference in Two Commands
NVIDIA has launched TensorRT Model Connect (TRTMC) in public preview, an open-source mission that takes a supported Hugging Face or native checkpoint to end-to-end TensorRT inference in two instructions. There is no intermediate ONNX export step. The construct produces a versioned .bundle artifact that runs via native C++ process APIs, so inference can execute in…
