Post
PyTorch
pytorch.org
did:plc:o3pmmtxoor73pszydv7pffsv
NVIDIA recsys-examples now provides an end-to-end HSTU inference workflow with Dynamo-Triton.
PyTorch AOTI compiles HSTU models to native C++, while FlexKV stores attention states to boost efficiency. On an RTX PRO 6000 Blackwell GPU, this yields up to 5.93x lower latency.
https://bit.ly/4AT5Vws
https://developer.nvidia.com/blog/deploying-an-hstu-generative-recommender-with-nvidia-dynamo-triton/
2026-10-08T21:00:16.552Z