Kernels documentation
Kernels
Getting started
Using kernels
QuickstartUsing LayersLocking Kernel VersionsEnvironment VariablesFAQMigrating from older versionsIntegrating kernels into a project
Building kernels
Writing KernelsBuilding kernelsLocal DevelopmentKernel RequirementsSecurityWhy Nix?Metal NotesBuild VariantsBuilding kernels with agents
API Reference
CLI Reference
You are viewing v0.14.0 version. A newer version v0.14.1 is available.
Kernels
The Kernel Hub allows Python libraries and applications to load compute kernels directly from the Hub. Kernels are a first-class repository type on the Hub, with dedicated pages that surface supported hardware and versions. To support dynamic loading, Hub kernels differ from traditional Python kernel packages in that they are made to be:
- Portable: a kernel can be loaded from paths outside
PYTHONPATH. - Unique: multiple versions of the same kernel can be loaded in the same Python process.
- Compatible: kernels must support all recent versions of Python and the different PyTorch build configurations (various CUDA versions and C++ ABIs). Furthermore, older C library versions must be supported.
Browse available kernels at huggingface.co/kernels.
If you’re looking for a more involved “Why kernels?” answer, refer to this page.
Update on GitHub