Huggingface Registry

You can create an HuggingFace registry through a Hugging Face account. This enables HPE Machine Learning Inferencing Software to pull vLLM-compatible models directly from the Hugging Face model hub.

Before You Start #

• Create a Hugging Face account at Hugging Face.

How to Set Up an HuggingFace Registry #

1. Go to the Hugging Face website and sign in to your account.
2. Navigate to your Profile and select Settings.
3. Select Access Tokens.
4. Select New Token.
5. Input the following:
   • Name: A name for your token.
   • Type: Select read.
6. Select Generate a Token.
7. Copy the token.

You can now proceed to adding a packged model for your models and deployments.