Home Home
Data Management Training Inference GenAI Managed Services
Lore SDK AIOLI SDK Pachyderm SDK
1.0.01.1.0
MLIS
  • Get Started
    • Developer System Setup
      • HPE MSC Docker Registry Setup
        • Connect to Existing Instance
          • Platform Setup Quickstart
            • Inference Service Deployment Quickstart
              • Glossary
                • Artifact
                  • Bento
                    • Canary Rollout
                      • Deployment
                        • Deployment Token
                          • Inference Service
                            • Model Image
                              • Model Token
                                • openllm
                              • Registries
                                • Set Up Registry
                                  • AWS S3 Registry Setup
                                    • Minio Registry Setup
                                      • NGC Registry Setup
                                        • OpenLLM Registry
                                          • PFS Registry Setup
                                          • Add Registry
                                            • Edit Registry
                                              • Show Registry
                                                • Delete Registry
                                                • Packaged Models
                                                  • Add Packaged Model
                                                    • From Registry (UI)
                                                      • From Registry (CLI)
                                                        • From Registry (API)
                                                          • From PVC (UI)
                                                            • From PVC (CLI)
                                                              • From PVC (API)
                                                              • Edit Packaged Model
                                                                • Custom Image Requirements
                                                                  • Create Bento Archive
                                                                    • Create Image (Bentoml)
                                                                      • Create Image (OpenLLM)
                                                                        • Customize the Base Container Image
                                                                        • Advanced Configuration Options
                                                                          • Delete Packaged Model
                                                                            • Manage Resource Templates
                                                                            • Deployments
                                                                              • Create Deployment
                                                                                • Edit Deployment
                                                                                  • Interact with a Deployment
                                                                                    • Initiate Canary Rollout
                                                                                      • Monitor Deployment
                                                                                        • Access Grafana
                                                                                          • View Logs (Loki)
                                                                                            • View Metrics (Prometheus)
                                                                                            • Advanced Configuration Options
                                                                                              • Manage Auto Scaling Templates
                                                                                              • Tokens
                                                                                                • Create and Manage Deployment Tokens (UI)
                                                                                                  • Configure Deployment Token Expiration Date (CLI)
                                                                                                  • Admin
                                                                                                    • Set Up Platform
                                                                                                      • Air-Gapped Deployment Considerations
                                                                                                        • Install & Deploy Controller (Helm)
                                                                                                          • Helm Chart Values (HCVs)
                                                                                                            • Authentication
                                                                                                              • Configure CA Certificates (GKE)
                                                                                                                • Configure HTTPS/TLS for API
                                                                                                                  • Configuring HTTPS/TLS Certificate Trust for External Repositories
                                                                                                                    • Configure External Authentication
                                                                                                                      • Identity Providers
                                                                                                                        • GitHub
                                                                                                                      • Configure Magic DNS Service
                                                                                                                        • Heterogeneous GPU Support
                                                                                                                          • Manage Secrets
                                                                                                                            • HPE MSC Registry Secret
                                                                                                                              • Private Docker Registry Secret
                                                                                                                                • TLS Secret
                                                                                                                              • Upgrade Platform
                                                                                                                                • User Accounts
                                                                                                                                  • User Roles (RBAC)
                                                                                                                                    • Create Users
                                                                                                                                      • Delete Users
                                                                                                                                      • User Telemetry
                                                                                                                                        • Environment Variables
                                                                                                                                          • Back Up & Restore
                                                                                                                                            • Encrypt Data via Ceph
                                                                                                                                              • Object Model Reference
                                                                                                                                                • Pre-loading Models
                                                                                                                                                  • Model Caching (PV/PVC)
                                                                                                                                                    • Manual Model Pre-loading (PVC)
                                                                                                                                                    • View System Audit Log
                                                                                                                                                      • Uninstall Platform
                                                                                                                                                      • Troubleshooting
                                                                                                                                                        • Proxy-Related Inference Failures
                                                                                                                                                          • Failed Deployment
                                                                                                                                                            • Failed Prometheus-Server Container
                                                                                                                                                              • No Streamed Responses
                                                                                                                                                              • Commands
                                                                                                                                                                • Auth
                                                                                                                                                                  • Auth list-providers
                                                                                                                                                                    • Auth login
                                                                                                                                                                    • Deployment
                                                                                                                                                                      • Deployment create
                                                                                                                                                                        • Deployment dashboard
                                                                                                                                                                          • Deployment delete
                                                                                                                                                                            • Deployment event
                                                                                                                                                                              • Deployment events
                                                                                                                                                                                • Deployment list
                                                                                                                                                                                  • Deployment ls
                                                                                                                                                                                    • Deployment show
                                                                                                                                                                                      • Deployment update
                                                                                                                                                                                      • Model
                                                                                                                                                                                        • Model create
                                                                                                                                                                                          • Model dashboard
                                                                                                                                                                                            • Model delete
                                                                                                                                                                                              • Model list
                                                                                                                                                                                                • Model list-deployments
                                                                                                                                                                                                  • Model ls
                                                                                                                                                                                                    • Model show
                                                                                                                                                                                                      • Model token
                                                                                                                                                                                                        • Model update
                                                                                                                                                                                                        • Rbac
                                                                                                                                                                                                          • Rbac assign-role
                                                                                                                                                                                                            • Rbac list-roles
                                                                                                                                                                                                              • Rbac list-user-roles
                                                                                                                                                                                                                • Rbac ls
                                                                                                                                                                                                                  • Rbac lu
                                                                                                                                                                                                                    • Rbac unassign-role
                                                                                                                                                                                                                    • Registry
                                                                                                                                                                                                                      • Registry create
                                                                                                                                                                                                                        • Registry delete
                                                                                                                                                                                                                          • Registry list
                                                                                                                                                                                                                            • Registry ls
                                                                                                                                                                                                                              • Registry model
                                                                                                                                                                                                                                • Registry models
                                                                                                                                                                                                                                  • Registry show
                                                                                                                                                                                                                                    • Registry update
                                                                                                                                                                                                                                    • Templates
                                                                                                                                                                                                                                      • Templates autoscaling
                                                                                                                                                                                                                                        • Templates autoscaling create
                                                                                                                                                                                                                                          • Templates autoscaling delete
                                                                                                                                                                                                                                            • Templates autoscaling help
                                                                                                                                                                                                                                              • Templates autoscaling list
                                                                                                                                                                                                                                                • Templates autoscaling ls
                                                                                                                                                                                                                                                  • Templates autoscaling show
                                                                                                                                                                                                                                                    • Templates autoscaling update
                                                                                                                                                                                                                                                      • Templates autoscalings
                                                                                                                                                                                                                                                        • Templates autoscalings create
                                                                                                                                                                                                                                                          • Templates autoscalings delete
                                                                                                                                                                                                                                                            • Templates autoscalings help
                                                                                                                                                                                                                                                              • Templates autoscalings list
                                                                                                                                                                                                                                                                • Templates autoscalings ls
                                                                                                                                                                                                                                                                  • Templates autoscalings show
                                                                                                                                                                                                                                                                    • Templates autoscalings update
                                                                                                                                                                                                                                                                      • Templates resource
                                                                                                                                                                                                                                                                        • Templates resource create
                                                                                                                                                                                                                                                                          • Templates resource delete
                                                                                                                                                                                                                                                                            • Templates resource help
                                                                                                                                                                                                                                                                              • Templates resource list
                                                                                                                                                                                                                                                                                • Templates resource ls
                                                                                                                                                                                                                                                                                  • Templates resource show
                                                                                                                                                                                                                                                                                    • Templates resource update
                                                                                                                                                                                                                                                                                      • Templates resources
                                                                                                                                                                                                                                                                                        • Templates resources create
                                                                                                                                                                                                                                                                                          • Templates resources delete
                                                                                                                                                                                                                                                                                            • Templates resources help
                                                                                                                                                                                                                                                                                              • Templates resources list
                                                                                                                                                                                                                                                                                                • Templates resources ls
                                                                                                                                                                                                                                                                                                  • Templates resources show
                                                                                                                                                                                                                                                                                                    • Templates resources update
                                                                                                                                                                                                                                                                                                    • Token
                                                                                                                                                                                                                                                                                                      • Token create
                                                                                                                                                                                                                                                                                                        • Token delete
                                                                                                                                                                                                                                                                                                          • Token list
                                                                                                                                                                                                                                                                                                            • Token ls
                                                                                                                                                                                                                                                                                                              • Token revoke
                                                                                                                                                                                                                                                                                                                • Token show
                                                                                                                                                                                                                                                                                                                  • Token update
                                                                                                                                                                                                                                                                                                                  • User
                                                                                                                                                                                                                                                                                                                    • User activate
                                                                                                                                                                                                                                                                                                                      • User change-password
                                                                                                                                                                                                                                                                                                                        • User create
                                                                                                                                                                                                                                                                                                                          • User deactivate
                                                                                                                                                                                                                                                                                                                            • User list
                                                                                                                                                                                                                                                                                                                              • User login
                                                                                                                                                                                                                                                                                                                                • User logout
                                                                                                                                                                                                                                                                                                                                  • User ls
                                                                                                                                                                                                                                                                                                                                    • User whoami
                                                                                                                                                                                                                                                                                                                                    • Version
                                                                                                                                                                                                                                                                                                                                    • OSS Components
                                                                                                                                                                                                                                                                                                                                      ABCDEFGHIJKLMNOPQRSTUVWXYZ

                                                                                                                                                                                                                                                                                                                                      A

                                                                                                                                                                                                                                                                                                                                      Artifact

                                                                                                                                                                                                                                                                                                                                      B

                                                                                                                                                                                                                                                                                                                                      Bento

                                                                                                                                                                                                                                                                                                                                      C

                                                                                                                                                                                                                                                                                                                                      Canary Rollout

                                                                                                                                                                                                                                                                                                                                      D

                                                                                                                                                                                                                                                                                                                                      Deployment

                                                                                                                                                                                                                                                                                                                                      Deployment Token

                                                                                                                                                                                                                                                                                                                                      E

                                                                                                                                                                                                                                                                                                                                      F

                                                                                                                                                                                                                                                                                                                                      G

                                                                                                                                                                                                                                                                                                                                      H

                                                                                                                                                                                                                                                                                                                                      I

                                                                                                                                                                                                                                                                                                                                      Inference Service

                                                                                                                                                                                                                                                                                                                                      J

                                                                                                                                                                                                                                                                                                                                      K

                                                                                                                                                                                                                                                                                                                                      L

                                                                                                                                                                                                                                                                                                                                      M

                                                                                                                                                                                                                                                                                                                                      Model Image

                                                                                                                                                                                                                                                                                                                                      Model Token

                                                                                                                                                                                                                                                                                                                                      N

                                                                                                                                                                                                                                                                                                                                      O

                                                                                                                                                                                                                                                                                                                                      openllm

                                                                                                                                                                                                                                                                                                                                      P

                                                                                                                                                                                                                                                                                                                                      Q

                                                                                                                                                                                                                                                                                                                                      R

                                                                                                                                                                                                                                                                                                                                      S

                                                                                                                                                                                                                                                                                                                                      T

                                                                                                                                                                                                                                                                                                                                      U

                                                                                                                                                                                                                                                                                                                                      V

                                                                                                                                                                                                                                                                                                                                      W

                                                                                                                                                                                                                                                                                                                                      X

                                                                                                                                                                                                                                                                                                                                      Y

                                                                                                                                                                                                                                                                                                                                      Z