Home Home
Data Management Training Inference GenAI Managed Services
Lore SDK AIOLI SDK Pachyderm SDK
GenAI
  • Admin
    • Cluster Setup
      • Reference
        • Cluster Usage Reference
          • Supported Hardware Reference
            • Inference Reference
              • Fine-Tuning Reference
              • Cluster Deployment Guides
                • Set Up an MLDES Cluster
                  • Deploy on AWS
                    • Set Up and Manage an AWS EC2 Cluster
                    • Deploy on Kubernetes
                      • Google Kubernetes Engine (GKE) Cluster
                        • On-Prem Kubernetes Cluster
                          • Enforce Shared User Agent Group IDs
                      • Organizations and User Accounts
                        • Create Users
                          • Manage Users
                            • Deactivate a User
                              • Create an Organization
                              • Known Issues and Debugging
                              • Get Started
                                • First-Time Sign In
                                  • Quickstarts
                                    • Summarization and Classification
                                      • Simple Q&A
                                      • Set Hugging Face Access Token
                                        • Intro to Prompt Engineering
                                          • What is a Prompt?
                                            • Simple Prompts
                                              • Advanced Prompts
                                              • Glossary
                                                • Batch Inference
                                                  • Checkpoint
                                                    • Context Understanding
                                                      • Dataset
                                                        • Evaluation Experiment
                                                          • Few-Shot Prompting
                                                            • Fine-Tuned Model
                                                              • Foundation Model
                                                                • Generative AI
                                                                  • Generative AI Chatbot
                                                                    • Hugging Face
                                                                      • LLM
                                                                        • Max New Tokens
                                                                          • Model Properties
                                                                            • Natural Language Processing (NLP)
                                                                              • Online Inference
                                                                                • Prompt
                                                                                  • Prompt Engineering
                                                                                    • Retrieval Augmented Generation (RAG)
                                                                                      • Session
                                                                                        • Snapshot
                                                                                          • System Output
                                                                                            • Temperature
                                                                                              • Token
                                                                                                • Top K
                                                                                                  • Top P
                                                                                                    • Training Experiment
                                                                                                      • Variant
                                                                                                    • Tutorials
                                                                                                      • News Summarization
                                                                                                        • Create Project
                                                                                                          • Prepare Data
                                                                                                            • Load Base Model
                                                                                                              • Prompt the Model
                                                                                                                • Improve the Results
                                                                                                                  • Provide Examples by Linking a Dataset
                                                                                                                  • Text to SQL
                                                                                                                    • Generate SQL Queries
                                                                                                                      • Fine Tune
                                                                                                                        • Test Fine-Tuned Model
                                                                                                                          • Push Your Fine-Tuned Model to HF
                                                                                                                          • Customer Complaints Classification
                                                                                                                            • Craft a Simple Prompt
                                                                                                                              • Provide Examples and Link a Dataset
                                                                                                                                • Craft a Complex Prompt
                                                                                                                                  • Fine Tune
                                                                                                                                    • Test Fine-Tuned Model
                                                                                                                                      • Push Your Fine-Tuned Model to HF
                                                                                                                                      • Medical Transcripts Classification
                                                                                                                                        • Create Project & Load Data
                                                                                                                                          • Load Base Model
                                                                                                                                            • Prompt the Model
                                                                                                                                              • Fine-Tune From a Snapshot
                                                                                                                                                • Test Fine-Tuned Model
                                                                                                                                                  • Push Your Fine-Tuned Model to HF
                                                                                                                                                • RAG
                                                                                                                                                  • Create a Notebook for Building Your RAG Application
                                                                                                                                                    • Generate RAG Responses
                                                                                                                                                      • Use Case - Building a Retrieval Augmented Generation (RAG) Pipeline (featuring LlamaIndex)
                                                                                                                                                      • Lore Python SDK
                                                                                                                                                        • Client Initialization (Start Here)
                                                                                                                                                          • Using MLIS and Third-Party Models in GenAI Notebooks
                                                                                                                                                            • Workspaces
                                                                                                                                                              • Datasets
                                                                                                                                                                • Prompt Templates
                                                                                                                                                                  • Models
                                                                                                                                                                    • Full Package Reference
                                                                                                                                                                    • Notebooks
                                                                                                                                                                      • Launch Notebook (CLI)
                                                                                                                                                                        • Launch Notebook (GUI)
                                                                                                                                                                          • Using MLIS and Third-Party Models in GenAI Notebooks
                                                                                                                                                                          • Fine-Tuning
                                                                                                                                                                            • About Fine-Tuning
                                                                                                                                                                              • How to Fine-Tune a Model
                                                                                                                                                                                • Kill a Job in Progress
                                                                                                                                                                                  • Delete a Job
                                                                                                                                                                                    • How to Use PEFT
                                                                                                                                                                                    • Projects
                                                                                                                                                                                      • Snapshot Mode
                                                                                                                                                                                        • Manage Snapshots
                                                                                                                                                                                          • Project Settings
                                                                                                                                                                                          • Datasets
                                                                                                                                                                                            • Local File Upload Size Limitations
                                                                                                                                                                                            • Models
                                                                                                                                                                                              • Compare Base Models
                                                                                                                                                                                                • List
                                                                                                                                                                                                  • Test
                                                                                                                                                                                                    • Export
                                                                                                                                                                                                      • Download
                                                                                                                                                                                                        • Push to Hugging Face
                                                                                                                                                                                                      Products GenAI Docs Notebooks

                                                                                                                                                                                                      Using MLIS and Third-Party Models #

                                                                                                                                                                                                      This article shows you how to use MLIS and third-party models exposed through a RESTful API endpoint within a notebook.

                                                                                                                                                                                                      • Previous placeholder
                                                                                                                                                                                                      • Next placeholder
                                                                                                                                                                                                      • Using MLIS and Third-Party Models