René's URL Explorer Experiment


Title: Getting Started | ServerlessLLM

Open Graph Title: Getting Started | ServerlessLLM

Description: This guide demonstrates how to quickly set up a local ServerlessLLM cluster using Docker Compose on a single machine. We will initialize a minimal cluster, consisting of a head node and a single worker node. Then, we'll deploy a model using the sllm and query the deployment through an OpenAI-compatible API.

Open Graph Description: This guide demonstrates how to quickly set up a local ServerlessLLM cluster using Docker Compose on a single machine. We will initialize a minimal cluster, consisting of a head node and a single worker node. Then, we'll deploy a model using the sllm and query the deployment through an OpenAI-compatible API.

Opengraph URL: https://serverlessllm.github.io/docs/getting_started

Generator: Docusaurus v3.4.0

direct link

Domain: serverlessllm.github.io

twitter:cardsummary_large_image
og:imagehttps://serverlessllm.github.io/img/docusaurus-social-card.jpg
twitter:imagehttps://serverlessllm.github.io/img/docusaurus-social-card.jpg
og:localeen
docusaurus_localeen
docsearch:languageen
google-site-verificationpaVylUvO7bZCEQC9ydl4sOZRbW2lCr7tp6_BdRxSemc
docusaurus_version0.8.0
docusaurus_tagdocs-default-0.8.0
docsearch:version0.8.0
docsearch:docusaurus_tagdocs-default-0.8.0
None1

Links:

Skip to main contenthttps://serverlessllm.github.io/docs/getting_started#__docusaurus_skipToContent_fallback
ServerlessLLMhttps://serverlessllm.github.io/
Documentshttps://serverlessllm.github.io/docs/intro
APIhttps://serverlessllm.github.io/docs/api/intro
0.8.0 (stable)https://serverlessllm.github.io/docs/
Latest (dev)https://serverlessllm.github.io/docs/latest/getting_started
0.8.0 (stable)https://serverlessllm.github.io/docs/getting_started
0.7.0https://serverlessllm.github.io/docs/0.7.0/getting_started
GitHubhttps://github.com/ServerlessLLM/ServerlessLLM
Serverless LLMhttps://serverlessllm.github.io/docs/intro
Getting Startedhttps://serverlessllm.github.io/docs/getting_started
Featureshttps://serverlessllm.github.io/docs/features/storage_aware_scheduling
Deploymenthttps://serverlessllm.github.io/docs/deployment/single_machine
ServerlessLLM Storehttps://serverlessllm.github.io/docs/store/quickstart
Developer Guidehttps://serverlessllm.github.io/docs/developer/supporting_a_new_hardware
Modelshttps://serverlessllm.github.io/docs/models/supported_models
Communityhttps://serverlessllm.github.io/docs/community/meetups
https://serverlessllm.github.io/
deploy from scratch guidehttps://serverlessllm.github.io/docs/deployment/single_machine
​https://serverlessllm.github.io/docs/getting_started#prerequisites
herehttps://docs.docker.com/get-docker/
herehttps://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html
​https://serverlessllm.github.io/docs/getting_started#start-the-serverlessllm-cluster
​https://serverlessllm.github.io/docs/getting_started#step-1-download-the-docker-compose-file
​https://serverlessllm.github.io/docs/getting_started#step-2-configuration
​https://serverlessllm.github.io/docs/getting_started#step-3-start-the-services
​https://serverlessllm.github.io/docs/getting_started#deploy-a-model-using-sllm
Hugging Face Model Hubhttps://huggingface.co/models
​https://serverlessllm.github.io/docs/getting_started#query-the-model
​https://serverlessllm.github.io/docs/getting_started#clean-up
Edit this pagehttps://github.com/ServerlessLLM/serverlessllm.github.io/tree/main/versioned_docs/version-0.8.0/getting_started.md
PreviousServerless LLMhttps://serverlessllm.github.io/docs/intro
NextStorage Aware Scheduling with Docker Composehttps://serverlessllm.github.io/docs/features/storage_aware_scheduling
Prerequisiteshttps://serverlessllm.github.io/docs/getting_started#prerequisites
Start the ServerlessLLM Clusterhttps://serverlessllm.github.io/docs/getting_started#start-the-serverlessllm-cluster
Step 1: Download the Docker Compose Filehttps://serverlessllm.github.io/docs/getting_started#step-1-download-the-docker-compose-file
Step 2: Configurationhttps://serverlessllm.github.io/docs/getting_started#step-2-configuration
Step 3: Start the Serviceshttps://serverlessllm.github.io/docs/getting_started#step-3-start-the-services
Deploy a Model Using sllmhttps://serverlessllm.github.io/docs/getting_started#deploy-a-model-using-sllm
Query the Modelhttps://serverlessllm.github.io/docs/getting_started#query-the-model
Clean Uphttps://serverlessllm.github.io/docs/getting_started#clean-up
Documentshttps://serverlessllm.github.io/docs/intro
APIhttps://serverlessllm.github.io/docs/api/intro
GitHubhttps://github.com/ServerlessLLM/ServerlessLLM

Viewport: width=device-width,initial-scale=1

URLs of crawlers that visited me.