This page covers creating, deploying, sharing, duplicating, editing and deleting templates.
On the Templates page, click New template. The form is the deploy page plus a Template name, which the CLI deploys the template by, and Visibility.
featherless-cloud templates create llm-dev \
--template featherless/rocm-vllm \
--gpu-count 1 \
--volume models:/workspace \
--port 8000 \
--env HF_HOME=/workspace/hf \
--visibility organization \
--tag vllm
Use --image <reference> instead of --template to base it on your own image.
A template is based on either an official template or your own image.
Deploy in a template's menu on the Templates page opens the deploy page with its settings filled in.
# Your own template
featherless-cloud instance create --template llm-dev
# A template shared in your organization
featherless-cloud instance create --template org/llm-dev
# An official template, at a chosen version
featherless-cloud exec --template featherless/rocm-pytorch:2.12.0 --gpu-count 1 -- python train.py
Other flags override the template's values. Copy CLI flag in a template's menu copies its --template flag.
Set the template's Visibility to Organization, and every member can see and deploy it, including its secret values.
Duplicate works on any template, including official ones. The copy is private and includes the original's secret values.
Instances and Run Jobs already deployed from a template keep their settings when it's edited or deleted.
You can edit or delete your own templates. Organization owners and admins can also edit or delete templates shared in the organization. Official templates can't be changed.