Global volumes for Serverless are in beta. Features and behavior may change before general availability.
Mount path
Inside a worker, a global volume mounts at/runpod-volume, the same path used for network volumes on Serverless. Read your model files and other assets from this path in your handler function.
Attach a global volume to an endpoint
You can select a global volume during endpoint creation only when you deploy from a Docker image or a GitHub repository. The following deployment options don’t include storage settings:- Deploy image or video API.
- Deploy LLM API.
- Deploy from the Hub.
- Start with Hello World!.
Attaching a volume doesn’t copy any existing data, so upload your model files and other assets to the global volume before you attach it.
Attach during endpoint creation
- Go to Serverless and click New endpoint.
- Select Deploy from a Docker image or Deploy from a GitHub repository, configure your source, and click Next.
- On the Configure endpoint page, make sure Compute type is set to GPU and select your GPU configuration.
- Expand Advanced settings.
- Under Global volume, select the volume you want to attach.
- Click Deploy.
Attach to an existing endpoint
Use these steps to attach, change, or remove the global volume on any endpoint, including endpoints created with options that don’t include storage settings during creation.- Go to Serverless and select your endpoint.
- Click Manage, then Edit endpoint.
- Expand Advanced.
- Under Global volume, select the volume you want to attach, or select None to remove it.
- Click Save Endpoint.
Limitations
- One global volume per endpoint: An endpoint can attach at most one global volume at a time.
- Mutually exclusive with network volumes: An endpoint can’t use a global volume and a network volume at the same time.