Core Concepts and Terminology
Model inference
Public Endpoint The shared inference endpoint for models published on the platform, billed by token usage and subject to a rate limit. No deployment is required to use it.
Private Endpoint A model inference endpoint dedicated to you, billed by the usage hours of the GPU or CPU resources used in the deployment. Supports replica management and auto scaling.
Playground An interactive model testing environment. Before committing to a model API, you can try it live, tune parameters, and get the matching code samples directly.
Trying models in the Playground is also billed.
API Key The credential that authenticates your model API calls. You can set a Budget Limit; once the limit is reached, API requests are rejected.
GPU containers
Pod The GPU container unit you rent. When deploying, you choose a resource specification and an image; you can mount storage, and each Pod provides a Web Terminal, resource monitoring, logs, and event records.
Image / Image Template The container image a Pod starts from. You can use official templates published by the administrator, or custom images from Docker Hub, GitHub Container Registry, NGC, GCP Artifact, or AWS ECR.
Credential Key The login credential required to pull private images from third-party container registries.
Volume Persistent storage that can be mounted to a Pod. Billing starts as soon as a volume is enabled (capacity × usage duration); after creation, a volume can only be expanded, never shrunk.
Secret Sensitive data stored as key-value pairs, which can be mounted as environment variables when creating a Pod. Secret contents are never displayed in the list.
Billing
Credit The platform's prepaid balance. Top up before using any resource; all charges are deducted from your credits. You can check your balance at any time in the top-right corner of the page.
Naming rules
Most resources on the platform (Pods, volumes, endpoints, secrets, credentials) must follow Kubernetes naming rules: names may contain only lowercase letters, digits, and the - character, must start with a letter, and must end with a letter or digit.