Skip to main content
You need the gcloud command-line tool and a GCP project with billing enabled, L4 GPU quota, and available capacity. Installing from source requires Python 3.9–3.14.

​
Install and authenticate

Download and run the installer:
The installer uses ~/.iwant and places the command in ~/.local/bin. Add ~/.local/bin to your PATH if your shell cannot find iwant. To disable anonymous installer telemetry, run the installer with IWANT_NO_TELEMETRY=1.

​
Preview and launch

Inspect the plan without provisioning resources, then launch:
The recipe requests one L4 GPU. Save the Server URL and API key printed by the launch. Provisioning, model downloads, and loading can take time. Iwant checks that the models API responds before reporting readiness.

​
Send a request

Set the URL and key from your launch:
Use the same URL, key, and model ID in your OpenAI-compatible application.

​
Remove your deployment

Cloud resources keep billing until you remove them:
Select the cluster to remove and confirm it no longer appears. For scripts, run iwant down EXACT_CLUSTER_NAME using the name from iwant list.
Ctrl+C detaches from a launch; it does not stop the remote server. The default 30-minute idle timer tracks cluster jobs, not API requests. A running model server keeps the cluster active. Run iwant down when you finish, including after an interrupted launch.
See launch options for region selection, spot capacity, and recipe versions. This guide follows the upstream quickstart.
Last modified on October 29, 2026