Connect your own GPU to staik

Last updated:

On this page

Connect your own GPU hardware to staik so your organization's traffic routes to your own nodes, isolated from everyone else on a private mesh. The whole flow takes ~10 minutes and is self-service in the portal. Read more about how the node and inference are secured.

Prerequisites

On your GPU machine:

  • Ubuntu 22.04 or 24.04 with sudo
  • An NVIDIA GPU with drivers installed (nvidia-smi works)
  • Outbound internet (to join the mesh) — no inbound ports need to be opened
  • A model for the node to serve. Ollama is installed automatically; if you run vLLM/SGLang, your engine is expected to already respond OpenAI-compatibly.

Step 1 — Create your organization

  1. Register an account at api.staik.se/register and note your API key.
  2. Open the GPU portal and enter the key.
  3. Click Create organization, give it a name, and you become the owner.

Step 2 — Add your GPU

  1. Click Add GPU. Choose the engine (ollama / vllm / sglang) and enter the model the node will serve.
  2. The portal shows a copy-paste line with a one-time node token and mesh key. Copy the whole line — it is shown only once.

One-time values

The node token and mesh key are shown only once. Copy the whole line before closing the view. If you lose it, you can generate a new one from the portal.

Step 3 — Run the line on the GPU machine

Paste the copied line into a terminal on your GPU machine. It looks like this (the values are filled in automatically by the portal):

bash
curl -fsSL https://api.staik.se/byo/provision-byo-node.sh | sudo \
  TS_AUTHKEY=<mesh-key> \
  STAIK_NODE_TOKEN=<node-token> \
  STAIK_HOSTNAME=cust-<your-org>-0 \
  STAIK_ENGINE=ollama \
  STAIK_MODEL=<your-model> \
  bash

The script connects your machine to the mesh, sets up the engine and a small agent, and locks down the network so the node is only reachable by staik. You don't need to configure anything manually.

Step 4 — Verify the node is online

Return to the GPU portal. Within ~1 minute your node should show as online with the right model and a recent "last seen" time.

Step 5 — Your first request

Use your API key against https://api.staik.se/v1 as usual. The model name controls the routing:

  • <your-org-slug>/<model> → your own node (isolated)
  • bare model name (e.g. qwen3.6:35b-a3b) → staik's shared pool
bash
curl https://api.staik.se/v1/chat/completions \
  -H "Authorization: Bearer sk-st-your-key" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "<your-org-slug>/<your-model>",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Step 6 — Invite your team (optional)

In the portal: enter a colleague's email and click Invite (they need a staik account). On accept they get an org-scoped API key whose traffic runs in your organization's context, against your own nodes.

Need help?

Want to add more nodes or stuck on the setup? Reach out to customercare@staik.se and we'll help you get going.