SSH Keys and How to Use Them

What SSH keys are, why they matter, and how to use them

Written By chloe kwok

Last updated 10 months ago

SSH keys let you securely access your Inference.ai servers from your terminal—no password required. They're a must-have for developers, researchers, and engineers who want full control over their compute environment.

What are SSH Keys?

SSH (Secure Shell) keys are a way to prove your identity when connecting to a remote machine. They’re more secure than a password and make it easier to automate tasks or access your server programmatically.

Each SSH key pair includes:

  • A public key: shared with servers (safe to distribute)

  • A private key: stored on your device (keep it secret!)

When you connect to a server, Inference.ai checks whether your private key matches the public key on file. If it does, you're in—no password needed.

How to Generate an SSH Key

If you don’t already have an SSH key pair, you can generate one on your local machine:

Mac / Linux / WSL:

Example
ssh-keygen -t ed25519 -C "[email protected]"

Windows (with Git Bash or WSL):

  1. Enter the same command as above

  2. When asked to where to save the key, press Enter to accept the default location (~/.ssh/id_ed25519)

  3. (Optional) Enter a passphrase or press Enter to skip

  4. To view your new public key:

Example
cat ~/.ssh/id_ed25519.pub

Adding Your SSH Key to Inference.ai

  1. Go to the SSH Key tab in the left sidebar

  2. Paste your SSH Key into the text box

  3. Select Save SSh Key

Pro tip: You can add multiple keys if you use different devices

Why Use SSH on Inference.ai?

  • Run commands directly on your server

  • Install packages or tools that your Jupyter environment doesn’t support

  • Deploy scripts, models, or full-scale experiments

  • Set up automated workflows or port forwarding