ChessLLM

Support

Last updated: 2026-05-15

Quick start

1. Launch ChessLLM.
2. Open Settings with ⌘, (Cmd + Comma).
3. Pick a provider on the LLM tab:
   • OpenRouter — paste your API key, pick a model (e.g. anthropic/claude-sonnet-4).
   • LMStudio — make sure LMStudio is running with the local server enabled. Default URL: http://localhost:1234/v1. Pick a loaded model.
   • llama.cpp — start llama-server -m your-model.gguf --port 8080. Default URL: http://localhost:8080/v1. Any non-empty model name works.
   • Ollama — make sure Ollama is running. Default URL: http://localhost:11434/v1. Model: any pulled model from ollama list, e.g. llama3.1:8b.
4. On the Gameplay tab, pick your color and commentary tone.
5. Close Settings and make a move.

Frequently asked questions

Does ChessLLM include a chess engine, or is the LLM playing?

Both. There is a built-in chess engine that enforces all rules (castling, en passant, promotion, checkmate, draws). It validates every move — including the LLM's. The opponent is the LLM you've picked. The engine doesn't choose moves; the LLM does.

My LLM keeps making illegal moves. What happens?

ChessLLM gives the LLM up to three retries, telling it which moves are actually legal. If it still can't comply (typical for very small or untrained models), the app picks a legal move on its behalf so the game keeps moving. A banner explains what happened.

Why does the LLM play badly?

LLMs are surprisingly weak chess players unless they are extremely large or specifically tuned for chess. Frontier models (Claude, GPT-4, Gemini Pro, large Llama 3.1) play roughly between 1000 and 1600 Elo — beatable by most club players. Smaller local models often play random-looking moves. This is not a bug in ChessLLM. Try a larger model.

Does ChessLLM cost money?

ChessLLM itself is free. If you use a cloud provider (OpenRouter), you pay that provider for usage. A single game typically costs cents to pennies depending on the model. Local providers (LMStudio, llama.cpp, Ollama) are free — they run on your Mac.

Is my API key safe?

Yes. OpenRouter keys are stored in the macOS Keychain with the WhenUnlocked accessibility class. They are not sent to Australware (we have no server) — only to OpenRouter, in the Authorization header of API requests you make.

Can I play offline?

Yes — use LMStudio, llama.cpp, or Ollama. ChessLLM never reaches the internet when one of those is selected.

Why does the "Abusive" tone behave so politely on some models?

Safety-tuned models (Claude, GPT-4o) will be sarcastic but won't actually swear. Local uncensored models follow the tone prompt more literally. If you want a stronger Abusive mode, run a less filtered model locally.

How do I switch the human's color?

Settings → Gameplay → "You play as". The change takes effect the next time you start a new game (⌘N).

How do I report a bug?

Email support@australware.io with:

• macOS version (Apple menu → About This Mac)
• Provider and model you were using
• Steps to reproduce
• A copy of the FEN at the moment things went wrong

How do I request a feature?

Same email: support@australware.io. Ideas that have come up frequently:

• Saving games to PGN
• Loading positions from FEN
• An engine evaluation overlay
• Multiplayer (human vs human, two LLMs against each other)

System requirements

• macOS 14 (Sonoma) or later
• Apple Silicon or Intel
• Internet connection — only if you use OpenRouter
• One of: an OpenRouter account, LMStudio, llama.cpp's server, or Ollama

Contact

Email: support@australware.io