GitHub radar
An open AI model for text and images that runs on your own computer
Inkling 2 Mini is an open general-purpose model from Thinking Machines. It understands text and images and runs on a powerful Mac without the cloud, so your data stays with you.
A general-purpose AI model that takes text and images and answers in text. Its weights, the trained model itself, are open under the Apache 2.0 license, so you can run it yourself and build it into your apps.
When it helps
Useful if you have an Apple silicon Mac with 32 GB of memory or more and want a model without the cloud: for personal experiments, a chatbot or repetitive tasks. Skip it if you have an ordinary laptop or need a replacement for strong paid models in serious agent work.
Pros
- Your texts and images stay on your computer
- Open Apache 2.0 license, usable in your own products
- 79.2% on SWE-bench Verified, as measured by the authors themselves
- Takes up to 1 million tokens at once
Cons
- Needs a Mac or graphics card with 32 GB memory
- May delete files without asking when using tools
- Can get stuck in long reasoning loops; weaker outside English
How to set it up — step by step
- 1Check that you have an Apple silicon Mac with 32 GB of memory or more, or a 32 GB graphics card.
- 2If you don't have such a computer, open the authors' Tinker online playground and ask the model questions there.
- 3Open Claude Code or Codex in your project folder.
- 4Send the agent the text from the block below.
- 5Check that the model answers both a text question and a question about an image.
- 6When the model works with files, limit its number of steps and run it in a separate folder, not your project.
Text for your agent
Copy this and send it to your agent — Claude Code, Codex, any of them:
Install the Inkling 2 Mini model locally for me: https://huggingface.co/thinkingmachines/Inkling-2-Mini – check whether my computer has enough memory, pick a quantized GGUF version, run it with Ollama or llama.cpp, and show me how to send it text and an image.
You need a Mac with an Apple chip and 32 GB of memory or more, a graphics card with 32 GB of memory or more, or an NVIDIA DGX Spark. The model file weighs about 20 GB. Without such a computer, you can try the authors' online playground, Tinker.
Open on Hugging Face▌ More finds