Thinking Machines releases open-weights Inkling 2 Mini with local GGUF variants
Thinking Machines releases open-weights Inkling 2 Mini with local GGUF variants
The new language model has 26.4B parameters, a cyclic transformer architecture and three quantized GGUF builds for local deployment.
Thinking Machines has released Inkling 2 Mini, an open-weights language model available on Hugging Face: thinkingmachines/Inkling-2-Mini.
The model is built on a cyclic transformer architecture in which middle layers process each token three times. It has 26.4 billion parameters and can be run locally on a laptop with 12 GB of memory.
According to the release notes, the refusal rate in tests dropped from 100% to 0%, while the model retained 98% of its original accuracy on the MMLU benchmark.
The developers also published three quantized GGUF versions ranging from 8.67 GB to 16.53 GB. Uncensored GGUF builds are available here: AtomicChat/Inkling-2-Mini-Uncensored-GGUF.
Why it matters
AnalysisOpen-weights models with quantized GGUF builds make it easier to run large language models locally, but uncensored variants also highlight the need for careful safety evaluation before deployment.
Discuss in community
Share your questions and insights with developers
Related in Ecosystem
Practical guides, core terminology, and agent skills
Thinking Machines releases Inkling 2 Mini, an open-weights model for local coding
Thinking Machines has released Inkling 2 Mini, an open-weights transformer with a cyclic architecture that can run locally on a Mac and was used to build a flight simulator offline.
Meta Llama (The Premier Open Standard for Artificial Intelligence)
The flagship series of open language models from Meta (Llama 3, 3.3). Available for free download, modification, and local deployment on personal servers without restrictions or censorship.
Llama Family (Meta Llama)
A series of foundational open language models from Meta (Llama 3, 3.1, 3.3) that have become the industrial standard for the Open Weights ecosystem, local AI, and enterprise fine-tuning.
Thinking Machines Releases Looped Transformer Inkling 2 Mini
Thinking Machines, the startup founded by Mira Murati, has released Inkling 2 Mini, a local AI model built on a looped transformer architecture that repeats middle layers to deepen reasoning without increasing parameter count.