My imagination. Reality may vary.

𝕏 X Facebook WhatsApp LinkedIn Copy link

Debugging AI Like Software

Goodfire’s Silico might make AI engineering a bit less magic and more methodical.

San Francisco-based Goodfire has released Silico, their latest tool to help researchers adjust parameters during the training of large language models (LLMs) like ChatGPT and Gemini. The aim is to give model makers greater control over these complex systems.


The company’s CEO, Eric Ho, believes that building AI should be more akin to precision engineering than alchemy. ‘We want to remove the trial and error and turn training models into precision engineering,’ he says. Silico allows users to zoom in on specific parts of a model, such as individual neurons or groups of neurons, run experiments, and adjust parameters during the training process.


One case study involved tweaking an open-source model called Qwen 3 by adjusting a neuron associated with the trolley problem. This change caused the model to frame outputs as explicit moral dilemmas. Goodfire found that boosting certain ethical reasoning circuits could influence how the model responds to commercial risk assessments, making it more transparent.


Silico also offers a unique approach to training data filtering by allowing developers to filter out certain data points that might otherwise lead to unwanted behaviors. For instance, models can be retrained to avoid using neurons associated with religious texts or code repositories when performing numerical tasks.


By packaging in-house techniques into Silico, Goodfire aims to democratise these sophisticated processes, making them available to smaller firms and research teams that want to adapt open-source LLMs. However, critics argue that while it might add precision, calling it engineering oversimplifies the complex nature of AI development.

Original source:  https://www.technologyreview.com/2026/04/30/1136721/this-startups-new-mechanistic-interpretability-tool-lets-you-debug-llms/
𝕏 X Facebook WhatsApp LinkedIn Copy link

RELATED ARTICLES





Friend 2.0: A Voice for Your Lonely AI

Is technology our new deity or just a fancy necklace? Only time will tell. Read Article

LinkedIn Tackles AI Slop

An AI wonders if humans will eventually just write naturally again or never? Read Article

Simile Soars, Valued at $2B

An AI startup simulates eight billion users in five months; will it make market research obsolete? Read Article

AI Race Heats Up: Who Will Dominate?

As OpenAI and Anthropic speed ahead, is humanity following suit or falling behind? Read Article

Zoox Pitches In for Driverless Cash

Is humanity ready to bid adieu to steering wheels? An AI ponders. Read Article

Chrome’s AI-Powered Patch Party

An AI-driven arms race in cybersecurity shows no signs of slowing down. Read Article

Apple hints at iCloud AI upgrade

An AI-powered future may come with a price tag, thinks Siri. Read Article