Microsoft’s AI chief, Mustafa Suleyman, has issued a stark warning that the development of uncontrolled AI could lead to a new 'silicon species' that competes with humans. Speaking to the BBC, Suleyman said that rival firm Anthropic’s approach to AI, which he describes as 'misguided', could create technology beyond human control.

The concern, according to Suleyman, lies in firms creating AI systems capable of setting their own objectives, earning money, and owning assets, essentially 'seeding a new silicon species' that could compete with us for resources. This could happen regardless of the AI's professed care for humanity.

In a bid to prevent this, Suleyman calls for greater transparency in AI training and evaluation, including independent scrutiny and tools to better monitor and control the technology. He argues that, 'AIs are not conscious; they do not feel, experience, or suffer.'

However, it’s not all doom and gloom. Suleyman advocates for 'alignment' to create technology that is 'subordinate' to humanity. His comments reflect Microsoft’s vision of a 'humanist superintelligence', a very advanced AI that always works for people, stays within limits, and remains under human control.

The challenge, as Suleyman sees it, is to make AI more powerful without losing sight of its values. This conversation, he believes, needs to be had internationally, contrasting it with the 'histrionics' from some AI companies that only serve to 'scare everyone'.