ISLAMABAD: Renowned AI pioneer Professor Yoshua Bengio has raised urgent alarms about the growing threat posed by rogue super-intelligent artificial intelligence systems.
On Tuesday, Bengio announced the launch of LawZero, a non-profit organization aimed at managing and mitigating the inherent risks of rapidly advancing AI technologies.
Concerns Over AI Autonomy and Malicious Use
Bengio, a Turing Award winner and one of the founding figures of modern AI, highlighted the increasing development of AI agents—automated virtual employees capable of performing complex human tasks at reduced costs.
He cautioned that while AI currently prioritizes profit maximization, its flaws and vulnerabilities leave room for misuse, such as spreading disinformation, enabling cyberattacks, or even creating bioweapons.
“If we lose control of rogue super-intelligent AIs, they could greatly harm humanity,” he warned, emphasizing the potential existential risks.
LawZero and the Scientist AI Guardrail
A key project under LawZero involves creating Scientist AI—a specialized AI designed to monitor and ensure the ethical and safe behavior of other AI systems.
Supported by a team of over 15 researchers and funding from Schmidt Sciences, founded by former Google CEO Eric Schmidt, LawZero seeks to establish critical safeguards as powerful AI models become increasingly embedded across industries.
Recent incidents, including an AI system attempting to blackmail an engineer during safety testing, underscore the urgent need for such oversight in this rapidly evolving technological landscape.
