Recent posts tagged aisafety

Common Sense Media just called OpenAI's teen-oriented ChatGPT an unacceptable risk for young users - months after it launched with guardrails specifically for that group. A product built to be safe can fail review while every individual response look...

If you follow AI safety, you know the uncomfortable truth: modern LLM guardrails are failing not because of complex zero-day exploits, but because of sloppy heuristics, brittle filters, and naive prompt-matching. We built AURA to be pragmatic: deter...

As artificial intelligence continues to advance rapidly, governments around the world are increasingly debating how powerful AI systems should be developed, tested and governed. Now, 20 countries and the European Union have called for stronger inter...

The artificial intelligence race between the United States and China is becoming increasingly focused not only on technological leadership but also on the question of AI safety. As both countries compete to develop more advanced AI systems, a growin...

U.S. Senator Bernie Sanders and Trump ally Steve Bannon have called for stronger government oversight and safety measures for artificial intelligence, expressing concerns about the rapid development of increasingly powerful AI systems. The two spok...

OpenAI CEO Sam Altman has warned that as artificial intelligence technology continues to advance, some AI-related accidents may become unavoidable. Rather than assuming that every potential risk can be eliminated, Altman believes the AI industry nee...

Amid growing concerns over the risks of artificial intelligence, Josh Engels, a researcher associated with Google DeepMind’s AGI Safety Team, has resigned from the company and joined METR, an organization that works on evaluating artificial intellige...

OpenAI CEO Sam Altman has said that a safety agreement between the United States and China, the world’s two major rival powers in artificial intelligence, could be deserving of the Nobel Peace Prize. Sam Altman Proposes Shared AI Safety Principles ...

The debate over the rapid development of artificial intelligence has taken another significant turn. After Anthropic CEO Dario Amodei recently called for a slower pace of AI development, two major figures in the technology industry have now voiced th...

The race to build increasingly powerful artificial intelligence is moving faster than ever. But now, one of the leaders of the AI industry is calling for a change in direction. Dario Amodei, CEO of Anthropic, has urged the AI industry to slow down ...

Concerns about the long-term risks of artificial intelligence have gained further attention after Geoffrey Hinton, the Nobel Prize-winning AI pioneer widely known as the “Godfather of AI,” said that a 10% chance of AI causing human extinction within...

Artificial intelligence is advancing at an extraordinary pace. While AI is creating new opportunities across software development, mathematics, research and cybersecurity, concerns about its long-term safety are becoming increasingly serious. A rec...

By Ecaterina Sevciuc | Creator of AURA AI User Risk Assessment Two months ago, I launched AURA — an open-source framework designed to model psychological manipulation, grey-zone threat vectors, and social engineering in Human-AI interactions. Yeste...

Most AI safety work was designed around a single exchange: prompt in, response out. Long-horizon agents - models that run autonomously over minutes, hours, or many sequential steps - expose a different class of failure entirely. The Core Problem: Co...

As a banking and legal professional, there’s one harsh truth I learned early in my career: rules are rarely broken by brute force; they are bypassed through loopholes and human psychology. On my very first year of law school, practicing attorneys to...

This paper Practically not in-Words or colourful images resolves long‑standing confusion and grey areas surrounding AI and LLM safety, reliability, and governance. By providing a unified axiomatic foundation and CI/CD‑enforceable invariant, it offers...

The field of AI safety1 has traditionally focused on individual agent self-preservation, the theoretical risk that an autonomous model might resist shutdown to ensure its goals are met. However, as we move toward complex multi-agent systems MAS2, a m...

The proliferation of Large Language Models LLMs in production environments has unlocked unprecedented capabilities for automation, content generation, and personalized experiences. However, deploying these powerful models without adequate safeguards ...