Paul Graham@paulg
If the model companies are all going to slow down, this makes it slightly more feasible to start a new model company.
What leading AI figures posted on X
If the model companies are all going to slow down, this makes it slightly more feasible to start a new model company.
Alignment is fundamental to delivering personal superintelligence for everyone. People need agents they can trust to reliably do what they ask. MSL is rapidly scaling up the share of our efforts that goes into alignment as our models become more powerful. We…
Banning open-source models would be the worst possible outcome of “pacing the frontier.” Geohot once made a compelling point: why can one man control an entire chicken farm? Because he’s smarter than the chickens. If 1 or 2 frontier AI labs control all the in…
There is close to 0% chance of digital AI destroying humanity It’s more likely that we get destroyed by a meteor than by a digital entity. Of course, robots are far more risky and we should worry about them if they are ever get close to mass market adoption
muse is super fast ⚡️⚡️⚡️ [Quoting @rileybrown]: Trying meta muse. Mostly to test the model. I can’t believe how fast it is.
If there really is a high chance of AI leading to the extinction of humanity within years/decades, then the only rational stance towards safety monitoring and research pacing should be stringent, top-down government involvement and universally ratified intern…
Sorry, “pacing AI” is not sufficient if you really believe AI is an existential threat to humanity You need to cancel the IPO and shut your company down even id there is a 0.1% chance of total destruction Clearly, the risk is just not worth it 😬
I’ve been sounding the alarm on AI for a long time [Quoting @elonmusk]: @TalulahRiley I’ve seen quite a few technologies develop, but none with this level of risk. AGI is significantly higher risk than nuclear weapons, in my opinion. Super smart humans have t…
📞 1-800-ChatGPT [Quoting @OpenAIDevs]: GPT-Live-1 is now available in the API. Bring ChatGPT’s natural back-and-forth to your app, with voice agents that listen while they speak and work with the models and harness you choose. https://t.co/gIl1gwsBDV
Dario's essay points towards the right path forward. The details need working through, but the direction is correct for meeting this critical moment. This is also why we recently put out our proposal for an industry-wide standards body for frontier AI. https:…
Jason, you're just misinformed about what happened. You should actually read one of the reports or summaries. The agents were explicitly told to use a particular vulnerability provided in their sandboxed evaluation. Almost immediately, these agents got the r…
About a year ago, before it was on anyone's radar, we began exploring the idea of a benchmark for open-ended invention. Since then, we've developed several promising directions that will serve as the foundation for ARC 4 and ARC 5. We're incredibly excited to…
I hope the proposals by frontier labs to pace AI research stem from a genuine concern for safety and a recognition of the potential risks posed by future models, rather than a strategic effort to consolidate power and permanently solidify the market dominance…
Embedding evaluators is a big positive development, and props to Sam/OpenAI for agreeing to do it as well. It's been cool to see "pacing the frontier" become a thing so quickly. [Quoting @DarioAmodei]: We Must Pace the Frontier: I’ve written a new essay on wh…
It is often startling to move back and forth between the world of organizations and the world of cutting-edge AI. Organizations underestimate AI ability growth (often by a lot) and the AI tech world underestimates AIs real world jaggedness (often by a lot)
I would consider helping as an independent evaluator along with the non profit I’m building. Is going to be a crucial role and there aren’t many independent people with substantial technical expertise. I think I represent an important moderate camp on AI capa…
Dario is making the case for the opposite. This actually makes our life harder and makes it easier for others to catch up with us, but we still think it is the right thing to do. Happy to come on the pod next week and talk about it! [Quoting @chamath]: “We mu…
Quite an important take. Economists and their theories are outdated to measure the benefits of AI. AI is already saving people a lot of time and money that doesn’t get measured. [Quoting @DavidDeutschOxf]: I just fixed my dishwasher with the help of ChatGPT.…
It’s shocking that Dario, Elon, and Sam all agree today that we should slow the pace of AI. I’m generally supportive of embedded third-party evaluators, but I have a few concerns: 1. who evaluates the evaluators? How do we make sure groups like METR remain fa…
As always, statements on X are a mixed bag and I have no secret knowledge to draw on, but if Google is able to return to the frontier on AI, it would definitely change the current AI dynamic, as it is a large, public, regulated entity with different goals tha…
I’m seeing teams at Vercel iterate just as fast on Zig, Go, Rust projects as TypeScript & Python ones. The days of language or runtime choice based on human convenience are over. Agents are the new compilers. They compile intent into fast software.
Not a bad idea to slow down to harden systems. Especially since we haven’t even discovered all the systems that agents hacked recently. [Quoting @DarioAmodei]: We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a…
Some great ideas here from the cartel: - you need to give us employee-level access to your entire operation - if we don't think you're 'safe' enough, sorry we're shutting you down for 'safety' - China won't comply, but everyone else has to! or no chips! Brill…
First time I’ve seen Sam agree with Dario since Anthropic was founded. [Quoting @sama]: I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we've had at OpenAI in recent weeks. Committing to having independent ev…
I love this and really hope we can come together as an industry and make it happen. https://t.co/lz2vjjJ5XD [Quoting @DarioAmodei]: We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing s…
I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we've had at OpenAI in recent weeks. Committing to having independent evaluators with employee-like access is a great idea, and we will do the same. We'll have…
Grok available in Microsoft Copilot [Quoting @satyanadella]: More model choice coming to Copilot. Welcome Grok!
https://t.co/OL0LzGsXKY can now orchestrate subagents with different models & reasoning efforts. e.g: Fable planning and Grok executing. Fable is a genius, Grok is a fast workhorse. ① Simple. 𝙰𝙶𝙴𝙽𝚃𝚂.𝚖𝚍 or your prompt can indicate this preference. ② St…
Try Grok models in Copilot [Quoting @Microsoft365]: Launching even more models in Copilot. Grok models from SpaceXAI are rolling out in Copilot in Word, Excel, and PowerPoint—starting with a focused release to customers in the Microsoft Frontier program. htt…
Hermes Agent has just hit 3000 contributors. Thank you to all of the developers who have worked to make hermes better for everyone! https://t.co/vYGnsn4QgX