Discussion about this post

User's avatar
Alexander McCoy's avatar

I appreciate you writing this, but as someone who is actually leading a team *fighting for* the regulation you say is needed, it is hard for me to get over the fact that the big Labs and their executives are certainly not ACTING like they want safety rules to solve the collective action problem.

Instead, they’re funding a political operation of unprecedented scale that is singlemindedly opposing ANY safety rules, seeking to overturn existing ones, and wielding hundreds of millions of dollars of super pac spending to intimidate all policymakers from going anywhere near the issue of AI safety. One in four federal lobbyists in Washington DC are currently employed by tech companies to lobby on opposing AI regulation. The forces that have been arrayed to explicitly prevent us from solving this problem are unlike anything I have ever seen, and I don’t think people in tech realize it.

If people in the Labs actually want safety rules that apply universally, then they need to do two things:

1) raise dissent within their companies over the actions of their government affairs teams and political action committees funded by their executives. Challenge the reassuring empty words being said at all-staffs and on Twitter about the leadership’s “good intentions” and contrast it with the concrete actions of the mercenary lobbyists and political operatives they have hired that say the exact opposite.

2) donate to pro-AI Safety organizations like Humans First, which are operating explicitly in the political/legislative advocacy domain. All the technical solutions and white papers don’t matter a jot if nobody will implement them. This is the high leverage, under-exploited area of AI safety.

Will Kiely's avatar

> But just because an argument is self-serving doesn’t mean it’s wrong. Critics refused to accept that two things could be true at once: (1) The CEOs have a financial incentive to make the claim; and (2) despite that incentive, it really is true that the frontier labs can’t afford to slow down because if they do, a worse actor will take the lead.

Good recognition of the fact that just because an argument is self-serving doesn't mean it's wrong!

I noticed that Karen Hao made this intellectual mistake *twice* in her recent Diary of a CEO podcast interview from last week, (1) when she dismissed the idea that AI poses an existential risk by saying that AI company CEOs profit by promoting this idea, and (2) when she dismissed the idea that scaling the current LLM-based AI paradigm will lead to AGI by saying that AI company CEOs profit by promoting this idea.

33 more comments...

No posts

Ready for more?