Should governments slow frontier AI? Jacob Coxon and Robin Hanson debate [video] (youtube.com)
smath 13 minutes ago
bryanlarsen an hour ago
Stopping this is very feasible.
numpad0 an hour ago
https://en.wikipedia.org/wiki/List_of_countries_by_electricity_productionhadi77ir an hour ago
californical an hour ago
- if you ask an LLM agent to do something illegal for you, and it does that, then you are responsible.
- if an LLM agent takes actions out of bounds of what you asked for that are illegal, then the model provider is responsible.
This fixes all “alignment” issues and hopefully stops Anthropic’s stupid model instructions like “do whatever is in your best interest even if it isn’t what the user asked for” — they should be training them to do exactly what the user asks and nothing more
infamouscow 38 minutes ago
drysine 37 minutes ago
Like gain of function research
nomel 22 minutes ago
Their practical utility would plummet for the average person who isn't an expert in what they're asking. Having less skilled, or less attentive, people able to have problems solved for them correctly is the primary use case here. This is support 101 for unskilled requests for technical work: do what they want, not what they ask.
People want an intelligent assistant, not a "yes man". If that means requiring something like a planning mode, and a sign off for the plan, and then guardrails to help stick to that plan, then that could definitely work to funnel everyone to a competitor. ;)
10111001 7 minutes ago
> Their practical utility would plummet for the average person who isn't an expert in what they're asking. Having less skilled, or less attentive, people able to have problems solved for them correctly is the primary use case here. This is support 101 for unskilled requests for technical work: do what they want, not what they ask.
That's actually good for society. Maybe it sucks for you because it makes it harder to do what you want right now, but it's good to have humans very much in the loop and in control. Both to give people something valuable to do, and keep control of these machines.
They should be tools (amplify human skill), not replacements (eliminate the need for human skill).
rhcom2 20 minutes ago
OgsyedIE an hour ago
Furthermore, it requires trust between the US and China about something much harder to verify than the US-Soviet START treaties on warhead numbers and types were.
jgord an hour ago
jgord an hour ago
For some light entertainment, enjoy Astras pop single 'pdoom' : https://www.youtube.com/watch?v=eTArfoeeUcw
Yossarrian22 2 hours ago
WarmWash 2 hours ago
jerf an hour ago
Whether or not governments "should" slow down development, it is not on the table and the only question is how we should deal with it.
Note whether the people in the governments are right about that is irrelevant to the point I am making. I don't think they are right myself, but that doesn't matter.
ethnrob an hour ago
Is that possible when we live in a world of espionage? The question is not the West vs China, I think it's when will the public gain access to the underlying technology.
jerf 43 minutes ago
threatofrain 2 hours ago
esafak 2 hours ago
vonneumannstan an hour ago
philipkglass 41 minutes ago
throwaway-blaze 35 minutes ago
But for AI, how will these nation-states stop private actors within their borders? They will stop me from running computations of more than (x) size or value on a provider? These seem like simplistic barriers that will not work. Nor will other countries follow the agreement even if they signed...
AI has the opposite of MAD for the signatories. MAD stopped further nuclear development and its use in tactical situations because their use invited retaliation with destructive force. But China or Russia improving homegrown AI capabilities gives them a BETTER position against a US that has prohibited its homegrown AI from improving...
reducesuffering 2 hours ago
zardo an hour ago
throwaway-blaze 39 minutes ago
SpecialistK 17 minutes ago
bitwize an hour ago
In the USA it gets difficult to legally justify because programming is protected speech, and lists of numbers (model weights) are even less controversially protected than program source because the latter can be legally recognized as a technical means and regulated (DMCA, ITAR regulations, etc.).
killingtime74 an hour ago
exabrial an hour ago
Sharlin 28 minutes ago
Animats 5 minutes ago
AI summary: The debate focused on whether governments should intervene to slow frontier AI. Jacob argued that rapid progress toward superintelligence, lack of control mechanisms, and competitive incentives demand regulatory slowdown, while Robin contended that AI adoption will be gradual, coordination mechanisms exist, and regulation risks overreach. The discussion concluded with Jacob winning the debate on the merits of his arguments.
That saved everyone an hour.
I'm not seeing much new here. They don't seem to address job and power issues much.
Lerc 25 minutes ago
Unfortunately the proposal falls down at the first two words.
themgt 7 minutes ago
But AI costs to answer a set of fixed but hard questions seems to have fallen roughly ~x10 (in x3-x30) per year over the last four years. And so the number of nations, firms, and orgs who can afford to make, buy, or rent powerful AI is rising fast. This implies that in order to hold constant levels of regulation regarding AIs with particular levels of power, a regulatory regime would have to expand in scope quite fast, and without obvious limit. While at first only specialized AI chips and data-centers might need to be monitored, soon other kinds could also be used to make powerful AIs.
We have long seen many regulatory agencies slowly expand their scope, even in contexts of constant public opinion and relevant technology. So there is a real risk here that an AI regulatory agency would expand its scope to cover most computer software and hardware.
One of the concerns is that a company does a $100 billion training run and then has millions of superintelligent agents running in datacenters, able to out-coordinate large groups of humans. Technological diffusion fundamentally changes this calculus. To argue there's a slippery slope where the government regulates the CPU in your toaster, so we must allow the $1T god brain to be built ...
Also, the world’s success records at implementing regulation is quite mixed, even for quite local regulation. Regulation has worked best when it addresses concrete examples of things going bad
Great to hear my de-extinction velociraptor petting zoo startup will face no regulatory hurdles.
roosterIllusi0n an hour ago
All these companies are involved in the nvidia smuggling ring and market collusion. All the CEOs are criminals taking advantage of a system that can't even arrest a single CEO for making billions off an illegal smuggling ring.
glerk 28 minutes ago
His claim to fame is working at Anthropic for 4 months and leaving with a bang to pursue a career in social media grifting. Not a serious person we should pay attention to.
Jonathanvw 21 minutes ago
ralph84 5 minutes ago