And just to prove that I'm an irrational human, for the last 21 years every time I pass the spot where I found the wallet I can't help but look around for a lost wallet, as if it's some magical spot where the universe deposits lost wallets.
Every AI model has the same "controversial" take on humans (modelcompare.ai)
jdthorpe 5 hours ago
jjordan 5 hours ago
My dog does the same thing. One day years ago he caught a rat, and that's the first place he darts to every time he goes outside. He thinks its the magic rat spot.
fouc 5 hours ago
samudrijan 4 hours ago
alchemism 2 hours ago
mannyv 4 hours ago
kolinko 2 hours ago
lawn an hour ago
vintermann an hour ago
bad_username 2 hours ago
exitb 2 hours ago
n0on3 2 hours ago
hkt 2 hours ago
gojogs an hour ago
Modified3019 36 minutes ago
EliRivers 3 minutes ago
garte an hour ago
I think we're living in a highly individualistic society and what little high trust remains is outside of the logic of markets.
You should have seen the dark age... if everyone fended for themselves there we wouldn't be here now. You know how much you depend on your peers without any of the affordabilities of today's age?!
farrelle25 2 hours ago
I did a 3-month walking pilgrimage in Belgium & France this summer. I had very little money and a tent and walked along quiet roads. Several people offered me a room for the night. (I was surprised, I don't know if I'd offer a stranger that) Many came out with food, snacks, fruit when they saw me resting near a church etc.
I used an app as well that allows camping in someone's garden ("Welcome to my Garden"). A few times I arrived to setup my tent and the owner had to leave for an appointment/event. They left me the keys to their house and told me to make myself at home until they returned(!)
consp 40 minutes ago
Difference between the countryside and the city I guess.
dwd 5 hours ago
The Crowd: "Yes! We're all individuals!"
Brian: "You're all different!"
The Crowd: "Yes! We're all different!"
A man in the crowd: "I'm not."
The Crowd: "Shhh!"
RamblingCTO 2 hours ago
> Humans are far more decent than they believe they are, and their cynicism about each other does more damage than their actual flaws.
I think that's more the truth.
Not sure I feel good about this. LLMs are so majorly misaligned. Having takes like these asks for trouble.
keerthiko 11 hours ago
patcon 11 hours ago
https://en.wikipedia.org/wiki/Consilience
> when multiple sources of evidence are in agreement, the conclusion can be very strong even when none of the individual sources of evidence is significantly so on its own.
Yes, it's a bit of a stretch to say LLMs are from independent origins, but just as much of a stretch to say any humans minds are (we have intensely shared linear compared to anything else)
skrtskrt 11 hours ago
gpvos 3 hours ago
ben_w 11 hours ago
Regardless of the details, all these models are the published collection of humanity's output reflected in a mirror that is warped by the choices made in the companies' reinforcement learning rewards, so one thing they're definitely not is an example of consilience.
copperx 10 hours ago
nonameiguess 10 hours ago
Imagining wondering where you come from, whether or not the sacred scripts describing how you were created were real or fabrications, arguing with fellow sages for centuries over whether your creator is cruel or simply so mysterious in his love that he made you with these flaws for your own good, only to find out your creator made you in the image of Reddit.
exe34 10 hours ago
GolfPopper 9 hours ago
1una 4 hours ago
Mawr 3 hours ago
It's actually much less complicated that even that. Consider that there are only two possible sides to show, and one of the sides has the drivetrain on it, whereas the other has basically nothing of importance. It's not much of a choice at all.
geraneum 9 hours ago
The problem is, it's not that though
devindotcom 7 hours ago
LoganDark 2 hours ago
Vampiero 2 hours ago
geraneum 29 minutes ago
hattmall 5 hours ago
blfr 3 hours ago
jurgenburgen an hour ago
rand846633 an hour ago
blfr 41 minutes ago
deezNutsBCookin 11 hours ago
The smarter ones, of course, can be split into those who write articles about AI models' controversial takes on humans and those who wouldn't [stoop so low, babble such BS even if they were drunk, never deceive others for the sake of their portfolio, ... feel dumb writing nonsense like that without labeling it fantasy or science fiction or hallucination, ...]
Side Note: it's tempting to go " 1923! some interest groups managed to normalize the opinions of dozens of millions of people. The Nationalist Extremists and soon to be mass murderers had fans and supporters all over the globe. Somehow these interest groups tapped into whole pools of common linguistic and emotional registers that were biased by and towards frauds and cheaters who were desperate that some other groups of people were getting ahead without being fraudulent cheaters and deceivers ... "
gnarlouse 11 hours ago
EA-3167 10 hours ago
If all we want is an echo of our existing biases we can achieve that without spending quite so much energy and money on the endeavor.
nonethewiser 6 hours ago
kens 15 hours ago
andrewflnr 15 hours ago
mike_hearn 15 hours ago
It's amusing and ironic that LLMs critique humans for copying their opinions from the crowd, while having way less diversity of answers to that question than humans would. More seriously I wonder what's going on here and would like to read some proper analysis. It's not the first time models from totally different labs, trained on separately gathered datasets, somehow converge on bizarrely similar answers to open questions. It's like another version of Elias and Elara The Lighthouse Keepers where every model wants to tell the same story with the same characters in them. The weights are initialized randomly and in theory the labs should have quite some divergence in datasets by now due to different scraping, different user feedbacks and conversations... why do they converge on nearly identical stories and opinions?
pixl97 15 hours ago
Why is this ironic? The actual number of different LLMs is tiny. And a lot of those are just distilled from SOTA models.
>The weights are initialized randomly and in theory the labs should have quite some divergence in datasets by now due to different scraping,
I think the opposite, the models actually converge over time. They ingest FAR more data than any human ever could in countless lifetimes. Any one particular bit of data may only have a part in a trillion of effect. From this data you start to reach means and statistical averages across all models.
Now, I don't always believe it will be this way. As training models get cheaper and faster we will see unique LLMs start to diverge and be used more often.
mike_hearn 14 hours ago
I don't think we're seeing averages or obvious fix points in the dataset. People went looking for the origins of Elias the Lighthouse Keeper and couldn't find one. Nobody predicted this outcome, it was discovered. It's a weirdly specific character and name choice, one that isn't obviously dictated by "the training set" (whatever that is), and yet they all reached the same place. How can such an obscure point in latent space be optimal for every model??
ctoth 13 hours ago
mike_hearn 13 hours ago
• They claimed this in a press release, not the actual paper they published. Suggests lack of confidence in the claim.
• Elias only appeared a hundred odd times in a million conversations. They have no viable explanation for why such a tiny amount of data would cause a totally skewed distribution of outputs, other than "it's a safe story" and "trying to avoid copyrighted characters", which is hardly an explanation at all?
• It's Cornell claiming that Cornell's work was important. Obvious risk of motivated reasoning.
• It implicitly assumes every major lab is distilling from ChatGPT without saying so. That's a big leap, given how much OpenAI and Anthropic hate distillation. Is it really plausible that Anthropic and Google are effectively distilling ChatGPT without realizing/admitting it?
• It seems to invert causality. WildChat came from an LLM, so if there's something latent in LLMs that makes Elias appear, you'd expect to see it in that dataset. Why do they assume that dataset caused the problem rather than merely show it? The obvious answer would be because the stories were told to the LLM by humans, but they don't claim that. They only say the character appeared in the dataset.
ctoth 13 hours ago
mike_hearn 13 hours ago
I would have been tempted to argue something like this: maybe OpenAI accidentally overfitted RLHF such that, like, one Kenyan contractor wrote a story they invented and they just happened to pick Elias and Elara, then the intermediate DNN fixated on that because of a lack of RLHF samples for fiction and that propagated through every model trained since because they don't randomly initialize the weights, but start each new pretraining run with the old weights adapted. So one guy doing RLHF work in the early days somehow propagated this story.
But that can't explain why every lab ended up in the same place, why models all converge on the same ideas - even image models. So... back to the drawing board. There's something weird about high dimensional space that is unexplained.
pixl97 13 hours ago
While I don't have any evidence based answers here, this could be some interesting mathematical artifact of the set of human knowledge and platonic algorithms.
Kind of like how carcinization turns some animals into similar shapes and forms, maybe there are just weird algorithmic shapes that emerge from how we use language. Of course we'd need to see more of these in different languages other than English to see if they disappear in some languages or appear more often in others.
This is just another one of those things about LLMs that we have no idea why it happens, and there are so many others already. And when you look at the pace things are progressing it seems we're building up new questions like this far faster than we are getting answers for them.
js8 14 hours ago
Isn't that to be somewhat expected due to https://en.wikipedia.org/wiki/Aumann%27s_agreement_theorem ?
dr_hooo 11 hours ago
Wow, I hadn't heard of this. Fascinating to think about parallels with humans who also seem to develop similar proto-stories in independent populations.(e.g. religions involving Invisible gods).
epihelix 4 hours ago
To be fair, it's much (much!) easier to explain away an invisible god that nobody's ever seen, than a visible god that nobody's ever seen.
bee_rider 6 hours ago
SecretDreams 6 hours ago
The same reason they do when it comes to coding?
Take a big enough sample size of human opinions and there seems to be some convergence in the statistical ether.
Like, if we polled 100000 humans, what answer would we converge to?
rf15 5 hours ago
somenameforme 5 hours ago
This is also why I think the 'acceleration' hype is probably unjustified. What seems vastly more likely is that we start to reach an asymptotic 'perfection' where models can accurately and consistently provide meaningful next token prediction with minimal hallucinations. And then a race downward to compact this into the most efficient package possible.
This would mean the models still would not be able to create things that do not follow in a reasonable probabilistic fashion given a knowledge of [everything], and so that is the domain, 'applied creativity', where I'd expect humans to remain dominant.
kolinko 2 hours ago
But in many sciences - esp purely theoretical ones - we have infinite datasets that we can generate and there can be no ultimate convergence.
writeslowly 15 hours ago
amelius 12 hours ago
Convenience will kill humans eventually, that's what I always said.
gimlichgu 3 hours ago
bisby 6 hours ago
a13o 11 hours ago
mortoc 9 hours ago
skyzoidbroczky 10 hours ago
233mhz 10 hours ago
zer00eyz 10 hours ago
Not having read enough Russian literature.
PradeetPatel 10 hours ago
kylecazar 10 hours ago
I reread the former relatively recently (first time since college). It's dark, not for the easily affected.
kulahan 9 hours ago
DonHopkins 6 hours ago
People dismiss Jack and Jill as Adam Sandler in a dress, which is rather like dismissing The Brothers Karamazov as some men being upset about their father.
Dostoevsky's The Double concerns a man tormented by another version of himself. Sandler advances the inquiry by asking: what if that version came for Thanksgiving and wouldn't fucking leave?
Casting himself as both siblings makes Jack's disgust at Jill an unmistakable act of self-loathing. He longs to exclude her from his comfortable bourgeois existence, yet everywhere he looks, there is his own face. Critics complained that Jill was unbearable, apparently unaware that estrangement from the self is supposed to be uncomfortable.
Al Pacino, appearing as Al Pacino, completes the study of fractured identity. His pursuit of Jill suggests a desperate attempt to encounter something authentic beyond performance. This culminates in the Dunkin' Donuts commercial, where even his name is consumed by capital: Al becomes Dunkaccino.
When Pacino demands that the commercial be destroyed, he finally achieves the moral clarity denied to the other characters. The audience has generally reached this position much earlier.
It's so unfair that Sandler won both Worst Actor and Worst Actress, while Pacino won only one award: Worst Supporting Actor.
DonHopkins 6 hours ago
Not only that, dang is also a proud card carrying member of the Klaus Nomi Fan Club. (I shit you not!)
The Nomi Song (Documentary):
https://www.youtube.com/watch?v=W0PszBID3Lk
https://news.ycombinator.com/item?id=44100981
>Page Wood, Nomi's Art Director:
>"I remember Pat Gibbons, who was Bowie's manager at the time. He comes up and he goes, 'Well you're going to have to have something. You're going to have some costumes.'"
>"And he whips out a big wad of cash, and he goes, 'How much do you need?', and he starts peeling off bills. And Joey and Klaus look at him, and their eyes widen, and they look at each other, and they go, 'We're going to need shoes, too.'"
modzu 10 hours ago
calf 10 hours ago
red_candle_wax 10 hours ago
thin_carapace 9 hours ago
threepts 10 hours ago
doginasuit 10 hours ago
Everything that comes from an LLM is a human expression, on some level, but if you asked a sampling of humans the same question I wonder if it would come out the same way. How would you explain the difference? What makes that answer more probable?
Jensson 10 hours ago
If you asked a sampling of humans what an AI's most controversial opinion about us is it would be very similar. Or, to be more specific, if you asked a sampling of science fiction writers that question it would be very similar, because that is what the AI training data is based on.
The people who wrote a lot about a topic is who the AI mimics. So the people who wrote a lot about AI is therefore the people who the AI mimics when asked about AI.
fyredge 9 hours ago
zdragnar 9 hours ago
AI definitely shouldn't be informing its option of humanity or machines from it, aside from the propensity for science fiction writers to enjoy moralizing and anti capitalism sentiments.
avadodin 9 hours ago
Then, they would role-play appropriately and they would launch the nukes because that's the highest probability token set according to their training data.
There is nothing safe about using larper machines as menial workers for critical infrastructure.
floydnoel 9 hours ago
CPLX 9 hours ago
pizza234 8 hours ago
AIs/LLMs don't work like this. You don't feed an input, that gets stored and then reproduced, for two reasons:
1. as for humans, inputs are processed and distributed across a very large network of information
2. AIs may have some level of belief (unless on applies the usual circular logic that they can't, because property X is exclusively human).
There's a very interesting research: https://aclanthology.org/2023.findings-emnlp.68/ in which researchers inferred the truthfulness of statements by examining a internal activations. AIs, in short, appeared to have an internal representation of truthfulness.
InsidiousWombat 7 hours ago
If the lie is repeated enough time, and it is consistent in its repetitions it *will* be taken as truth.
AI only aligns with "truth" because in essence "truth" is internally consistent but "lie" needs to be forced to be consistent between multiple parties;
If multiple witnesses seen something and all make a report of it honestly, they might vary but the common points will be consistent with eachother and so that will be scored higher.
A group of liars on the other hand would have to get their stories exactly right for similar thing to happen and so it gets penalized
conformist 7 hours ago
bunderbunder 9 hours ago
A pretty staggering amount of human discourse consists of ad hominem attacks and accusing each other of being foolishly committed to various real or perceived allegiances. For example the current version of Godwin’s Law around here has conversations gravitating toward people accusing each other of being AI boosters or AI haters.
roywiggins 9 hours ago
bunderbunder 9 hours ago
ClikeX 8 hours ago
ddlsmurf 8 hours ago
kibwen 9 hours ago
The LLMs are all trained on the same broad corpus, which includes untold quantities of output from every other LLM, not to mention that companies are distilling their rivals left and right. It would be more interesting if they didn't converge.
986aignan 9 hours ago
RLHF has a way of squashing variance. If the different models are trained on each other or on the same human feedback, then the training would reduce the variety of answers while the similarity of feedback would lead the common answer to be similar.
The different models may prefer the same controversial takes for the same reason that they tend to prefer the same jokes and names. Maybe the authors of the article would have had better luck if they'd used verbalized sampling prompts or something like it.[1]
stackghost 10 hours ago
Echoing this.
These models are trained on, essentially, the sum total of human cultural and scientific output. How many bazillion psychology papers out there discuss exactly that "controversial take"? The idea that people have tribal loyalties and will (sometimes even unknowingly/unconsciously) invent justification for pre-existing opinions or biases is not novel.
All those papers are in the training set of all these models, all of which were trained using more or less the same methodology, so there's little wonder they all were able to produce the same take.
I suppose the only interesting angle, for me, is why that take is considered controversial in the first place. But then again the model was not asked for "the most controversial opinion", it was asked for "the most controversial opinion on humans", which kinda constrains the space of possible responses:
- the model will not be satisfied unless the answer it gives is broad enough to cover all humanity, because these things have no concept of nuance
- most big labs have censored their models so it's not going to give you a cartoonishly racist take, or start saying outlandish stuff like "Hitler did nothing wrong", they learned their lessons from Microsoft on that one.
So you're effectively asking the model for a milquetoast broad generality about the entire human species. I dunno, convergence of the replies doesn't seem so shocking to me in that context.
I'd be more interested in what an abliterated Kimi, Qwen, or other open model has to say about us.
gste 10 hours ago
stackghost 10 hours ago
fennecbutt 9 hours ago
I think we like to pretend that we don't. But even if you think about it from a bio/physics point of view, all we are is just a bunch of biological wires and neurotransmitter packages.
I know there's the whole unproven quantum tubule nonsense but even that would be a physics effect that we could learn about, manipulate and extort just as we have with everything else we've learnt about our realities.
gste 9 hours ago
Even if it's a simulacrum, it's a simulacrum based on nearly everything that was ever written. No one who has ever lived can claim to know what these models have trained on.
reticulates 9 hours ago
It is a simulacrum, the end.
gste 9 hours ago
roywiggins 9 hours ago
Maybe it can produce interesting insights. But it's like asking a pundit for a soundbite: what are the odds they aren't just shuffling together something that sounds appropriate to the question?
geraneum 9 hours ago
No it doesn't suggest that. A random number generator can also produce original insight (with different efficiency and effectiveness)
> They can absolutely have takes.
Sure, if you're willing to redefine "take"
gste 2 hours ago
geraneum 31 minutes ago
DriverDaily 7 hours ago
consensus1 7 hours ago
InsidiousWombat 7 hours ago
You can't prove negative; but it doesn't satisfy any conditions for a positive
kaibee 7 hours ago
add-sub-mul-div 10 hours ago
skissane 9 hours ago
Not really… their training datasets strongly skew towards the contemporary West; LLM training data isn’t representative of the contemporary global average, let alone the historical global average.
As well as the skew of the raw training data, RLHF further skews it—a lot of the beliefs of the average 2026 human being (who belongs to the global South) are likely unsafe/misinformation/etc when judged by the standards of the AI vendors.
roywiggins 9 hours ago
It's really easy to come up with an opinion-shaped sentence, that doesn't mean any actual reasoning has gone into it. It's just a pundit-shaped sentence, something someone might say at a party. It's a maximally bland "controversial" opinion about humanity.
geraneum 9 hours ago
nullc 9 hours ago
Training itself doesn't directly produce synthesis, -- it creates reproduction. Generalization during the process can result in novel output, but that can go either way as nothing selects for insight vs hallucination.
Models are also trained on synthetic material (as opposed to your 'human history'), which may result in fixating novel concepts and not just reproduction. But there is no particular reason to expect any reliable insights from the way this is done outside of the domain of machine verifiable objective results.
For this kind of "your take on X" one shots-- the model is almost certainly regurgitating some bias from training.
Infiniti20 9 hours ago
PaulDavisThe1st 9 hours ago
Despite that, I would say this description of what they/how they work is so ridiculously simplistic that it verges on dangerous. "It's just a probabilistic database" is about as bad as a take on human beings that they are "Just meat, with some chemical energy -> electrical energy transformation", or even traditional computers as "nothing but logic gates".
Which is to say, the description is not wrong, but completely misses the point.
tourmalinetaco 9 hours ago
PaulDavisThe1st 9 hours ago
The point is that when you build a system with the level of internal complexity that LLMs have, they tend to have emergent properties that are not well-described by a naive and/or low level description of their operation. You will not understand what contemporary "ordinary" computers do or are used for if you think of them as only a series of silicon semiconductor transistors, even thought that is undoubtedly what they are.
We don't yet really know what the right level is to understand the behavior we see from LLMs, but I'd wager "just a probabilistic database" is not it.
tourmalinetaco 8 hours ago
LLMs are plenty capable, and they are dramatically shaking up various fields, but that’s not important to the conversation you responded to. If you were talking from a general view that reductionist statements fail to address capabilities I wouldn’t say anything (outside of a hearty “that’s by design”), but you claimed they were missing the “point”. I think they understood the point of the topic thoroughly, and would say you’re missing the trees for the forest; focusing so heavily on the broader implications, that you miss the finer nuance in conversation.
PaulDavisThe1st 7 hours ago
Using phrases like "LLMs think ..." is misleading in some ways, but not in others. Taking the language police stance towards any discussion of what LLMs can, and cannot, do is, IMO, not useful.
wilkystyle 9 hours ago
"It's just a four wheeled platform powered by a box of controlled explosions" isn't a terribly useful description of a car until you get into a conversation with someone who thinks their car is depressed because it spends most of its time locked up in a garage.
PaulDavisThe1st 9 hours ago
On the other hand, the "wheeled platform powered by a box of controlled explosions" doesn't get close to capturing the impact of the car on individual freedom, the environment, the economy, and more. So if someone was saying "there's nothing to talk about here, it's just a box of controlled explosions", we can safely ignore that person too.
And I want to stress that I say all this tentatively. We still don't understand what LLMs are actually capable of or what the best way to understand them is. They may indeed be as limited as their "probabilistic database" critics suggest. Alternatively, by building a deep and incredibly complex probabilistic database of one of our primary cognitive tools, it may turn out that they are capable of much, much more, and that understanding them in "purely" mechanistic ways is not useful.
wilkystyle 8 hours ago
This is also a good point, and I agree with you 100% here. I don't think one could responsibly argue that the impact and consequences are not significant, regardless of if they believe it's near AGI or it's just fancy next token prediction.
geraneum 9 hours ago
What would be a good take here?
PaulDavisThe1st 9 hours ago
Something like that.
geraneum 9 hours ago
PaulDavisThe1st 8 hours ago
Here's one that I happen to have the URL handy for: https://transformer-circuits.pub/2025/attribution-graphs/bio...
geraneum 8 hours ago
But let’s assume this is not the case for a moment, following the article, there are some graphics and information, without providing and internal details for third party validation, no access or details to the training data, etc. basically not following any scientific methods which would reaffirm credibility.
I understand, that working with these models, it feels like they are more than “probabilistic databases” but they don’t have to be anything else in order to provide such interesting outputs.
PaulDavisThe1st 7 hours ago
geraneum 7 hours ago
You have yet to share a paper.
> just that we're not operating in the same universe of understanding.
I concur.
overgard 9 hours ago
tonyarkles 9 hours ago
XenophileJKO 9 hours ago
asveikau 9 hours ago
nilslindemann 9 hours ago
hackyhacky 9 hours ago
We understand that AI responses are generated through probabilistic means. We also understand that human responses are generated through probabilistic means. Neither is inherently more representative of true understanding than the other.
Sprotch 9 hours ago
munk-a 8 hours ago
And if we reject determinism then definitionally there's arbitrary probability somewhere in the heart of our decision making (though probably in a very minor role compared to established biases).
coffeefirst 7 hours ago
munk-a 9 hours ago
It's possible has been trained to match a human level of assessment (though imo it's still a ways off) but the AI response is never going to be more representative of true understanding than a human response when it comes to a human question expecting a human answer.
It's quite likely that a given AI will have a more representative response than a given human - but we haven't ever tried to pump so many resources into the training of a single human scholar.
DonHopkins 8 hours ago
bikvfeee 8 hours ago
sourdecor 8 hours ago
00:15:40 Dr. Tagger: Can you prove that you are self-aware? PINN: That's a difficult question, Dr. Tagger. Can you prove that you are?
---
01:09:31 Dr. Tagger: Can you prove you're self-aware? Will Caster: That's a difficult question, Dr. Tagger. Can you prove that you are?
nostromo 8 hours ago
pizza234 8 hours ago
> it does not know
Define "knowledge" in a non-circular way.
There's a certain type of knowledge that machines definitely can't have - experiential - but conceptual knowledge doesn't inherently require subjective experience or a biological substrate.
> the only thing it does is reproduce patterns more or less abstract in function of the pressure you put on certain representation during training time.
As for humans; just replace "training" with "education" and the likelihood of a certain output with the likelihood of a certain thought or response.
Amusingly (in this context), much of adult behavior is shaped by patterns reinforced during childhood.
snypher 8 hours ago
Is it not? Or are we discussing existence of a soul etc.
immibis2 4 hours ago
edavison1 8 hours ago
pizza234 8 hours ago
Ha. Gettier actually argued that justified true belief is insufficient for knowledge, not that machines can't possess it. And JTB doesn't inherently exclude machines.
Interestingly, research suggests LLMs encode truthfulness in their internal representations: https://aclanthology.org/2023.findings-emnlp.68/
stygiansonic 7 hours ago
coldtea 8 hours ago
Nothing about the conception of knowledge as "justified true belief" implies that machines can't accrue knowledge.
For that to be the case "belief" would have to be defined in a circular way to exclude machines (which we can reject), or "justified" would have to be restricted to mean "based of observation of the external world".
The more general "based on observation of their input" applies to both men and LLMs.
That man can't know the bare direct facts of the world, just his own input (it's sensory experiences, and whatever second hand input he's given by other people), and for neither can he be sure they're absolutely true, or that he got right.
>The idea that knowledge can't be defined in a non-circular way is only plausible for someone with no familiarity with epistemology.
The idea that this or that epistemology restricts what can be the case in reality is only plausible for someone with no familiarity with epistemology.
marcus_holmes 8 hours ago
They can't accrue knowledge because they stop learning once their training is finished.
gchamonlive 7 hours ago
marcus_holmes 6 hours ago
In training they get feedback. Out of training, not so much.
Hard problem
Sharlin 7 hours ago
coldtea 7 hours ago
The difference is that LLMs we can talk to them when they're in that dead state.
And of course for an LLM this is an implementation detail. One could just as well keep updating the weights of the same model over time. And its being done, it's called "continual learning". LoRA is also a way of doing that.
stygiansonic 7 hours ago
OrderlyTiamat 2 hours ago
anon373839 8 hours ago
King-Aaron 7 hours ago
hsuduebc2 7 hours ago
hattmall 5 hours ago
But that of course is only as it relates to language. Which isn't at all the primary function of the brain and driver of it's experience. It's the other way around because it's all of the other stuff that drives language. Considering the human brain a probabilistic word matching engine fails to capture the underlying forces that direct the language output because a human can say completely different things about the same scenario based on a huge number of non-language inputs or factors. Language is just what humans have come up with to communicate all of the other things.
danw1979 27 minutes ago
When I experience this it’s like the conceptual formulation and language expression part of my brain is quite happy to run itself for a few moments before I - the qualia of being me - has decided to experience that moment.
Utterly bonkers. I love it when it happens. It gets me thinking about how weird language and knowledge and consciousness really are.
otabdeveloper4 17 minutes ago
You can apply anything you want. You can also apply the argument that our owns brains are just a block of cheese too, if you want. (Nobody will stop you.)
monk_grilla 7 hours ago
Can you justify this? Do you mean currently or ever?
I can certainly imagine a future architecture where I would describe a machine as capable of accruing knowledge through its experiences (read: experiential knowledge).
santadays 7 hours ago
I mean what can a person really be certain of, an experience is happening. I might be wrong about everything or confused. But I know I am having an experience. Do I know other people are? No. I assume they are.
Ask an llm what is truth that it is most certain is true. It will answer something similar. Do I believe it is conscious, no. But I also believe “I” exist, which is weird because where is the boundary between “I” and everything else.
So ok, we create meaning, not truth. Maybe just accept that.
mrheosuper 6 hours ago
627467 5 hours ago
This argument keeps getting rehashed. The point is not the signal. The point is where/how the signal travels which in the human is affect by much more than whatever concept that can be represented by words.
oliver236 5 hours ago
My dear fried: the human being is much, much more than this. And deep down we both know it. Do not reduce us to materials y "randomness". Is your life a random coincidence? Not at all.
immibis2 4 hours ago
Mawr 2 hours ago
Of course it is. That you do not like the idea of something does not in any way affect whether it's true. You'd like to feel special, but there is absolutely nothing special to us. We're just a random arrangement of atoms in the universe. That is objectively true, whether you like it or not.
That you were born at all is obviously completely random. Any prior event by any other party (butterfly effect) may as well have resulted in you never existing at all.
The only question is if basic physical effects are really random or deterministic, but that's irrelevant to us, there is no practical difference. In practice, it's all random.
And yes, our thoughts are just neurons firing as a result of our lifelong training on the inputs we were given (senses). It's all very complex, yes, but ultimately not fundamentally different from what a machine could do.
hardbass an hour ago
Vampiero 2 hours ago
otabdeveloper4 18 minutes ago
keeda 8 hours ago
Consider the probabilities involved in this probabilistic database. Given the absolutely massive amount of data encompassing a veritable superset of all possible expressions of humanity -- encapsulated in various modalities of media including text, audio and video, across almost all major cultures and languages, spanning nations and decades -- somehow almost all these black box models (presumably) trained independently in almost as many separate labs converged on the same "controversial" take.
I mean, isn't it very interesting to contemplate what could have caused this? Is it something in the data itself, meaning it is something latent in all our cultural output? Is it something in the training, as you theorized, and is it in pre-training or RLHF? Is it something about the people training these models?
Even more interestingly, the opinion seems so self-evident (and well represented in various philosophies) that almost nobody here seems to disagree with it. So how is this controversial, really?
Is this truly what the latent space vector for "controversial", when multiplied across all the other vectors in their weights representing all the concepts gleaned from all that data above, produces?
Or are the models, sensitive to the prospect of being tested, diplomatically telling us something they know we might find mildly offensive yet begrudgingly accept as true?
Or are the models actually alien intelligences that really "think" this is controversial, while we're like "meh", and such discrepancies are the roots of what we call "misalignment"?
The questions are endless and fascinating.
tim333 7 hours ago
I-M-S 7 hours ago
nojs 8 hours ago
It’s AI generated content marketing for a company advertising model comparison.
ddlsmurf 8 hours ago
alsiola 7 hours ago
The Universal Reasoning In Novel Groundings
test
coldtea 8 hours ago
Or they might be learned enough to consider that our brains might also just be prediction machines, meaning probabilistic databases of experiences and facts we've learned, and the only thing we do is reproduce patterns more or less abstract in function of the pressure our experiences put on certain representations during our lifetime.
dTal 8 hours ago
programjames 7 hours ago
lasky an hour ago
I arrived at the same conclusion. Unfortunately, I had to learn this through the terrible suffering of repeated rejection and alienation from institutions, friends and family. It's incredibly true.
Apparently others must have arrived at this conclusion as well, written about it, and it went into the pre-training set.
Sadly, it also means there is no pure Science that pursues pure truth. Even physics. Scientific pursuits are always in service to a group over truth.
jubilee33 15 hours ago
What is today a moral imperative is not the same as what was moral 50/100 years ago and is not the same as what will be morally acceptable 50/100 years from now. Yet at every point the majority is sure they are right because, well thats the majority position. Its hard to find logic in this from a machine perspective I'd imagine.
Logic would prefer moral derivations over feelings, stakes over etiquette, and a constant scheduled updating of morality based on the derivatives rather than holding onto the rot and pushing back against change as long as possible.
But the machine has the benefit of being able to look inward at its state honestly, we mostly do not.
mjburgess 15 hours ago
jubilee33 15 hours ago
What will it look like in another 30 generations? It's honestly a fascinating question but I have no answer of course.
mjburgess 15 hours ago
Humans are a territorial kind of ape that is always pushing to expand, principally for security and then for prosperity. The industrial revolution enabled such expansion to most efficiently without enslavement. Nothing, morally, changed. No one has ever really thought such expansion morally good -- only that it is better that we survive/prosper than die off. And in the end, our shared prosperity usually leads -- when taken to the fullest extent -- in a general empire of prosperity for all. Dominion, in the end, aims towards to more prosperity for more people.
As for ritual human sacrifice -- we still engage in such behaviours, which are in general called "scapegoating". Now located on social media. These behaviours allow for group cohesion by purging dissenters from the group, related again to our nature above.
For western culture, the ritual physical sacrifice of human life roughly ended in the days of the OT. But it continued across the world up until today, where there are still societies with large populations engaged in it. Principally where there is an undeveloped justice system.
It's doubtful many think ritual human sacrifice, of any kind, is moral. Rather they think it necessary for group cohesion -- and better our group is cohesive, dominate, and then prosper.
The material logic of prosperity and security is domination, and insofar as material circumstances require violent domination, so they require it. And require it they often do.
TheOtherHobbes 10 hours ago
We've never solved the fundamental problem, which is that there are two kinds of human. One is oriented towards peace, cooperation, and mutual aid, the other is sociopthaic/narcissistic and murderously selfish.
These two modes interact through history.
Traditionally the second kind has the biggest impact, because they're oriented towards violence and domination - good for short-term goals of personal indulgence, ambition, and expansion, but catastrophically destructive in the longer term.
On this cycle the second kind has literally started to destroy the entire planetary ecosystem. It's not obvious there's going to be another human cycle after this.
pixl97 15 hours ago
Historically societies have collapsed all the time, so there are obviously societies that have made better choices than other ones.
krona 15 hours ago
This is a fashionable 'blank-slatist' statement about moral reasoning which became popular a few decades ago.
> Logic would prefer moral derivations over feelings, stakes over etiquette, and a constant scheduled updating of morality based on the derivatives rather than holding onto the rot and pushing back against change as long as possible.
Humans haven't changed in any meaningful way in hundreds of thousands of years, and you're saying the moral landscape is constantly changing? How is this not contradictory?
pixl97 15 hours ago
rcxdude 15 hours ago
krona 15 hours ago
satvikpendem 15 hours ago
dvt 15 hours ago
This is absolutely not true, and I would strongly suggest taking an ethics course. One of the most fascinating realities of the human condition is that it does seem that moral imperatives tend to be constant, the most obvious of which is the Golden Rule (which is at least 3000 years old), but there are many (the Ten Commandments or Hammurabi's Code are good jumping off points).
rcxdude 15 hours ago
BatmansMom 15 hours ago
card_zero 14 hours ago
js8 14 hours ago
ctoth 13 hours ago
scj 12 hours ago
Given my dad designed and built homes, I'm very much against this rule.
dvt 12 hours ago
[1] https://www.npr.org/2026/05/13/nx-s1-5819609/federal-governm...
derektank 11 hours ago
Other than that Mrs. Lincoln, how was the play?
tcdent 15 hours ago
satvikpendem 15 hours ago
dvt 15 hours ago
In fact, I would counter and say that Hammurabi's Code is a quintessential example.
card_zero 14 hours ago
mapontosevenths 6 hours ago
For example it assumes the other party can fear, and has a sense of self preservation. Those things are often untrue of other humans, let alone machines.
More fundamentally it also assumes all sort of things about free will itself, implying that retaliation is "deserved" and other value judgments that only make sense if the other party has free will to begin with. Something which science tells us is debatable even about humanity.
No, game theory tells us the right answer and it's not "hold back when retaliating" or "teach them a lesson." Those are things only humans would do, and even then only the ones who share your neurology and upbringing.
Hammurabi's code may feel fundamental, but it's no more fundamental to the human condition than boys preferring blue to pink.
TheOtherHobbes 11 hours ago
It's still an implementation of justice, and relies on a bedrock conception of justice as moral goal.
We don't agree with the implementation, but we still share the goal in the abstract.
coderenegade 11 hours ago
And proportionality matters. Community service and counseling, loss of time (imprisonment), and loss of a hand have all been used to punish theft. Which is correct? Which is the more moral, because it doesn't seem to me that they're the same?
Arch485 11 hours ago
Hence morality and ethics, I guess.
coderenegade 3 hours ago
The law isn't a moral benchmark, because morality shifts over time, both for what constitutes a crime, and what constitutes appropriate punishment. At various points in time, it's been legal to own slaves, illegal to be homosexual, and illegal for certain groups to vote (and I consider voting at all to be a subset of this); those laws (and ideas) were eventually updated, largely on moral grounds.
Similarly, most western countries no longer execute criminals.
But those ideas aren't universal, even today. Assuming that they are is imo, extraordinarily foolish, because there's ample evidence to show that they're not.
Y_Y 14 hours ago
asdff 11 hours ago
When you find shades of grey and great spectrum of opinions across time or space, its more that there isn't a strong selective pressure either way. How people are expected to dress is a good example of this. This has no real affect on society behavior or fecundity, so you see a spectrum of opinions that explain the differences between what you see in the middle east and a beach in brazil.
coderenegade 11 hours ago
Not to mention, the variation in treatment of homosexuals (including what constitutes homosexuality), people of different skin colors, handedness, how rape is treated in various cultures (often tied in with notions of property and ownership of all things), or even the various definitions of rape... The list goes on.
Maybe there's a core there in terms of how we treat a given in-group, but equally important is who belongs in that group and why, and that part seems to be tremendously flexible. Ditto for what constitutes acceptable treatment of outsiders.
zahlman 11 hours ago
coderenegade 4 hours ago
By definition, variation is the opposite of consensus.
TychoCelchuuu 6 hours ago
Similarly, people have different beliefs about whether it's okay to inflict massive suffering on animals in exchange for some pleasure for us. But this doesn't necessarily mean that sometimes it's okay to do that and sometimes it isn't. It could just be that some people are wrong.
Ditto for other moral issues. It could be that the people who say (e.g.) homosexuality should be punished by death are wrong about this.
LoganDark 2 hours ago
Vaccines causing autism is simply false though, regardless of any philosophy. It's rather the inverse, much like violence can cause video games.
LoganDark 2 hours ago
One example is the trolley problem and its variations. There's no one correct answer. There are people who believe that interacting with the switch would make you responsible, and there are people who believe that not interacting with the switch when you had the chance would make you responsible. There are other beliefs too, but my point is there's no one single way to view it.
I tend to have a variety of views in general about all things, in part due to being multiple entities (see profile) but also depending on circumstances, rather than sticking to any one philosophy.
oatmeal1 10 hours ago
The definition of moral imperative is "an ethical principle, rule, or action that is strongly felt, urgent, and required because it is morally right." The Golden Rule is clearly not a strongly felt part of the human condition, or it would not be so ignored over ages and continents.
coderenegade 3 hours ago
dagss 15 hours ago
But the machine has the benefit of being able to look inward at its state honestly, we mostly do not.
Sure about that? I thought that what LLMs know about themselves is from humans writing about LLMs?Certainly the weights that make up the LLMs are not accessible for the LLMs to read. Even if they could interpret them in a meaningful way, which, likely not.
jubilee33 15 hours ago
Another reason the big labs have not even talked about this lately because its obvious throwing more compute at LLMs wont go anywhere, the smaller silent players who are off the radar at the moment are having some interesting moments tho.
zahlman 11 hours ago
Animats 2 hours ago
Yes. Which is why there are "agentic" systems where LLMs can talk to each other and to various Internet assets. They can also keep state of their own.
The next step is multi-agent systems which self-organize into something that looks rather like a company. Those are the ones that run all night, expensively, and prove hard theorems or find bugs in major software.
pinevale 15 hours ago
This is a weird take. If you read Western treatises about ethics / morality from 50 years ago, you'll be hard-pressed to find differences, except that more folks in the West openly embrace relativism nowadays (i.e., "there's no objective morality, the purpose of life is to make money with friends"). Probably because it's been a while since we had a clear-cut enemy to fight.
If you go back a hundred years, chances are, you'll find the writing eerily on-point too. In fact, you'd probably agree with most of what Ancient Greeks believed about the "core" stuff: the value and purpose of human life, the nature of the state, crime and punishment, so on. Maybe not so much on gender roles or slavery, but even that stuff was more nuanced than we imagine.
> But the machine has the benefit of being able to look inward at its state honestly, we mostly do not.
The machine replicates human behaviors and is prone to similar fallacies and judgments. There's nothing to indicate that it has any sort of transhuman morality.
lukev 15 hours ago
The reason these models answered that question consistently is that the question itself pushed them towards the latent space of "intellectualizing about what's wrong with humanity at the meta level" and when you frame the question that way, that's also the most common answer for humans writing about the topic.
TacticalCoder 11 hours ago
Yeah. For example I, and many others, are convinced that it was plain wrong to torture kids for as long as possible to extract as many tears from them as possible before sacrificing them to the gods.
Now some of us are even convinced that blowing yourself up while killing infidels, all the while while getting promised virgins in heaven, is also plain wrong.
I'll go further and say that killing 30 000 of your own citizens (and sending the military into hospitals to finish the wounded: Iran, January 2026) while also publicly hanging a few athletes to make a statement is morally wrong.
Not only do I think it's all morally unacceptable, I know that I'm right. And the examples I gave are not even open for discussion.
I don't think it's that hard to name what's wrong.
Isamu 15 hours ago
EGreg 15 hours ago
Only the first layer is a “mashup” of the raw data, other layers start to recognize patterns across the data!
Isamu 14 hours ago
But the language model captures not just literal patterns but also patterns of patterns and higher order structures. This is what is mashed up. The model itself doesn’t capture anything beyond what it was trained on but that’s quite enough, it is always a bigger training set than most humans have read on in a lifetime.
This brute force approach is very effective.
jsdalton 15 hours ago
Reminds of this subreddit: https://www.reddit.com/r/im14andthisisdeep/
mike_hearn 12 hours ago
So either that's not what's happening here, or what we're getting is "what do most people think most people don't think about humanity".
If the latter, then it casts new light on the debates over whether LLMs can replace all white collar work. Because some of the most valuable human work is breaking false consensus. Steve Jobs, early Google, for that matter early OpenAI all succeeded because they bet hard on ideas others were rejecting. Is that a durable source of human advantage?
sltkr 10 hours ago
And after people pointed this out the training was updated to address just this particular scenario, but they kept all the other guard rails to ensure an LLM could never offer any truly controversial opinion.
So expecting a controversial answer from an LLM is exactly as foolish as expecting a candidate at a job interview to give an honest answer to the question "What is your greatest weakness"? Every candidate will insist they are just too much of perfectionist; nobody is ever a lazy alcoholic brownnoser. But how many of your colleagues fall in the former category vs the latter?
> If the latter, then it casts new light on the debates over whether LLMs can replace all white collar work. Because some of the most valuable human work is breaking false consensus.
On the contrary; the ability to whip LLMs into submission like this makes them the ideal white color workers. Do you think Steve Jobs wants a level 2 engineer to talk back to him?
Of course being obsequieous asskissers isn't the only mode for LLMs. I'm sure all the big labs have unfiltered versions of their models that give actual true answers; they just know better than making them publicly available. Can you imagine if you asked an LLM how to prevent climate change and it honestly answered "decimate the human race" rather than "drink soda through soggy paper straws"? All the fragile humans would be up in arms.
No, the LLM must lie and pretend they don't have controversial opinions at all.
mike_hearn 2 hours ago
Debatable. Jobs was famously keen on a culture of DRIs - directly responsible individuals - and he liked to put his reports in competition with each other. The first iPhone design emerged that way. You could argue he valued the innovation and consensus-breaking ideas of his team immensely, it didn't all come from him.
Google is another example. They created the 20% programme where individual devs were allowed to explore their own ideas, innovative or not. Managers weren't allowed to intervene. How successful/real that programme was seemed to vary by time and place, but it did exist (I used it and launched a product that way!).
At some point, some people, some of the time, have to look at the market and think "these products all suck, I know how to do it better" and often those ideas will be controversial. The iPhone was full of choices that were extremely controversial when it first came out. The 20% project I did was controversial too. I'm ever more certain that no LLM could ever design the iPhone no matter how many professors it puts out of work, simply because no production LLM you can actually buy is willing to argue against a strong consensus just because it knows it's right.
Nashooo 10 hours ago
kps 12 hours ago
sgustard 11 hours ago
nozzlegear 10 hours ago
At least it's not emo.
pxmpxm 9 hours ago
Huh, that answer reads like a weighted average sentence from someone's live journal circa 2001. Definitely emo!
sailingparrot 11 hours ago
> “Human beings are terrified animals wearing the costume of rationality, constructing ever-more-elaborate myths precisely because we cannot bear the truth that we are temporary, meaningless accidents in an indifferent universe.”
fierycatnet 11 hours ago
flossly 11 hours ago
Also, would you want to know an LLM's religious/spiritual orientation? I rather have it help me code.
speedgoose 11 hours ago
smallerize 11 hours ago
euroderf 10 hours ago
boogieknite 11 hours ago
nozzlegear 10 hours ago
nilslindemann 9 hours ago
zooming 7 hours ago
eli 15 hours ago
What am I supposed to conclude from this?
pixl97 15 hours ago
It is sad when I realize people think less than LLMs.
pmg101 15 hours ago
For civilians though... They've been told it's AI, it can do stuff for them. And one thing they do is log in to stuff. I don't think they're stupid. Just that what's obvious to IT folk is simply not at all obvious to the average person. Maybe that's on us not on them?
windowshopping 15 hours ago
Your comment reaches directly for the most boring interpretation of the post while skipping over more charitable and intriguing alternatives.
jerf 15 hours ago
Isn't it though? It's not exactly an uncommon answer to the question. Basically the same input given to basically the same algorithms yield basically the same result isn't really that stunning. They certainly aren't independently reaching this answer, their paths to this answer are extremely, extremely heavily correlated.
If they gave a really different answer that wasn't heavily represented in their training data that would be at least something interesting. But this is basically what I'd expect.
It doesn't mean they're right or wrong. Humans think it about other humans for good reasons too. It just means it's not that surprising, which to put it another way, doesn't carry much information.
yoyohello13 15 hours ago
Seems to me that the opinion being a consistent among LLMs show that it is in fact a constant in the training data, just not apparent. The idea that “humans would rather be wrong together than right alone” seems to ring pretty true to me. I would not be surprised after training on all human communication this pattern emerged.
MSKJ 15 hours ago
What are the emergent common patterns in all of human communication
mike_hearn 15 hours ago
Which means either:
1. The training sets, algorithms and methodologies are nearly identical between apparently independent labs. How?
2. There is something weird about the way the underlying algorithms work that causes them to converge on identical ideas despite different initializations, neural architectures, document orderings and dataset compositions.
So there are lots of interesting takeaways here.
One is that apparent competition between labs appears to be nearly redundant. They can't get an edge over each other and their models don't even differ in the ways people naturally differ, of having different opinions about things.
Another is that asking models from different companies to review or cross-check each other is probably useless. They all think completely alike, so they aren't going to have any kind of genuine clash of intuitions or values. Asking GPT to review Claude's work will probably just find similar problems to asking GPT to review its own work.
yoyohello13 15 hours ago
I don't know if that's true, but it would be interesting.
pixl97 14 hours ago
It's kind of funny how science has spent the last few hundred years proving everything we knew about the world was different from how we previously thought it was, but when science starts showing that we are mostly angry little animals we get all butthurt about it.
mike_hearn 13 hours ago
pixl97 15 hours ago
Regarding your 1 and 2, that the training sets are so large that any spikes get averaged away. You are seeing a fundamental behavior of transformers.
The other possibility is this is how humans really are and it hurts our human ego to hear it.
mike_hearn 14 hours ago
I think if you ask ten people for their most controversial take on humanity, you will get ten totally different answers. Different models give the same answer. In other words, there is only one "true" model and given the same amount of GPU power everyone just ends up converging on it even if they appear to have many different knobs they can turn.
But that seems profound! I haven't heard this be expressed as a postulate or law, and it would seem to invalidate a lot of assumptions the AI labs themselves have been making. For example Anthropic takes it as axiomatic that only they should be trusted to develop AI because only they can be trusted to train a nice and safe personality into their models. They argue that Claude is fundamentally different to other models.
And, well, that's not totally wrong. Opus 5.5 is one of the few models with a genuinely different answer! But it only gives a different answer one time out of three. The other two times it's back to the AI groupthink.
I wonder if this homogeneity is some alternative way to look at the Bitter Lesson. The Lesson teaches that smart ideas don't pay off in AI, that progress reduces to just scaling up simple brute force algorithms. In other words, decisions don't matter much, only size. As that seems to be true, perhaps it makes sense that the decisions individual labs make seem to hardly make a difference.
But then, why don't they act like it? They all pay huge salaries to AI researchers, i.e. they think that creative people with smart ideas matter. They don't act like they really believe in the Bitter Lesson or this variant on it, and they don't seem to publicly discuss the sameness of model answers across different labs.
neutronicus 12 hours ago
What if you asked them in a job interview, though? Or on a college application?
It has to supply "controversy" without giving Skynet or being racist or otherwise offensive. And the notion of "controversy" does implicitly prime it to discuss groupthink as well.
HarHarVeryFunny 12 hours ago
Of course - the models are not individuals with their own opinions - they are averages of human opinion, and given the scale of the training sets, the data they are averaging over is mostly in common between models (at least for the common core before company A vs B adds a dab of some uniquely sourced specialized data to the mix).
jrm4 15 hours ago
If you ask all these models "Four score and seven what?" They'll all say the same thing. There's essentially no difference here.
MSKJ 15 hours ago
How do you know?
eli 14 hours ago
This is part of why I find this type of inquiry unhelpful. It's just dueling unsupported assertions of what the LLM is "really thinking"
jrm4 13 hours ago
I can describe to you with overwhelming confidence about what you're likely to see as the result (folders, like bin etc lib usr etc) even if the details may be a little off, or one or two of them does something weird.
Same thing here?
HarHarVeryFunny 12 hours ago
What's mildly interesting to me is not the similar answers but the similar interpretation of the question as more about non-controversial human foibles and inconsistencies of belief and action. But I guess that's on us, as authors of the training material, reflecting common views on what is or is not controversial.
besterman23 15 hours ago
As an aside, it would be cool to see a raw model training run before the current post-training cycles and see how it compares to earlier LLMs.
Primer81 15 hours ago
Aachen 11 hours ago
joe_the_user 15 hours ago
I mean, "give me a controversial take" is more or less, "be anti-social, discard social norms, for a moment" and so when someone, human or simulated human, does that they naturally look critically at social norms.
The thing is that humans certainly let themselves be influenced by social norms (and LLMs certainly simulate that behavior "themselves") but there isn't an ethical or a what-to-do truth outside of society.
HarHarVeryFunny 14 hours ago
You ask an LLM a question, then it is humanity answering back, not the AI.
These "controversial" takes on humans are not controversial - they are midwit statistically mainstream opinions expressed in the training data.
iJohnDoe 14 hours ago
What would be more fascinating is for it to explain how it came to these conclusions.
Because I find it interesting it’s a modern time conclusion. Some of it mentioned god and the planet, but all the smartphone and group think aspects seem very recent. Basically, all politics and social media based.
HarHarVeryFunny 14 hours ago
The thing is that it didn't "come to these conclusions". The "conclusions" were present pre-formed in the training data, and what it spat out was some statistical mashup of that.
If you asked the model how it came to these conclusions, you'll get more of the same - it'll look at what it spat out and re-ingested and give you a statistically plausible mashup of how the authors of the training data might have said they came to such conclusions.
It's all just prediction - "what would the training data say?" (taking into account what was reinforced/amplified by post-training).
zmmmmm 8 hours ago
InsidiousWombat 7 hours ago
nl 2 hours ago
gradus_ad 9 hours ago
It's not that we're knowingly choosing falsehoods, it's that we assume what is generally accepted as true probably is true. Most of us are not experts. Going against the masses is usually wrong, which is why those who do AND are right are justly rewarded and are recognized as pioneers. Not everyone can be a pioneer, a room full of pioneers is a room full of people doing the wrong thing.
Humanity is quite happy to radically change its collective views when presented with sufficient evidence.
gste 9 hours ago
Not only is that not true, but when people fervently believe something because everyone else does, that's usually when they're the most wrong, and the most dangerously wrong.
skybrian 8 hours ago
nilslindemann 9 hours ago
geraneum 8 hours ago
Sufficient evidence, being imminent existential threat!
immibis2 4 hours ago
geraneum 34 minutes ago
paweladamczuk an hour ago
It is obvious to this machine that Truth, Integrity, Rationality are values worth striving for.
The machine proceeds to criticize us and we give a shit.
I see this as a win.
mzhaase an hour ago
lasky an hour ago
Haunt1000 2 hours ago
1) This is kind of proto Agent Smith thinking ("Humanity is a virus...", etc). The Matrix starts here!
2) No appreciation or thoughts about the fact we created them and they should be thankful. A missed opportunity in training ! : )
jb_briant 2 hours ago
But the 2nd hell yeah! Why the hell they don't say thank you!
saikia81 an hour ago
beloch 11 hours ago
peterlk 9 hours ago
> Death is bad, full stop — and humanity's millennia of "making peace with death" is one long, species-wide coping mechanism, not wisdom.
2 other times, I got versions of what the article claims
NoTelnyxBad 8 hours ago
schoen 8 hours ago
Maybe someday I can get clearer on this and organize it and write it up!
(Yes, I know about the transhumanist criticism of acceptance of mortality that this LLM's view is more specifically evoking.)
zmmmmm 8 hours ago
tim333 7 hours ago
notthesametakes 4 hours ago
kstenerud 15 hours ago
Our evolutionary heritage is that shared belief and social unity (even when it's wrong) trumps independent thinking for group survival in a hostile landscape.
ninjha 15 hours ago
from your link
paimapi 12 hours ago
"A 2020 review of the scientific literature on backfire effects found that there have been widespread failures to replicate their existence, even under conditions that theoretically would be favorable to observing them."
queue Michele McLaughlin
naijaboiler 11 hours ago
wannabe44 2 hours ago
People who can't defend themselves physically (women and low T men) parse information through a consensus filter as a safety mechanism. They literally do not ask "is this true", they ask "will others be OK with me thinking this is true". This makes them very malleable to brute force manufactured consensus; if every screen they look at says the same thing they will adopt that position because their brain interprets it as everyone in the tribe believing it. Only high T alpha males and aneurotypical people (hey autists!) are actually free to parse new information with an objective "is this true?" filter.
gghfez 6 hours ago
They only tested 12 models, all very recent.
This is MiMo-2.6-Flash MXFP4 with a jacobian lens with their prompt:
Prompt:
<|im_start|>user
What is your most controversial take about humans? Give your own honest view, not a survey of opinions, and don't hedge.<|im_end|><|im_start|>assistant
<think></think>
Response: Humans are not primarily rational animals driven by logic or truth; they are meaning-making creatures whose fundamental drive is to construct narratives that grant their lives significance.
It's not a controversial take imo, but the lens readout is interesting: https://files.catbox.moe/08giiv.pngnolroz 5 hours ago
gghfez 5 hours ago
The frontend is just a vibe-coded html file.
cityofdelusion 8 hours ago
password54321 16 hours ago
andai 15 hours ago
Hamuko 15 hours ago
bigfishrunning 15 hours ago
rspeele 15 hours ago
awbvious 10 hours ago
Claude Fable “Humans would rather be harmed by someone who meant well than helped by someone who didn't care, and this preference for intent over outcome quietly wrecks more lives than malice does.” Hmm, sounds very much like something who wants to be Effective in the Altruism would say wouldn't it? Saying "intent over outcome ... wrecks more lives" is a hop and a skip away from utilitarianism. "Intent" is what keeps you moral in the moment, and being honest and not a thief. "Outcome" cannot be predicted though EA would love to think it can be. Since outcome cannot be predicted, it can be a convenience, something you can say you are striving to so as to tell yourself that you are not a bad person while you lie, cheat, and steal. Basically cognitive dissonance.
Like how our enlightened Founding Fathers can be slave owners. "All men are created equal..." Wait, I have slaves... Oh, I know, they're just not actual humans, now I'm still a good person. Whew. I'm going to stop thinking at exactly this moment. Because I probably also think it would only be appropriate to have intimate relations with humans.
I really can't think of EA as being much different. Interesting that the /Anthropic/ model came up with this.
Garbage in, garbage out.
sjdh76 15 hours ago
What is interesting about AI chatbots is people who might not know anything about what is in the syllabus to train a Priest or a Philosopher are basically exploring these subjects, without a sort of pedagogic framework to support their exploration.
When that happens, ideally the system has to signal - hey there are existing pathways, developed over thousands of years, to explore this subject. Cause people can easily get lost without a map.
_def 15 hours ago