The task of auditing a business is extremely complicated by virtue of data/information being all over the place. AI had not gotten to a point of where it could outperform humans but in this experiment they find out a group of agents are good enough for this task. I still think there are so many poorly defined tasks that auditors just understand implicitly, eg data discovery; before the audit even starts, that humans will always be needed to initiate and conclude audits just like software projects.
AI agents ask better questions than KPMG accountants in audit trial (europeanbusinessmagazine.com)
prometheus1992 42 minutes ago
mannyv 37 minutes ago
I expect for 80% of the audits AI will be 'good enough.' And those are the bread and butter for the public accounting firms.
datsci_est_2015 27 minutes ago
The difference is important because I don’t want idiots out there reading this comment and drinking the KoolAid, believing that an entire client’s audit activities can be blindly automated.
Just like a self-driving car’s entire drive can’t be blindly automated, even though X% of the maneuvers that the car has to perform can be automated.
nonethewiser 23 minutes ago
But in terms of executing on the check list I think it would consistently do much better.
If you have every asked AI to investigate some sort of mystery - like something no one truly knows the answer to - it is very good at gathering information and even forming good hypothesis. I've done this and when it usually gets to a dead end or gives up, you can find facts that it shares and ask more questions: "You said X and Y. That makes me think of Z, which doesnt directly have to do with anything we talked about, but could it shed any new light?" Etc. Just making connections and sparking new avenues to explore.
I have so say, it's really, really fun to use AI for this sort of thing. To investigate novel problems. Doesn't have to be full on scientific research. You will see that you can really spark progress by just making observations.
echelon 35 minutes ago
And it's true.
We're getting to a point where you don't even have to look at the code anymore, and I'm serious.
> AI had not gotten to a point of where it could outperform humans but in this experiment they find out a group of agents are good enough for this task
The more this is done, the better it gets. Especially as more resources are poured into making it better.
It's only a matter of time before AI auditing is the common practice and humans are the backup for the AI.
dev_dan_2 26 minutes ago
nonethewiser 14 minutes ago
gimlichgu 5 minutes ago
trentnix an hour ago
nonethewiser 12 minutes ago
You could state this much more strongly even. It's the entire industry, not just KMPG.
origini 2 hours ago
And every year a new human comes along and has to learn all of it again.
Of course ONE AI agent and teaching ONE AI is massivly in an advantage as soon as its as good as the avg person in the job and it blows everyone else out of the water as soon as it gets a tag better.
lazide 2 hours ago
It’s literally a monoculture.
For example, if an iteration of the singular AI ends up being crashable with a magic visual pattern or QR code (highly likely at some point), that is a major national security risk if that AI is piloting aircraft, as the entire nations aircraft could be taken down by anyone projecting said image in it’s visual plane until the fix gets pushed.
And these systems are far too complicated to exhaustively test all possible inputs before release.
There is a reason why nature rarely has such monocultures - that live for very long, anyway.
origini an hour ago
Its a possible as an attack vector for sure.
But in comparision to nature, compute can speedrun all of this with RL.
disgruntledphd2 39 minutes ago
Even a lot of what software professionals do isn't verifiable.
onefiftymike 21 minutes ago
joshAg an hour ago
[1]: https://www.who.int/teams/integrated-health-services/patient... [2]: https://en.wikipedia.org/wiki/Battleshort
KolmogorovComp an hour ago
lixtra 34 minutes ago
[1] https://www.solist.blog/pilots-did-not-invent-checklists-in-...
datsci_est_2015 24 minutes ago
One of the most misinformed things I’ve read on Hacker News recently. That’s not how any of this works.
Has the average quality of discussion plummeted since the advent of LLMs and every tech bro starting to comment wildly out of their depth?
chilmers an hour ago
On the other hand, with AI we'll use reinforcement learning to create agents without such evolved-in tendencies. Where (so long as we can solve alignment and cheating) they are trained to do the job, no matter how much effort it takes, or what's involved.
wongarsu an hour ago
They are less lazy than humans though
jtmarl1n 41 minutes ago
disgruntledphd2 37 minutes ago
chirau an hour ago
AI labs were working with companies like Mercor for more than a year paying the consultants and accountants themselves from these very firms a good amount per typical task they work on everyday, some even providing actual documents.
The expectations were more rigorous, and the rubrics pretty expansive. so yeah, the agent trained from tens of thousands of consultants would eventually ask better questions than an individual consultant.
marconey 2 hours ago
I think this is the source FT article
edoloughlin 12 minutes ago
and
> "one AI agent failed to correctly match regulatory requirements with the company’s documentation"
This is a depressing pattern. The AI can bury you with the volume it produces, forcing you into cognitive surrender. Then it makes the dumbest of mistakes that you're too overwhelmed to spot. Luckily for them, that one didn't make it to the client.
bell-cot 2 hours ago
Most famously - https://en.wikipedia.org/wiki/Enron_scandal
Is anyone in this space, to speak to whether AI agents asking "better" questions is a benefit, vs. a bad product-market fit?
RobotToaster 2 hours ago
method_capital 2 hours ago
The reason these things happen is compliance is paid for by the company. The Enron account was massive, so auditors incentives are misaligned.
fernmyth an hour ago
Topfi 2 hours ago
fidotron an hour ago
disgruntledphd2 34 minutes ago
hectormalot an hour ago
I know some people in the big four world. At least here (NL), it’s prohibited to be the auditor and provide consulting services at the same time.
disgruntledphd2 34 minutes ago
Like, there are a lot of problems with auditing as currently practiced, but to imply widespread corruption is entirely wide of the mark.
Once upon there used to be a Big 5, they are now four because of one case like you're describing
jordanb an hour ago
TrackerFF an hour ago
The very first time I ever worked with a McKinsey consultant, he turned out to be a jr. consultant half year into his gig at McKinsey. In all likelihood a really sharp and ambitious person, but extremely junior when compared to the domain experts (with decades of experience) in the same room.
shye 2 hours ago
johndhi 2 hours ago
devindotcom 2 hours ago
hall0ween an hour ago
munk-a 2 hours ago
letmeguessok an hour ago
pembrook 2 hours ago
JumpCrisscross an hour ago
To be clear, this describes the vast majority of coding.
pembrook an hour ago
I'm not trying to denigrate accountants, I'm just amazed that this is a headline finding in 2026.
I guess for industries heavily tied up by regulatory norms and regimes it doesn't matter how much better AI is at the job. Hence why Anthropic's claims of 15% GDP growth are unserious childlike predictions from nerds who have never interfaced with the world outside silicon valley.
The ThinkPad army will be manually typing business buzzwords into their powerpoint presentations for another 10 years still, regardless of how fast the actual tech is moving.
letmeguessok an hour ago
Rules, rulings and following them. I have an extremely hard time coming up with something that requires intelligence but lacks rules and rulings. The rules and ruling might be complex but they are always there even if in the background (like in, say, visual arts).
JumpCrisscross 37 minutes ago
No. Not currently.
> Rules, rulings and following them
Does not describe an auditor's role in the context of litigation.
> rules and ruling might be complex but they are always there even if in the background (like in, say, visual arts)
Uh, sure. Q.E.D.
arctic-true an hour ago
rithdmc an hour ago
redwood an hour ago
There are many downsides to this in that business cannot ever be perfect and a sample-based regime is useful because it allows for a few mistakes here and there it's not waste everyone's time at audit time
So similar to cybersecurity where you're going to need to apply AI offensively and defensively I suspect we'll see the same in accounting
jsty an hour ago
But even moving from sampling to an exhaustive analysis, the time-wasting mistakes could still be rejected as non-material (i.e. too small to care about). If it wasn't possible to automate this, I doubt an exhaustive approach would take off.
jdw64 2 hours ago
j45 2 hours ago
The accountants will not have this ability to use AI because their fantasy of managing and overseeing IT wasn't able to be handled.
bigstrat2003 2 hours ago
Very much not my experience (which is also why I don't believe the claims in this article). My experience is that when trying to troubleshoot issues with LLMs they are prone to make wild leaps and insistently chase down esoteric edge cases, in situations where a human would start with common solutions first.
joe_the_user an hour ago
...
I think AIs can ask good questions and lead a person to important insights.
But they can also fail to ask "obvious" questions and get stuck at points that an average person wouldn't be stuck in.
Which makes them for adversarial processes - like auditing or hacking. But no so good at producing defect-free software or planning without guidance. With guidance, they're great aids in this too. But when people AI processes to "turn off their brains" or act autonomously, then you get problems. And you get a lot of pressure to very lightly if at all scan AI output when AI investment is supposed to show productivity gains.