Dream-1 (dreamlabs.ai)

167 pointsby GaggiX15 hours ago76 comments

dumberquestions 14 hours ago

Tested one prompt in the playground ("Move the elephant next to the ball") and this is the generated recorded video link:

https://dreamlabs.ai/playground/?play=a05f0e641559490e#sim

ajjenkins 14 hours ago

Interesting. It actually moved the ball next to the elephant, but I guess that accomplishes the goal of the elephant and ball being next to each other. But probably not how must humans would interpret that prompt. And it continued to move both the elephant and ball after that for some reason.

Hopefully this is like the first GPT models and it gets better over time.

wand3r 13 hours ago

Yeah. I didn't want to be rude, because real people building things they are passionate about is a great ideal. However, it is REALLY starting to feel like 1999. There is a new paradigm with clearly amazing potential, but we do not have all the pieces in place to execute on the forward thinking ideas, much less the businesses. Just imagine if that robot arm destroyed a ton of super expensive machinery. It was an extremely fair prompt, very clear and very simple instructions. Also, 90 Million to tweak an AI model to not achieve a task in an unvalidated market? IDK if that is too harsh and I just don't understand? There is 100% chance that myself or Dream-1 is out of touch, but I am concerned I can't tell which is which.

mapkkk 12 hours ago

I tried "Make a matryoshka out of the appropriate objects" https://dreamlabs.ai/playground/?play=c3ed4d011f05ce94

Approximately the same result as your run. But it was interesting to see that the idle arm seems to have these rhythmic movements across all the prompts I saw on there. Also that one arm, the left one most of the time, is just idling.

pedalpete 11 hours ago

I wonder if the entire thing would be better if the first step was for the LLM to try to understand the final goal of the user, rather than just the simple instruction.

For instance, the LLM may have an understanding that the ball is easier for it to pick-up than the elephant (which it seemed to struggle with, which also made it a strange choice for the demo).

How much of an LLM understanding the physical limitations of the robot would help the task be accomplished in a way that satisfies the goal, without following the exact directions.

Aurornis 14 hours ago

This is all very cool and something I would like to play with. However I also can’t mentally bridge this over to the actual automation, manufacturing, and warehouse work I’ve been involved with throughout my career. Everything about this looks optimized for getting-started tasks to play around with, but I’m left feeling that it’s not the right fit or even a good starting point for real automation work.

Everything about this page strikes me as having been optimized for investors, not customers. Why would they cite a literal toy as a leading example of automation work? It doesn’t make any sense unless they’re maximizing for what investors remember seeing in headlines, not what actual automation customers would be interesting in paying for.

I think the product they’re selling is their equity, and their target customers are acquirers. The demos and the model feel like marketing material for that highly specific goal, but they forgot to include enough about how it could be useful to anyone.

hdz 13 hours ago

From a consumer standpoint are two arm robots ready to do anything useful yet for us? From your experience.

Folding laundry seems like one but then quickly falls apart the more I think about it. Not sure what else.

ethanj8011 14 hours ago

Obviously AI written text. At least there is real content here, however I do find the order and the way in which it was written and portrayed to have a heavy AI smell. That is, it's hard to read and follow the clean narrative, it isn't written the way a human who was trying to convince another human would write, and is less effective because of it.

drum55 14 hours ago

It's weird to spend all this time making a product and then just throw up something you had a LLM regurgitate. Any amount of human written content here would have been better, even if scribbled on the back of a napkin to show that the product had anybody care about it. A blog post, post-LLMs, can exist entirely in a vacuum away from anybody believing in it.

fn-mote 14 hours ago

Totally untrue. They have a lot of videos showing robots performing tasks with their system driving. That’s not fake LLM content.

drum55 7 hours ago

I didn’t say it was fake, I said nobody cared enough about what they were making to write a paragraph saying why. Being excited about your product, what if can do and why you made it is very different to promoting “make a blog post about this in a boring corporate style” and going to lunch.

jampekka 11 hours ago

Building products is a different skill than writing about them. And if you write just "back of the napkin" people will complain about it even more than about an LLM version. Writing polished content is hard and takes a lot of time and skill.

Routine8502 9 hours ago

People used to complain about back of the napkin posts because they signaled low effort. The same is true about LLM blogs. A back of the napkin blog signals more effort than slop.

drum55 8 hours ago

A back of the napkin post means at least one person had interest in its authorship to put down their drink and write something, the LLM made blog posts are a show that zero people had interest in its authorship enough to put down some words.

besterman23 14 hours ago

This post feels really weird, DreamLabs isn’t some well known project like Anthropic or OpenAI and Dream-1 wasn’t really an awaited release.

But somehow this was pushed to the front page of HN before receiving a single comment with a title reminiscent of a major LLM release. Like I can only find 1 other reference historically to this lab and nobody noticed it or cared.

tgrowazay 14 hours ago

There are PR agencies that take care of your content to be trending. They do use fake accounts to upvote and manipulate, but you as a customer don’t have to know that.

jelloroll42 13 hours ago

Occam's razor it's more likely the mods or YC has some social or other connection to the project

CamelCaseName 13 hours ago

Occam's razor would suggest that mods simply thought that it would generate insightful discussion, and manually pushed it up, something that dang regularly does and a core feature of HN -- and that is assuming it was pushed up in the first place.

jelloroll42 10 hours ago

This is the place where dark triad sam altman got his start; let's not be pollyannas about how things work around here.

walrus01 13 hours ago

I'm certainly not a mod or affiliated with YC and I've had random things I posted briefly end up on the front page. Then if people keep upvoting it, they sometimes remain there...

jelloroll42 10 hours ago

I'm not accusing you of anything. It's well known that the front page is heavily curated and not purely the result of upvotes.

computomatic 13 hours ago

Wouldn’t it just be easier to ask their team to upvote the post? They probably all have legitimate hacker news accounts already and are happy to upvote their work.

bertt 12 hours ago

Not really.

GaggiX 14 hours ago

I posted it after I discovered the model on https://robocurve.org/

I discovered the Robocurve benchmark after someone on X was saying that Kimi K3.1 Pro was performing particular bad on it.

Anyway I found the model particularly interesting because I think it's the first time I see an API for a random bimanual robot. Also HN removes "Introducing" so it's just the name of the model.

besterman23 13 hours ago

Sorry I don’t mean to specifically point you out, I believe you’re being genuine.

However this comment got me thinking. Whats up with all the YC backed benchmarking companies? I know there’s only a few, but what is the business model for companies like Robocurve exactly?

computomatic 13 hours ago

I came across this recently and was initially surprised too. It makes sense when you consider that any company trying to build models (or an agent/value-add layer on top of a model) needs benchmarks. The best funded will do the full vertical - build their benchmarks and models together - but many will outsource the benchmark. This is particularly valuable when the dataset is difficult to compile (robotics being a prime example) - it makes more sense to let the benchmark vendor focus on that.

besterman23 12 hours ago

Sure it’s useful, but I’m asking who actually pays for this. Sort of a conflict of interest if you’re providing public testing for the companies paying you for the tests no?

Perhaps it’s purely for VC so they can judge which model is best? Also seems a little too conflict of interest-y, but that might just be too cynical.

dmix 11 hours ago

> Robocurve raises $10M to independently evaluate frontier AI in the physical world

that would be an interesting business to run.

smallerize 14 hours ago

It only takes a few upvotes to get any story to the front page briefly. And on Saturdays there is just less competition.

modeless 13 hours ago

It does seem weird. In my experience HN generally shows little interest in robotics research, so I'm surprised to see this up top. I'm biased but I think Physical Intelligence's recent announcement is more impressive, with greater diversity of robot embodiments and more impressive real-world tasks in real workplaces. https://www.pi.website/blog/api-beta

GaggiX 13 hours ago

This one as I read it is a bit different, the Physical Intelligence API requires finetuning for the task/robot while the Dream-1 model offers an API that can do zero-shot (with great limitations of course but still cool).

modeless 13 hours ago

If you look at what they actually demonstrate, zero-shot embodiment generalization is limited to controlling two-finger grippers on two stationary arms. The embodiments are all very similar, and when they're slightly different (even just replacing two fingers with five fingers) they can't do zero-shot anymore. But there's no real reason to do zero-shot embodiment generalization in practice, as it's trivial to collect a small amount of data on a new embodiment to get significantly improved performance. Zero-shot embodiment generalization, especially in such a narrow domain of similar configurations, is not an important problem to solve and doesn't necessarily indicate progress on the important problems.

Zero-shot task generalization is more interesting, but has been demonstrated by many other companies at this point, so it's not new. And it only becomes useful with high success rates on long-duration tasks, so demonstrating short zero-shot tasks with low success rates in toy environments is uninteresting.

What's hard and still unsolved in general-purpose robotics is doing real useful tasks end-to-end in real uncontrolled environments with high reliability. I guess there's just a lack of understanding generally about what's actually hard and useful in robotics.

fwlr 13 hours ago

I upvoted it while I ruminated on what I wanted write as a comment. It could have been a “multiple people are typing…” moment.

beernet 12 hours ago

So essentielly comments from simonw? Sounds like what you describe

jere 12 hours ago

Random Wikipedia articles make it to the front page all the time. What’s so weird?

nine_k 11 hours ago

Is the story worthy of being on the front page? I assume that being already famous is not a prerequisite.

schleck8 11 hours ago

1. Well funded 2. Cool idea that hasn't been widely tackled yet. Most action models are accompanied by hardware, Like Figure's Helix

cyanydeez 11 hours ago

3. Probably a investment vehicle by a HN admin

soundworlds 11 hours ago

Yeah, from my experience HN must be pushing "trending" topics to front page and not pushing others.

There are huge numbers of new posts - the ones that reach front page are definitely not the only ones with that amount of upvotes.

halJordan 7 hours ago

You think that claims of an actual honest to god working robot is somehow so out of sync with this audience that we need to be so cynical we call it a conspiracy? Am i literally the only one who's wanted a Robbie of my own since i read i, robot as a kid?

prometheus1992 14 hours ago

I don't like the direction this is going in - so a third party is going to be able to control a robot in my house?

we shouldn't aim for economies of scale on this problem as there are massive negative externalities attached to it. Hopefully, a chinese lab will release an open source version soon.

lifeisloving 14 hours ago

how are you going to afford a house when you're competing against $3.00 hr labor?

Unironically there's lots of companies who will clean your house for free right now, but their staff get to wear cameras while they do it. People dont seem to care.

fn-mote 14 hours ago

The $15,000 to get started with the bipedal robot takes a long time to amortize a way.

lifeisloving 13 hours ago

Thats like one year of payroll taxes for a lot of jobs. And thats just one aspect of burden

Im completely against all of this just fyi, but the capital owners are certainly going to try and cut out as many humans as possible. Get ready for lots of poverty, crime and generally a worse society in <20 years.

p1esk 13 hours ago

how are you going to afford a house when you're competing against $3.00 hr labor?

You rent a couple of robots who will build it for you for $3/hr.

saretup 14 hours ago

I’m sure once this category has traction and investments coming there will be open source models too.

amelius 14 hours ago

SaaS -> RaaS ?

plutomeetsyou 13 hours ago

What do you mean by "negative externality" in this case?

wolttam 13 hours ago

Xiaomi-Robotics-1

gradus_ad 14 hours ago

Their "breaking the flywheel" strategy is predicted on people using their enabled robots in real world tasks. And from the demos it looks like they are unusable for real world tasks.

fn-mote 14 hours ago

The only toroidal bar of soap I have ever seen in one of those demos.

amelius 13 hours ago

Looks like they are not solving any hard problems yet, but just want to launch a platform so they can be acquired for big $$$ once a community finds working solutions.

amelius 14 hours ago

I think this is a bit too ambitious. Let's first have 1 robot reliably do things. And only then generalize.

jmugan 6 hours ago

I tried "throw the block off the table" but it wouldn't run for some reason I didn't catch, safety maybe?

Narciss 10 hours ago

Tested one prompt, "put the crown on the cup", it was partially successful: https://dreamlabs.ai/playground/?play=d8fb67a01cb5ba50

atleastoptimal 13 hours ago

What happens when robots can perform all manual labor better and cheaper than humans, and AI can perform any task on a computer better and faster than humans? Will everyone politely accept losing their job and hoping that their UBI payments will be enough to preserve their old lifestyle?

dmix 11 hours ago

> The Cambrian explosion of cheap, affordable robots

That's a good way to describe it

baalimago 13 hours ago

How is this cheaper than (sadly) one of the 1/1,000,000,000 humans who can do the same?

at1as 11 hours ago

I read this as "Dream S-1"

It must be that time of the cycle again...

andai 14 hours ago

> Imagine two Microducks folding your laundry, using their beaks as grippers.

arctic360 13 hours ago

So we’re one step closer to Judgment Day then. Nice.

Krei-se 14 hours ago

Getting my meals prepped, flat cleaned and laundry folded is getting closer!!

I'm looking forward to robotics a lot because solving menial tasks will have a huge class impact as we can stop looking for ways to keep a portion of society suppressed and dumb.

One can dream, right?

andai 14 hours ago

You mean we can finally ban TikTok?

bigyabai 14 hours ago

Menial tasks and gig workers aren't going away. If home robotics pans out, then those workers will have their wages suppressed which will prevent them from reinvesting into a college education.

jfengel 13 hours ago

Unless the college professors become so comfortable that they can afford to just give away college educations.

I don't like utopianism and I'm certainly not going to plan on a best case scenario. But I can't help a tiny fraction of my brain that says "There are ways in which it could turn out well." Probably not, but the existence of a best case scenario feels like it should mean something.

Krei-se 12 hours ago

That's actually what i already encounter, if you show interest in a field and put in the work the old academic moat turns from keeping you out to guard the precious knowledge into "well we put that up so you too can work in peace".

Also to pick up your conflict - when there are 2 possible outcomes you don't know yet - planning for the worst will have you lose either way, but planning for a good one (not best as this would mean to do nothing) leaves you with a positive chance.

fhars 14 hours ago

Well, the whole point of the current AI boom is about finding ways to stop keeping a large portion of society employed, so in that sleep what dreams may come must give us pause...

Krei-se 12 hours ago

Yes, but the "point" of evolution is to get more complexity while keeping a good enough stability baseline and this entails automation, but it never led to less diversity.

So while it's true that the current jobs some people do will go away the total variety of jobs will continue to grow.

If you leave a working class citizen alone with a secure income he will educate himself or go with arts, we simply cheat him out of the possibility to discover his unique potential.

fwlr 14 hours ago

  Once a robot can do everything an IQ 80 human can do, only better and cheaper, there will be no reason to employ IQ 80 humans. Once a robot can do everything an IQ 120 human can do, only better and cheaper, there will be no reason to employ IQ 120 humans. Once a robot can do everything an IQ 180 human can do, only better and cheaper, there will be no reason to employ humans at all, in the unlikely scenario that there are any left by that point.

Machines are making great progress on the IQ 180 front, and now with this it looks like they’ve opened a beachhead from the other direction too. Classic pincer move.

  In the earlier stages of the process, capitalism becomes more and more uncoupled from its previous job as an optimizer for human values. Now most humans are totally locked out of the group whose values capitalism optimizes for. They have no value to contribute as workers – and since in the absence of a spectacular social safety net it’s unclear how they would have much money – they have no value as customers either. Capitalism has passed them by. As the segment of humans who can be outcompeted by robots increases, capitalism passes by more and more people until eventually it locks out the human race entirely, once again in the vanishingly unlikely scenario that we are still around.

https://www.slatestarcodexabridged.com/Meditations-On-Moloch

0xbadcafebee 11 hours ago

Something that "revolutionary software for robots!" always misses is you can't fix a hardware problem with software. China controls the robotics industry, and despite their hyper-vertically-integrated companies and rapid development, they still have trouble developing a market of cheap robots that're useful for more than entertainment. It'll be 5-10 years before "general purpose robots" make it into our lives, and even then it probably won't happen for the US due to its isolationism and protectionism.

GaggiX 13 hours ago

I feel like robotic tasks by LLM models and similar are very much underexplored, a few new frontier models are now able to do very simple tasks but hopefully there would be more competition in the future, this one was the first one that offers an API for this task specifically, maybe in the future if more models come up there will be a dedicated OpenRouter category, that would be cool.

measurablefunc 14 hours ago

So looks like generalized actuator planning & control is possible.

rvz 14 hours ago

This is just going to get acquired by OpenAI for their robotics department.

Yeah I said it. Time to start the countdown timer.

dumberquestions 14 hours ago

Why this and not any of the other robotics startups?

boshalfoshal 13 hours ago

1. I don't think it'll get acquired by a frontier lab. Frontier labs already focus on robotics with enough effort that acquiring pure-software research IP from a company like this is not very useful. OpenAI has way more compute and researchers than these guys, and there likely isn't very much dream is doing on the model side thats different from OpenAI, or what they are capable of doing.

2. However to argue against basically any other robotics startup, I think they would only be acquired if it was a robotics SW company _with real customer distribution_/revenue, or a robotics company focusing on HW that is worth acquiring the IP for. The problem with the latter is that it is also a huge cost, and that cost is only worth it if the ML side actually catches up to the HW. I don't think a frontier lab would want to sustain a full physical supply chain for a non-revenue additive product. And frankly, most robotics companies have no meaningful distribution/revenue or SW/HW IP that is worth acquiring, considering the cost.

dmje 14 hours ago

~ whispers quietly ~ I’m not sure of the point…?