DuckDB Ducklake (github.com)

84 pointsby saikatsga day ago11 comments

smithclay 2 hours ago

Don't think it's widely known or understood, but Ducklake doesn't require duckdb: it's just a (good) data lake spec that works in duckdb.

There's a cool alternate rust/datafusion ecosystem initiative going on at https://github.com/datafusion-contrib/datafusion-ducklake, and think the Quack protocol opens up a lot of cool possibilities too.

If you need an idea for what do do with ducklake: recommend throwing all of your agent traces in it.

celias 21 hours ago

Motherduck is offering a free copy of O'reilly's "DuckLake: The Definitive Guide" book on their DuckLake web page

https://motherduck.com/product/ducklake/

engineeringwoke an hour ago

It's alright, it's pretty alpha software. On v1.5.4, catalog filtered counts are broken, afaik. I went to main/v2 to fix it, and then the SQL parser in duckdb v2 is 10x slower, which was another wrench in the gears. It's been a bit of a pain tbh

jauco an hour ago

Yep, they made the spec 1.0 but it isn’t 1.0 software. Browse the bugs before use.

When it works well it’s really nice. And it beats handrolling a multi level parquet store.

engineeringwoke 9 minutes ago

Absolutely. I love it, but you need a fork for now.

suchire a day ago

But "Duckpond" was right there!

HackerThemAll 14 hours ago

DuckDB is the best thing world got since 1990s.

https://duckdb.org/2025/05/19/the-lost-decade-of-small-data....

loufe 2 hours ago

Why program greenfield in C++? I know "made with rust" is a meme but seriously, why not a memory safe language in 2026?

esafak an hour ago

DuckDB has been around since 2018. Naturally its offspring use C++.

OutOfHere 18 minutes ago

Rust has been out since 2010. It was recognized and popular by 2017.

esafak 11 minutes ago

It was not popular then (https://www.tiobe.com/tiobe-index/), and it was not selected by DuckDB. IF they feel C++ is holding them back they can rewrite it...