1TB of Parquet Files. Single Node Benchmark. (DuckDB Style)

(dataengineeringcentral.substack.com)

2 points | by dancrystalbeach 11 hours ago ago

1 comments

  • dancrystalbeach 11 hours ago

    I give the people what they want; I’m a slave to clicks and the buzz of internet anger and mayhem. Not so long ago, I tried, with limited success, to convince a legion of engineers who were raised on the Snowflake and Databricks teat, that salvation lay right at their feet; all they must do is lean down and put their hand to the plow.