@earthmover.io on Bluesky

JavaScript RequiredThis is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is. Learn more about Bluesky at bsky.social and atproto.com.

Post

Earthmover

earthmover.io

did:plc:2to66thokp6tvgtlq2m3jawe

Mainstream data folks sometimes ask, 𝑤ℎ𝑦 𝑑𝑜𝑛’𝑡 𝑦𝑜𝑢 𝑗𝑢𝑠𝑡 𝑐𝑜𝑛𝑣𝑒𝑟𝑡 𝑎𝑙𝑙 𝑡ℎ𝑎𝑡 𝑤𝑒𝑎𝑡ℎ𝑒𝑟 𝑓𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝑑𝑎𝑡𝑎 𝑡𝑜 𝑃𝑎𝑟𝑞𝑢𝑒𝑡? This post explains why we need Array-native data systems. Bottom line: @xarray.bsky.social , @zarr.dev, and Icechunk are >10x faster than Parquet and DuckDB for common tensor data workloads.

2025-04-03T17:39:31.682Z