Datasets @ Hugging Face | Open Source + HF Dataset Hubhttps://bsky.app/profile/lhoestq.hf.cohttps://bsky.app/profile/lhoestq.hf.co/post/3mlo6fmxvk2241M public datasets on @hf.co ! Congrats for pushing forward AI with open datasets !12 May 2026 16:09 +0000at://did:plc:nj2acksctlolkzquptyutvz7/app.bsky.feed.post/3mlo6fmxvk224https://bsky.app/profile/lhoestq.hf.co/post/3lusgjgy3vk26New blog post 🚨 Every data engineer should read it @kszucs.bsky.social (Apache Arrow PMC member) announces how to drastically speed up Parquet files uploads and downloads via deduplication. Best part: the feature enabling this is open source ! https://huggingface.co/blog/parquet-cdc25 Jul 2025 16:06 +0000at://did:plc:nj2acksctlolkzquptyutvz7/app.bsky.feed.post/3lusgjgy3vk26https://bsky.app/profile/lhoestq.hf.co/post/3lpcedioyqk2eCDC Parquet writer is out in PyArrow nightlies 🔥🔥 $ pip install \ -i https://pypi.anaconda.org/scientific-python-nightly-wheels/simple \ "pyarrow>=21.0.0.dev0" it's changing the way I view data versioning👇16 May 2025 15:38 +0000at://did:plc:nj2acksctlolkzquptyutvz7/app.bsky.feed.post/3lpcedioyqk2e