ML Research Engineer at 🤗. Lisboeta 🇵🇹https://bsky.app/profile/guilherme.hf.cohttps://bsky.app/profile/guilherme.hf.co/post/3lcruzwtlzk2oAnnouncing 🥂 FineWeb2: A sparkling update with 1000s of 🗣️languages. We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages. 🥂 FineWeb2 has 8TB of compressed text data and outperforms other datasets.08 Dec 2024 09:19 +0000at://did:plc:63jfgxuz33djjfqo7txcd374/app.bsky.feed.post/3lcruzwtlzk2o