This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Jeremy Howard
howard.fm
did:plc:ihze7dasblwewgunyesfbm23
So how does it work? ModernBERT brings modern engineering ideas from LLMs over to encoder models. We did so in three core ways: 1) a modernized transformer architecture; 2) particular attention to efficiency; 3) modern data scales & sources.
Details here: arxiv.org/abs/2412.13663
https://arxiv.org/abs/2412.13663v1
2024-12-19T16:45:16.252Z