Federated learning and language models
Pilot study for federated language models in Swedish
Scaleout is joining the National Library of Sweden and AI Sweden for a pilot on federatively trained language models. This will be the first federative, large-scale modelling of artificial neural networks for language comprehension in Sweden and one the first examples world-wide. The potential impact is substantial as it would enable more actors to use large, existing datasets without the data ever leaving the point where it originated - thus solving pressing challenges around data sharing and privacy. The pilot could also be a first, important step towards a shared Scandinavian language model.
Learn more here: