GLUE Benchmark

https://gluebenchmark.com/

Last activity: 04.02.2025

Active

Categories: Training

The General Language Understanding Evaluation (GLUE) benchmark is a collection of resources for training, evaluating, and analyzing natural language understanding systems.

Website visits

29.3K /mo.

Mentions

Mentions in press and media 31

Date	Title	Description
Sign up to see	Sign up to see	Sign up to see
Oct 24, 2024	Оценка LLM: метрики, фреймворки и лучшие практики	Дженсен Хуанг в своем выступлении на саммите «Data+AI» сказал: «Генеративный ИИ есть везде, в любой отрасли. Если в вашей отрасли еще нет генеративных ИИ, значит вы просто не обращали внимания на это». Однако широкое распространение вовсе н...
Mar 9, 2024	Обзор дискуссий о «понимании» большими языковыми моделями (LLM)	Это перевод статьи от 10 февраля 2023 года Melanie Mitchell и David C. Krakauer, в которой разбираются основные аргументы и позиции относительно того, могут ли современные LLM "понимать" в человеческом или каком-либо ином смысле.....
Nov 24, 2023	New technique can accelerate language models by 300x	Are you ready to bring more awareness to your brand? Consider becoming a sponsor for The AI Impact Tour. Learn more about the opportunities here. Researchers at ETH Zurich have developed a new technique that can significantly boost the spee...
May 4, 2023	Зоопарк трансформеров: большой обзор моделей от BERT до Alpaca	Введение В последнее время только ленивый не говорит про революцию ИИ (искусственный интеллект), искусственные нейронные сети позволяют создавать сервисы, которые 10 лет назад показались бы фантастикой. Ведение диалогов, генерация и редакти...
Dec 3, 2022	Обучение Russian SuperGLUE моделей с помощью библиотеки DeepPavlov	Соревнования GLUE и SuperGLUE В последние годы соревнования GLUE и SuperGLUE на английском языке стали стандартным бенчмарком для определения возможностей универсальных языковых моделей, таких как BERT, RoBERTa в решении широкого круга зада...
May 24, 2022	Насколько естественен естественный язык? Представляем датасет RuCoLA	В последние годы в области NLP произошла настоящая революция: огромные нейросети, предобученные на сотнях гигабайт текстов, бьют все известные рекорды качества. Но обладают ли такие нейросети чутьём на «естественность» текста, которое есть ...
Feb 14, 2022	Проблемы современного машинного обучения	Во многих популярных курсах машинного и глубокого обучения вас научат классифицировать собак и кошек, предсказывать цены на недвижимость, покажут еще десятки задач, в которых машинное обучение вроде как отлично работает. Но вам расскажут на...
May 8, 2021	The four most common fallacies about AI	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! The history of artificial intelligence has been m...
May 8, 2021	The four most common fallacies about AI	Join Transform 2021 this July 12-16. Register for the AI event of the year. The history of artificial intelligence has been marked by repeated cycles of extreme optimism and promise followed by disillusionment and disappointment. Today’s AI...
Apr 5, 2021	NANTHEALTH, INC. NantHealth : Data-Driven AI in Healthcare	Technology's impact on healthcare was felt widely during the pandemic. We witnessed years of acceleration take flight in what felt like months. The pandemic exposed gaps and opportunities for the use of real-world data and evidence as the w...
Mar 8, 2021	Debate over accuracy of AI transcription services rages on	Join Transform 2021 for the most important themes in enterprise AI & Data. Learn more. Transcription service companies continue to make claims about their AI, but in the absence of any formal set of benchmarks for natural language proce...
Mar 8, 2021	Debate over accuracy of AI transcription services rages on	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! Transcription service companies continue to make ...
Apr 22, 2020	StereoSet measures racism, sexism, and other forms of bias in AI language models	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! AI researchers from MIT, Intel, and Canadian AI i...
Apr 22, 2020	StereoSet measures racism, sexism, and other forms of bias in AI language models	AI researchers from MIT, Intel, and Canadian AI initiative CIFAR have found high levels of stereotypical bias from some of the most popular pretrained models like Google’s BERT and XLNet, OpenAI’s GPT-2, and Facebook’s RoBERTa. The analysis...
Mar 16, 2020	Microsoft, White House, and Allen Institute release coronavirus data set for medical and NLP researchers	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! The COVID-19 Open Research Dataset (CORD-19), a r...
Mar 16, 2020	Microsoft, White House, and Allen Institute release coronavirus data set for medical and NLP researchers	The COVID-19 Open Research Dataset (CORD-19), a repository of more than 29,000 scholarly articles on the coronavirus family from around the world, is being released today for free. The data set is the result of work by Microsoft Research, t...
Feb 12, 2020	How Mastering Natural Language Processing Can Boost Your Bottom Line	When past generations imagined the future, they pictured humans and machines speaking naturally to one another. While voice assistants like Siri and Alexa still fall short of that vision, they have come a long way from the days when talking...
Jan 16, 2020	Google’s AI language model Reformer can process the entirety of novels	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! Whether it’s language, music, speech, or video, s...
Jan 2, 2020	Top minds in machine learning predict where AI is going in 2020	Did you miss a session from GamesBeat Summit 2022? All sessions are available to stream now. Learn more. AI is no longer poised to change the world someday; it’s changing the world now. As we begin a new year and decade, VentureBeat turned ...
Jan 2, 2020	Top minds in machine learning predict where AI is going in 2020	AI is no longer poised to change the world someday; it’s changing the world now. As we begin a new year and decade, VentureBeat turned to some of the keenest minds in AI to revisit progress made in 2019 and look ahead to how machine learnin...
Sep 26, 2019	Google AI’s ALBERT claims top spot in multiple NLP performance benchmarks	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! Researchers from Google AI (formerly Google Resea...
Sep 26, 2019	Hugging Face launches popular Transformers NLP library for TensorFlow	Maker of the popular PyTorch-Transformers model library, Hugging Face today said it’s bringing its NLP library to the TensorFlow machine learning framework. The PyTorch version of the library has seen more than 500,000 Pip installs since th...
Sep 26, 2019	Hugging Face launches popular Transformers NLP library for TensorFlow	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! Maker of the popular PyTorch-Transformers model l...
Sep 26, 2019	Google AI’s ALBERT claims top spot in multiple NLP performance benchmarks	Researchers from Google AI (formerly Google Research) and Toyota Technological Institute of Chicago have created ALBERT, an AI model that achieves state-of-the-art results that exceed human performance. ALBERT now claims first place on majo...
Aug 29, 2019	Microsoft’s Icecaps toolkit makes multiple-persona conversational AI with multitask learning	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! Icecaps, an open source toolkit for neural conver...
Aug 29, 2019	Microsoft’s Icecaps toolkit makes multiple-persona conversational AI with multitask learning	Icecaps, an open source toolkit for neural conversational networks from Microsoft Research, made its debut today. Icecaps is an acronym that stands for Intelligent Conversation Engine: Code and Pre-trained Systems, and it uses multitask lea...
Jun 21, 2019	Google Brain’s XLNet bests BERT at 20 NLP tasks	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! A group of Google Brain and Carnegie Mellon Unive...
Jun 21, 2019	Google Brain’s XLNet bests BERT at 20 NLP tasks	A group of Google Brain and Carnegie Mellon University researchers this week introduced XLNet, an AI model capable of outperforming Google’s cutting-edge BERT in 20 NLP tasks and achieving state-of-the-art results on 18 benchmark tasks. BER...
May 16, 2019	Microsoft makes Google’s BERT NLP model better	Microsoft AI researchers today said they’ve created a Multi-Task Deep Neural Network (MT-DNN) that incorporates Google’s BERT AI to achieve state-of-the-art results. The MT-DNN was able to set new high performance standards in 7 of 9 NLP ta...
May 16, 2019	Microsoft makes Google’s BERT NLP model better	We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. Register today! Microsoft AI researchers today said they’ve creat...

Reviews 0

FAQ about GLUE Benchmark

What has the press written about GLUE Benchmark?

Parsers VC has collected 31 articles mentioning GLUE Benchmark, among them “Оценка LLM: метрики, фреймворки и лучшие практики” (Oct 24, 2024) and “Обзор дискуссий о «понимании» большими языковыми моделями (LLM)” (Mar 9, 2024).

Is GLUE Benchmark still active?

Yes, GLUE Benchmark is active; its latest activity on Parsers VC dates from Feb 4, 2025.