Albayzin Evaluation Challenge 

We are glad to announce that IberSPEECH’2024 will hold the traditional ALBAYZIN evaluations.

This year we have 5 evaluation proposals.

Speech to Text

Challenge

(S2TC) 

Organized by RTVE and University of Zaragoza, consists of automatically transcribe different types of TV shows as in previous challenges.

Speaker Diarization and

Identity Assignment

Challenge (SDIAC) 

Organized by RTVE and Universidad de Zaragoza, consists of segmenting broadcast audio documents according to different speakers, linking those segments which originate from the same speaker and identify a closed set of speakers.

 

Search on

Speech Challenge

(SoSC)

Organized by Universidad San Pablo-CEU and Universidad Autónoma de Madrid, consists of finding a list of terms/queries in audio archives and is divided into two different tasks: Spoken Term Detection (STD) and Query-by-Example Spoken Term Detection (QbE-STD).

Bilingual Basque-Spanish

ASR System Challenge

(BBS-S2TC) 

Organized by the University of the Basque Country (UPV/EHU), the proposed task consists of transcribing short segments of speech (ranging from 3 to 10 seconds)  in Spanish, Basque, or both languages (with code switchings).

 

Wake-up Word

Detection Challenge

(WuWDC)

Organized by Telefónica Innovación Digital and Universidad Autónoma de Madrid, this challenge aims to assess the performance of State-of-The-Art Keyword Spotting systems in addressing various industrial needs such as accuracy, inference delay, computational load, and energy efficiency.

Calendar for the Albayzín evaluations

Selection of evaluation proposals: April 19th, 2024
Opening of registration for the evaluation: May 20th, 2024
Release of training and development data: June 3rd, 2024
Registration deadline for the evaluation: July 31st ,2024
Release of evaluation data: September 2nd ,2024
Deadline for the submission of system outputs: October 18th , 2024
System results distributed to participants: October 31st , 2024
Official results presented publicly and published: November 12th, 2024
IberSPEECH 2024 Albayzin Evaluations special session in Aveiro: November 12th, 2024

For any additional information, please contact the organizing committee. 

ALBAYZIN 2024 Evaluations Organizing Committee

Eduardo Lleida Solano, lleida@unizar.es, ViVoLab, Universidad de Zaragoza, Spain
Alfonso Ortega Giménez, ortega@unizar.es, ViVoLab, Universidad de Zaragoza, Spain
Luis Javier Rodríguez Fuentes, luisjavier.rodriguez@ehu.es, GTTS, Universidad del País Vasco, Spain
Javier Tejedor Noguerales, javier.tejedornoguerales@ceu.es,  BIOLAB, Universidad San Pablo CEU, Spain
Doroteo Torre Toledano, AUDIAS, Universidad Autónoma de Madrid