{"id":1371,"date":"2026-04-21T17:53:45","date_gmt":"2026-04-21T17:53:45","guid":{"rendered":"https:\/\/iberspeech.tech\/2026\/?page_id=1371"},"modified":"2026-04-21T17:53:52","modified_gmt":"2026-04-21T17:53:52","slug":"albayzin-evaluation-challenge","status":"publish","type":"page","link":"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/","title":{"rendered":"ALBAYZIN EVALUATION CHALLENGE"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; custom_padding_last_edited=&#8221;off|desktop&#8221; admin_label=&#8221;Hero&#8221; _builder_version=&#8221;4.24.2&#8243; background_enable_color=&#8221;off&#8221; custom_margin=&#8221;|||&#8221; custom_padding=&#8221;50px||0px|||&#8221; custom_padding_tablet=&#8221;130px||130px|&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row column_structure=&#8221;1_2,1_2&#8243; _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; max_width=&#8221;1280px&#8221; custom_padding=&#8221;|15px||15px|false|false&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; locked=&#8221;off&#8221; sticky_enabled=&#8221;0&#8243;][et_pb_column type=&#8221;1_2&#8243; _builder_version=&#8221;4.24.2&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; header_font=&#8221;|||on|||||&#8221; custom_margin=&#8221;||0px|||&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<h1 aria-level=\"1\">ALBAYZIN EVALUATION CHALLENGE 2026<\/h1>\n<p>[\/et_pb_text][et_pb_divider divider_weight=&#8221;3px&#8221; _builder_version=&#8221;4.24.2&#8243; _module_preset=&#8221;default&#8221; width=&#8221;25%&#8221; module_alignment=&#8221;left&#8221; global_colors_info=&#8221;{}&#8221; custom_margin=&#8221;||-2px|||&#8221;][\/et_pb_divider][et_pb_text _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; text_font=&#8221;||||||||&#8221; header_font=&#8221;|||on|||||&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<p style=\"font-weight: 400;\"><span>The <strong>\u201cALBAYZIN 2026\u00a0Speech Technologies for COSER: A Spanish Rural Corpus (Speech-COSER)\u201d<\/strong> challenge\u00a0is supported by\u00a0the <a href=\"https:\/\/rtth.es\">Spanish Thematic Network on Speech\u00a0Technology<\/a> (RTTH) and is\u00a0organized by Universidad San Pablo CEU and AUDIAS\u00a0from\u00a0Universidad\u00a0Aut\u00f3noma\u00a0de Madrid. The challenge integrates in the IberSPEECH 2026 conference that will be held in Madrid, Spain from 18th to 20th November 2026.<\/span><\/p>\n<p>[\/et_pb_text][et_pb_text _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; hover_enabled=&#8221;0&#8243; sticky_enabled=&#8221;0&#8243;]<\/p>\n<p style=\"font-weight: 400;\"><strong><span>Challenge and database description<\/span><\/strong><\/p>\n<p style=\"font-weight: 400;\"><span>The challenge addresses several speech technologies on the Spanish speech rural corpus called COSER. This Spanish dataset stands out due to its substantial geographical and dialectal diversity, covering all regions in Spain, and whose speakers belong to an old population in rural areas with low education levels. This is the largest corpus of dialectal European Spanish, with recordings of rural context and senior Spanish speakers. The complexity of this dataset presents a significant challenge for speech technologies. The\u00a0challenge\u00a0integrates three different tracks:<\/span><\/p>\n<ul>\n<li><strong><span>Automatic Speech Recognition (ASR)<\/span><\/strong><span>: This track focuses on automatically transcribing the audio files, for which the sequence of words that appears in each audio file must be provided.<\/span><\/li>\n<li><strong><span>Speaker Diarization (SD)<\/span><\/strong><span>: This track focuses on automatically segmenting the audio files according to speaker turns, for which timestamps and speaker assignment to segments must be provided. Even if the identity of the speakers and number of speakers is unknown, the output should group segments of the same speaker under the same speaker label.<\/span><\/li>\n<li><strong><span>Spoken Term Detection (STD)<\/span><\/strong><span>: This track aims to detecting a list of terms within the audio files. This list is\u00a0assumed to be\u00a0unknown when processing the audio.\u00a0A\u00a0set of occurrences for each term detected in the\u00a0audio files\u00a0must be generated, along with their timestamps and scores as output.<\/span><\/li>\n<\/ul>\n<p style=\"font-weight: 400;\"><span>The evaluation will be performed in a continuous evaluation method, with a publicly available leaderboard where participants will be able to submit their scores for each of the tracks and check their performance with respect to other participants. This leaderboard will be frozen by the deadline evaluation submission and will be reopened for post-evaluation period. <\/span><\/p>\n<p>[\/et_pb_text][\/et_pb_column][et_pb_column type=&#8221;1_2&#8243; _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;]<\/p>\n<h1><span style=\"color: #e09900;\"><strong>GOLD SPONSOR<\/strong><\/span><\/h1>\n<p>[\/et_pb_text][et_pb_image src=&#8221;https:\/\/iberspeech.tech\/2026\/wp-content\/uploads\/2025\/11\/gold-free-low-3.png&#8221; title_text=&#8221;gold-free-low&#8221; _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][\/et_pb_image][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.16&#8243; _module_preset=&#8221;%22default%22&#8243; custom_padding=&#8221;%22||50px|||%22&#8243; global_colors_info=&#8221;%22{}%22&#8243;][et_pb_row _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; custom_margin=&#8221;|auto||308px||&#8221; max_width=&#8221;1280px&#8221; hover_enabled=&#8221;0&#8243; sticky_enabled=&#8221;0&#8243;][et_pb_column _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; type=&#8221;4_4&#8243;][et_pb_text _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; hover_enabled=&#8221;0&#8243; sticky_enabled=&#8221;0&#8243;]<\/p>\n<p style=\"font-weight: 400;\"><strong><span>Challenge participation channels<\/span><\/strong><\/p>\n<p style=\"font-weight: 400;\"><span>Participants can register in any of the tracks (i.e., it is not mandatory to participate in all the tracks of the challenge) or all the tracks, depending on their choice. There are two ways to participate in the challenge according to the submission type:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span>The first way relies on editing the <strong>system description paper<\/strong> <strong>following the IberSPEECH 2026 paper submission template<\/strong> so that the submitted paper (describing the system\/s and the results) will appear in the IberSPEECH 2026 proceedings following the regular peer review process (<strong>deadline set at 22nd June<\/strong>). Moreover, participants may also have the chance to submit an extended version of this paper to a journal. This submission way implies sending one or more representatives to the evaluation workshop, to be held in Madrid, Spain as part of IberSPEECH 2026 (November 2026), and <strong>present there upon acceptance of the paper.<\/strong><br \/><\/span><span><\/span><\/li>\n<li style=\"font-weight: 400;\"><span>The second way demands<strong> a free-format document<\/strong> in which participants describe the submitted system\/s along with the results, but <strong>this will not appear in the IberSPEECH 2026 proceedings<\/strong>. In this case, participants are allowed to present on-line their system\/s without physically attending the conference, or send a video to the evaluation organizers explaining their submitted system\/s, which will be shown during the evaluation workshop. <strong>The paper submission deadline in the second submission way is September 30th, 2026 (23:59 GMT+1).<\/strong><\/span><\/li>\n<\/ul>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.24.2&#8243; _module_preset=&#8221;default&#8221; custom_padding=&#8221;0px||2px|||&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row column_structure=&#8221;1_2,1_2&#8243; _builder_version=&#8221;4.24.2&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; max_width=&#8221;1700px&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;1_2&#8243; _builder_version=&#8221;4.24.2&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_toggle title=&#8221;Calendar for the CHALLENGE&#8221; open=&#8221;on&#8221; toggle_icon=&#8221;&#x43;||divi||400&#8243; _builder_version=&#8221;4.27.4&#8243; _module_preset=&#8221;default&#8221; title_level=&#8221;h2&#8243; title_font=&#8221;|||on|||||&#8221; body_font=&#8221;||||||||&#8221; body_font_size=&#8221;15px&#8221; custom_margin=&#8221;||30px|||&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<ul style=\"font-weight: 400;\">\n<li><strong>April 20th, 2026<\/strong>: Registration opens.<\/li>\n<li><strong><span>May 1st, 2026<\/span><\/strong><span>: Release of the training\/development data.<\/span><\/li>\n<li><strong><span>June 5th, 2026<\/span><\/strong><span>:\u00a0Release of the test data. System submission (leaderboard) opens.<\/span><\/li>\n<li><strong>July 31st, 2026<\/strong>: Registration deadline.<\/li>\n<li><strong><span>September 30th, 2026 (23:59, GMT +1)<\/span><\/strong><span>: System submission and system description paper deadline (for system description paper according to the second system description submission way). The leaderboard will be frozen by this date.<\/span><\/li>\n<li><strong><span>October 31st, 2026<\/span><\/strong><span>: Results are distributed to the participants. The leaderboard will be reopened by this date for post-evaluation period.<\/span><\/li>\n<li><strong><span>November 18th-20th, 2026<\/span><\/strong><span>: IberSPEECH 2026 Albayzin Evaluations special session in Madrid.<\/span><\/li>\n<\/ul>\n<p><span>More details in the evaluation plan that can be found <a href=\"https:\/\/iberspeech.tech\/2026\/wp-content\/uploads\/2026\/04\/COSER_EvalPlan.pdf\" title=\"Evaluation plan\">here<\/a>.<\/span><\/p>\n<p style=\"font-weight: 400;\"><span>For more information, please contact <a href=\"mailto:javier.tejedornoguerales@ceu.es\">Javier Tejedor<\/a> and\/or <a href=\"mailto:alicia.lozano@uam.es\">Alicia Lozano<\/a>.<\/span><\/p>\n<p>[\/et_pb_toggle][\/et_pb_column][et_pb_column type=&#8221;1_2&#8243; _builder_version=&#8221;4.24.2&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_toggle title=&#8221;ALBAYZIN 2026 Evaluations Organizing Committee&#8221; open=&#8221;on&#8221; toggle_icon=&#8221;&#x43;||divi||400&#8243; _builder_version=&#8221;4.24.2&#8243; _module_preset=&#8221;default&#8221; title_level=&#8221;h2&#8243; title_font=&#8221;|||on|||||&#8221; body_font_size=&#8221;15px&#8221; custom_margin=&#8221;||30px|||&#8221; global_colors_info=&#8221;{}&#8221;]<\/p>\n<p><span data-contrast=\"none\">Eduardo Lleida Solano, <\/span><span data-contrast=\"none\">\u202f<\/span><a href=\"mailto:lleida@unizar.es\"><span data-contrast=\"none\">lleida@unizar.es<\/span><\/a><span data-contrast=\"none\">,<\/span><span data-contrast=\"none\"> Universidad de Zaragoza, Spain<\/span><span><br \/><\/span><span data-contrast=\"none\"><\/span><\/p>\n<p style=\"font-weight: 400;\">Javier Tejedor Noguerales, \u202f<a href=\"mailto:javier.tejedornoguerales@ceu.es\">javier.tejedornoguerales@ceu.es<\/a>,\u202f Universidad San Pablo CEU, Spain<\/p>\n<p style=\"font-weight: 400;\"><span data-contrast=\"none\">Luis Javier Rodr\u00edguez Fuentes, <\/span><span data-contrast=\"none\">\u202f<\/span><a href=\"mailto:luisjavier.rodriguez@ehu.es\"><span data-contrast=\"none\">luisjavier.rodriguez@ehu.es<\/span><\/a><span data-contrast=\"auto\">,<\/span><span data-contrast=\"none\"> Universidad del Pa\u00eds Vasco, Spain<\/span><\/p>\n<p style=\"font-weight: 400;\">Mar\u00eda del Carmen Magari\u00f1os Iglesias, <a href=\"mailto:mariadelcarmen.magarinos@usc.es\">mariadelcarmen.magarinos@usc.es<\/a>, Universidad de Santiago de Compostela, Spain<\/p>\n<p>[\/et_pb_toggle][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>ALBAYZIN EVALUATION CHALLENGE 2026The \u201cALBAYZIN 2026\u00a0Speech Technologies for COSER: A Spanish Rural Corpus (Speech-COSER)\u201d challenge\u00a0is supported by\u00a0the Spanish Thematic Network on Speech\u00a0Technology (RTTH) and is\u00a0organized by Universidad San Pablo CEU and AUDIAS\u00a0from\u00a0Universidad\u00a0Aut\u00f3noma\u00a0de Madrid. The challenge integrates in the IberSPEECH 2026 conference that will be held in Madrid, Spain from 18th to 20th November 2026.Challenge and [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":"","_links_to":"","_links_to_target":""},"class_list":["post-1371","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>ALBAYZIN EVALUATION CHALLENGE - Iberspeech<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ALBAYZIN EVALUATION CHALLENGE - Iberspeech\" \/>\n<meta property=\"og:description\" content=\"ALBAYZIN EVALUATION CHALLENGE 2026The \u201cALBAYZIN 2026\u00a0Speech Technologies for COSER: A Spanish Rural Corpus (Speech-COSER)\u201d challenge\u00a0is supported by\u00a0the Spanish Thematic Network on Speech\u00a0Technology (RTTH) and is\u00a0organized by Universidad San Pablo CEU and AUDIAS\u00a0from\u00a0Universidad\u00a0Aut\u00f3noma\u00a0de Madrid. The challenge integrates in the IberSPEECH 2026 conference that will be held in Madrid, Spain from 18th to 20th November 2026.Challenge and [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/\" \/>\n<meta property=\"og:site_name\" content=\"Iberspeech\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-21T17:53:52+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/\",\"url\":\"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/\",\"name\":\"ALBAYZIN EVALUATION CHALLENGE - Iberspeech\",\"isPartOf\":{\"@id\":\"https:\/\/iberspeech.tech\/2026\/#website\"},\"datePublished\":\"2026-04-21T17:53:45+00:00\",\"dateModified\":\"2026-04-21T17:53:52+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/iberspeech.tech\/2026\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ALBAYZIN EVALUATION CHALLENGE\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/iberspeech.tech\/2026\/#website\",\"url\":\"https:\/\/iberspeech.tech\/2026\/\",\"name\":\"Iberspeech\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/iberspeech.tech\/2026\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ALBAYZIN EVALUATION CHALLENGE - Iberspeech","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/","og_locale":"en_US","og_type":"article","og_title":"ALBAYZIN EVALUATION CHALLENGE - Iberspeech","og_description":"ALBAYZIN EVALUATION CHALLENGE 2026The \u201cALBAYZIN 2026\u00a0Speech Technologies for COSER: A Spanish Rural Corpus (Speech-COSER)\u201d challenge\u00a0is supported by\u00a0the Spanish Thematic Network on Speech\u00a0Technology (RTTH) and is\u00a0organized by Universidad San Pablo CEU and AUDIAS\u00a0from\u00a0Universidad\u00a0Aut\u00f3noma\u00a0de Madrid. The challenge integrates in the IberSPEECH 2026 conference that will be held in Madrid, Spain from 18th to 20th November 2026.Challenge and [&hellip;]","og_url":"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/","og_site_name":"Iberspeech","article_modified_time":"2026-04-21T17:53:52+00:00","twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/","url":"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/","name":"ALBAYZIN EVALUATION CHALLENGE - Iberspeech","isPartOf":{"@id":"https:\/\/iberspeech.tech\/2026\/#website"},"datePublished":"2026-04-21T17:53:45+00:00","dateModified":"2026-04-21T17:53:52+00:00","breadcrumb":{"@id":"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/iberspeech.tech\/2026\/albayzin-evaluation-challenge\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/iberspeech.tech\/2026\/"},{"@type":"ListItem","position":2,"name":"ALBAYZIN EVALUATION CHALLENGE"}]},{"@type":"WebSite","@id":"https:\/\/iberspeech.tech\/2026\/#website","url":"https:\/\/iberspeech.tech\/2026\/","name":"Iberspeech","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/iberspeech.tech\/2026\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/iberspeech.tech\/2026\/wp-json\/wp\/v2\/pages\/1371","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/iberspeech.tech\/2026\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/iberspeech.tech\/2026\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/iberspeech.tech\/2026\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/iberspeech.tech\/2026\/wp-json\/wp\/v2\/comments?post=1371"}],"version-history":[{"count":6,"href":"https:\/\/iberspeech.tech\/2026\/wp-json\/wp\/v2\/pages\/1371\/revisions"}],"predecessor-version":[{"id":1796,"href":"https:\/\/iberspeech.tech\/2026\/wp-json\/wp\/v2\/pages\/1371\/revisions\/1796"}],"wp:attachment":[{"href":"https:\/\/iberspeech.tech\/2026\/wp-json\/wp\/v2\/media?parent=1371"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}