Showing posts with label Spanish discussion threads. Show all posts
Showing posts with label Spanish discussion threads. Show all posts

Monday, November 16, 2026

LDC 2026 November Newsletter

Join LDC for membership year 2027  

Spring 2027 data scholarship application deadline

New publications:

Computational Cultural Understanding Korean

DEFT Multilingual Rich ERE Annotation

MATERIAL Pashto-English Language Pack

____________________________________________________________________

Join LDC for membership year 2027  
It’s time to renew your LDC membership for 2027. Any organization that joins the Consortium or renews their membership before March 1, 2027, will receive a 10% discount off the membership fee. 

In addition to accessing new publications, current LDC members enjoy the benefit of licensing at reduced fees older data from our Catalog of over 1000 holdings. Current-year for-profit members may use most data for commercial applications.

Plans for next year’s publications are in progress. Among the expected releases are:  

  • Fisher English Training Part 3 Speech: 1300+ hours of previously unreleased English conversational telephone speech from the Fisher collection with speaker metadata  
  • Computational Cultural Understanding: multimodal data and annotations, assessments, results and supplemental resources to support system development for analyzing and interpreting sociocultural norms, recognizing emotion across cultural contexts, and detecting changes that affect cultural understanding; includes Chinese, Japanese, Russian, Spanish and Turkish releases 
  • Urdu Conversational Telephone Speech and Transcripts: 74 Urdu telephone conversations (14 hours) with transcripts, developed to support language identification, spoken language recognition and transcription of the Urdu language 
  • Speech Biomarkers: 23 hours of spontaneous and elicited speech and corresponding transcripts from American English speakers designed to establish a baseline of language and speech patterns from healthy speakers for comparison with clinical populations such as persons with dementia
  • Global TIMIT: a continuing series of TIMIT-like read speech corpora, focusing on Mandarin Chinese, Mandarin Chinese dialects and English 
For full descriptions of all LDC data sets, browse our Catalog. Visit Join LDC for details on membership, user accounts and payment.

Spring 2027 data scholarship application deadline
Applications are now being accepted through January 15, 2027, for the Spring 2027 LDC data scholarship program which provides university students with no-cost access to LDC data.

Consult the LDC Data Scholarships page for more information about program rules and submission requirements.

New publications:

Computational Cultural Understanding Korean was developed by LDC and consists of Korean source data, manual annotations, assessment results, and associated supplemental resources used for development and evaluation in the DARPA Computational Cultural Understanding (CCU) program. The CCU program focused on developing technologies to improve cross-cultural understanding and communication with the goal to create systems capable of analyzing and interpreting sociocultural norms, recognizing emotion across cultural contexts, and detecting communicative changes that affect interpersonal understanding.

This corpus contains over 6500 documents and URLs, annotations, annotated metadata for each source document, manual transcripts for development data, and ASR output for evaluation data. Source data consists of naturally occurring conversations involving two or more Korean speakers in text, audio, or video (provided as URLs) representing a wide variety of speaker demographics, social roles, settings, genres, topics, emotions, and sociocultural norms. Documents were manually labeled for the presence of emotion categories, valence, and arousal. A subset of files was also annotated for defined sociocultural norms, including norm adherence or violation, and for the presence of changepoints (points in a conversation where a change occurs with the potential to significantly impact conversation outcome).

2026 members can access this corpus through their LDC accounts. Non-members may license this data for a fee.

*

DEFT Multilingual Rich ERE Annotation was developed by LDC and contains 153 Chinese, English, and Spanish discussion forum threads annotated for entities, relations, and events (ERE) under its rich ERE guidelines. Rich ERE annotation expands types and tagging in the entities, relations, and events annotation tasks and replaces strict event coreference with a more loosely defined event hopper annotation.

DARPA's Deep Exploration and Filtering of Text (DEFT) program aimed to address remaining capability gaps in state-of-the-art natural language processing technologies related to inference, causal relationships and anomaly detection. LDC supported the DEFT program by collecting, creating and annotating a variety of data sources.

2026 members can access this corpus through their LDC accounts. Non-members may license this data for a fee.

*

MATERIAL Pashto-English Language Pack was developed by Appen for the IARPA MATERIAL program and contains 120 hours of Pashto conversational telephone speech, transcripts, English translations, annotations and queries. Calls were made using different telephones (e.g., mobile, landline) from a variety of environments. Transcripts cover 100% of the speech files, 2% of which were translated into English. This release also includes domain annotations, English queries and their relevance annotations. 

The MATERIAL program focused on underserved languages with the ultimate goal to build cross language information retrieval systems to find speech and text content using English search queries.

2026 members can access this corpus through their LDC accounts provided they have submitted a completed copy of the special license agreement. Non-members may license this data for a fee.