Can I read w2v-BERT: Advanced Speech Pre-Training on EtoBox?

w2v-BERT: Advanced Speech Pre-Training by smcsrn2k2y is a document available to read on EtoBox.

What is w2v-BERT: Advanced Speech Pre-Training about?

The document presents w2v-BERT, a novel framework that combines contrastive learning and masked language modeling for self-supervised speech representation learning. This approach allows for end-to-end optimization of speech discretization and contextualized representation learning, achieving state-of-the-art performance on the LibriSpeech benchmarks and significantly improving real-world voice search tasks. The framework demonstrates the effectiveness of simultaneous training of contrastive and masked pred

Author

smcsrn2k2y

Language

EN