Skip to content

Opening book details…

Can I read Efficient Text Summarization with Transformers on EtoBox?

Efficient Text Summarization with Transformers by your.stranger.guy is a document available to read on EtoBox.

What is Efficient Text Summarization with Transformers about?

The document discusses a novel approach to text summarization using a pre-trained Transformer language model that enhances sample efficiency by utilizing a decoder-only architecture. Experiments on the CNN/Daily Mail dataset demonstrate that this method significantly outperforms traditional encoder-decoder models, achieving a ROUGE-2 score of 13.1 with only 1% of the training data. The findings suggest that this approach could be beneficial for low-resource summarization tasks by effectively leveraging pre-

Author
your.stranger.guy
Language
EN