Can I read Modifying Knowledge in Transformers on EtoBox?
Modifying Knowledge in Transformers by Yun Zhou is a document available to read on EtoBox.
What is Modifying Knowledge in Transformers about?
This paper proposes a new task of explicitly modifying specific factual knowledge stored in Transformer models while ensuring performance is preserved on unmodified facts. Several baseline approaches are evaluated, and constrained layer-wise fine-tuning is found to be effective for knowledge modification. The work also provides insights into how pretraining and fine-tuning impact memorization and modification capabilities.
- Author
- Yun Zhou
- Language
- EN