Can I read 噪音微调CLIP on EtoBox?

噪音微调CLIP by liver0377 is a document available to read on EtoBox.

What is 噪音微调CLIP about?

The document presents a novel approach to enhance vision-language (VL) alignment through the Positive-incentive Noise Injector (PiNI), which fine-tunes pre-trained models like CLIP by injecting customized beneficial noise into both visual and linguistic modalities. This method aims to address the challenges of dataset bias and overfitting in downstream tasks by generating diverse embeddings without extensive computational resources. The effectiveness of PiNI is validated through experiments across multiple

Author

liver0377

Language

EN