Steering Vector in VLMs
Explore how to steer vision encoder in Vision-Language Models.
Collaboration: Defence Science and Technology Group (DSTG)
Status:
- In progress.
Key components
1. Trainable activation and steering vector.
2. Vision-language model (Open-Clip) and vision model (DINO)