Skip to content

Source code of ARMADA: Knowledge Distillation of Language Models from Black-box Vision-Language Teachers

License

Notifications You must be signed in to change notification settings

LCS2-IIITD/ARMADA

Repository files navigation

ARMADA

Source code for ARMADA, a novel cross-modal knowledge distillation framework

How to run

To run ARMADA with the different loss formulations, run

python main_superglue.py \
--task $task \
--data_dir ./data/ \
--loss_type loss_Type 

About

Source code of ARMADA: Knowledge Distillation of Language Models from Black-box Vision-Language Teachers

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages