Adding support for Hybrid-CLIP models such as MedCLIP variants also Evaluation Data saving.

[TennoSerra]

When doing some work testing multimodal transformer models in the medical field sometimes the models in question use Hybrid-Clip variants, such as these: https://huggingface.co/models?search=medclip. It would be great if some models like these could be supported.

More importantly, is there any way to save evaluation data to a csv or json file?

[eloy-encord]

Hi @TennoSerra, I'm glad that TTI-Eval helps you with your workflow!
To register models from known sources to TTI-Eval, you can use the following guide.

In the particular case of MedCLIP, you may first need to add a model source that knows how to interact with the details of the medclip package and then register the model instance. Contributions are always more than welcome 🤗!

On the other side, to save the evaluation results to a CSV, use the --save option of the evaluate command.