ValueError: SentenceTransformer.encode() has been called with additional keyword arguments that this model does not use: ['request_qid']

[aurotripathy]

Faithfully used the requirements.txt file for installation, namely,

git+https://github.com/embeddings-benchmark/mteb.git@w_limit

It installed

>>> import mteb
>>> mteb.__version__
'1.38.34'

However get this error

ValueError: SentenceTransformer.encode() has been called with additional keyword arguments that this model does not use: ['request_qid']. As per SentenceTransformer.get_model_kwargs(), this model does not accept any additional keyword arguments.

I'm trying to run this Evaluation code.

[orionw]

Hi @aurotripathy! Can you confirm you have this version installed? pip install git+https://github.com/embeddings-benchmark/mteb.git@w_limit

Until the v2.0.0 branch becomes more stable this is the easiest to use.

It’s possible that your issue could also be related to a new version of SentenceTransfomers that came out recently and i need to pin the old version. Let me know if you still have the issue after running that pip install and I can look into it

[aurotripathy]

Thanks for the real-time response, @orionw
Yes, confirming that's the case.
For my installed versions, I get

>>> import mteb
>>> mteb.__version__
'1.38.34'

and

>>> import sentence_transformers
>>> sentence_transformers.__version__
'5.1.1'

[aurotripathy]

@orionw , you may be right.

The issue went away with the previous version of sentence_transformers.

uv pip install sentence_transformers==5.1.0

[orionw]

Thanks for figuring that out and glad the issue went away @aurotripathy!