How to use webis/bert-bi-encoder with Lightning IR:
#install from https://github.com/webis-de/lightning-ir from lightning_ir import BiEncoderModule model = BiEncoderModule("webis/bert-bi-encoder") model.score("query", ["doc1", "doc2", "doc3"])
https://huggingface.co/webis/bert-bi-encoder/resolve/main/tokenizer.json
hf download hf://webis/bert-bi-encoder/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/webis/bert-bi-encoder/resolve/main/tokenizer.json
