khoj/config
Debanjum Singh Solanky 4a90972e38 Use a better model for asymmetric semantic search
- The multi-qa-MiniLM-L6-cos-v1 is more extensively benchmarked[1]
- It has the right mix of model query speed, size and performance on benchmarks
- On hugging face it has way more downloads and likes than the msmarco model[2]
- On very preliminary evaluation of the model
  - It doubles the encoding speed of all entries (down from ~8min to 4mins)
  - It gave more entries that stay relevant to the query (3/5 vs 1/5 earlier)

[1]: https://www.sbert.net/docs/pretrained_models.html
[2]: https://huggingface.co/sentence-transformers
2022-07-18 20:27:26 +04:00
..
environment.yml Add dateparser library to conda environment YAML 2022-07-14 22:29:07 +04:00
environment_osx-arm64.yml Add separate conda environment.yml for osx-arm64 2022-07-14 23:16:49 +04:00
sample_config.yml Use a better model for asymmetric semantic search 2022-07-18 20:27:26 +04:00