khoj/documentation/docs/miscellaneous/performance.md

---
sidebar_position: 2
---

# Performance

Here are some top-level performance metrics for Khoj. These are rough estimates and will vary based on your hardware and data.

### Search performance

- Semantic search using the bi-encoder is fairly fast at \<100 ms across all content types
- Reranking using the cross-encoder is slower at \<2s on 15 results. Tweak `top_k` to tradeoff speed for accuracy of results
- Filters in query (e.g. by file, word or date) usually add \<20ms to query latency

### Indexing performance

- Indexing is more strongly impacted by the size of the source data
- Indexing 100K+ line corpus of notes takes about 10 minutes
- Indexing 4000+ images takes about 15 minutes and more than 8Gb of RAM
- Note: *It should only take this long on the first run* as the index is incrementally updated

### Miscellaneous

- Testing done on a Mac M1 and a \>100K line corpus of notes
- Search, indexing on a GPU has not been tested yet
Migrate to using docusaurus, rather than docsify for documentation (#603) * Add docusaurus documentation (to replace the docsify setup * Remove older docs * Specify documentation as the gh pages build action working directory 2024-01-07 15:58:15 +01:00			`---`
			`sidebar_position: 2`
			`---`

			`# Performance`

			`Here are some top-level performance metrics for Khoj. These are rough estimates and will vary based on your hardware and data.`
Fix diff blocks, links, remove footnotes & rearrange sections in docs Extract performance into separate sectin into shoving it under search Create page for web interface 2023-07-21 09:05:44 +02:00
			`### Search performance`

			`- Semantic search using the bi-encoder is fairly fast at \<100 ms across all content types`
			- Reranking using the cross-encoder is slower at \<2s on 15 results. Tweak `top_k` to tradeoff speed for accuracy of results
Spell fix s/e.g/e.g./ across code, tests and docs 2024-06-24 09:20:33 +02:00			`- Filters in query (e.g. by file, word or date) usually add \<20ms to query latency`
Fix diff blocks, links, remove footnotes & rearrange sections in docs Extract performance into separate sectin into shoving it under search Create page for web interface 2023-07-21 09:05:44 +02:00
			`### Indexing performance`

			`- Indexing is more strongly impacted by the size of the source data`
			`- Indexing 100K+ line corpus of notes takes about 10 minutes`
			`- Indexing 4000+ images takes about 15 minutes and more than 8Gb of RAM`
			`- Note: It should only take this long on the first run as the index is incrementally updated`

			`### Miscellaneous`

			`- Testing done on a Mac M1 and a \>100K line corpus of notes`
			`- Search, indexing on a GPU has not been tested yet`