sij/khoj: Mirror of khoj from Github

sij/khoj

mirror of https://github.com/khoj-ai/khoj.git synced 2024-11-23 15:38:55 +01:00

Mirror of khoj from Github

Find a file

Debanjum Singh Solanky 78a1f4ebb4 Use YAML file to allow user to configure application. Add tests - YAML Config - Can specify all params[1] earlier being passed via cmd args in config YAML - Can now also configure sentence-transformer models to use etc for search - [1] Config params - org files - compressed entries file config path - embeddings file config path - Include sample_config.yaml - Include sample .org file from this repos readmes - CLI - Configuration Priority: Config via cmd > Config via YAML > Default Config - Test CLI, include test config.yml for the tests - Set default type to None unless set via query param to API Run notes search if search_enabled, also if type is None (default) Prepares for running queries on all search types unless type specified in API query param - Update Readme		2021-08-21 19:07:39 -07:00
src	Use YAML file to allow user to configure application. Add tests	2021-08-21 19:07:39 -07:00
.gitignore	Add Readme, License. Update .gitignore	2021-08-15 22:52:37 -07:00
environment.yml	Use YAML file to allow user to configure application. Add tests	2021-08-21 19:07:39 -07:00
LICENSE	Add Readme, License. Update .gitignore	2021-08-15 22:52:37 -07:00
README.org	Use YAML file to allow user to configure application. Add tests	2021-08-21 19:07:39 -07:00
sample_config.yml	Use YAML file to allow user to configure application. Add tests	2021-08-21 19:07:39 -07:00

Semantic Search

Allow natural language search on user content like notes, images using transformer based models

All data is processed locally. User can interface with semantic-search app via Emacs, API or Commandline

git clone https://github.com/debanjum/semantic-search && cd semantic-search
conda env create -f environment.yml
conda activate semantic-search

Load ML model, generate embeddings and expose API to query specified org-mode files

python3 src/main.py --org-files ~/Notes/Schedule.org ~/Notes/Incoming.org -c sample_config.yml --verbose

Semantic Search via Emacs
- Install semantic-search.el
- Run M-x semantic-search <user-query> or Call C-c s
Semantic Search via API
- Query: GET http://localhost:8000/search?q="What is the meaning of life"
- Regenerate Embeddings: GET http://localhost:8000/regenerate
- Semantic Search API Docs

  cd semantic-search
  git pull origin master
  conda env update -f environment.yml
  conda activate semantic-search