sij/khoj
1
0
Fork 0
mirror of https://github.com/khoj-ai/khoj.git synced 2024-12-03 12:23:02 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions 7
720 commits 12 branches 110 tags 133 MiB
Commit graph

3 commits

Author SHA1 Message Date
Debanjum Singh Solanky
536f03af8f Process text content files in sorted order for stable indexing 
- Image search already uses a sorted list of images to process
- Prevents index of entries to desync when entries, embeddings
  generated by a separate server/app instance
 2022-09-12 11:09:40 +03:00
Debanjum Singh Solanky
a701ad08b9 Support multiple input-filters to configure content to index via khoj.yml 
- Update existings code, tests to process input-filters as list
  instead of str
- Test `text_to_jsonl' get files methods to work with combination of
  `input-files' and `input-filters'

Resolves #84
 2022-09-12 11:08:59 +03:00
Debanjum Singh Solanky
d3267554ae Add basic tests for markdown to jsonl conversion 2022-09-11 00:15:27 +03:00