sij/khoj
1
0
Fork 0
mirror of https://github.com/khoj-ai/khoj.git synced 2025-02-17 08:04:21 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Run explicit filter on raw entry, add more terms to split entries by

Browse source 
- With \t Last Word in Headings was suffixed by \t and so couldn't be
filtered by
- User interacts with raw entries, so run explicit filters on raw entry
   - For semantic search using the filtered entry is cleaner, still
This commit is contained in:
Debanjum Singh Solanky 2022-07-14 21:54:04 +04:00
parent 7640e2ab0c
commit 3aac3c7d52
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
src/search_filter/explicit_filter.py
View file

@ -18,8 +18,8 @@ def explicit_filter(raw_query, entries, embeddings):
entries_by_word_set = [set(word.lower()
for word
in re.split(
r',|\.| |\]|\[\(|\)|\{|\}', # split on fullstop, comma or any brackets
entry[0])
r',|\.| |\]|\[\(|\)|\{|\}|\t|\n|\:', # split on fullstop, comma or any brackets
entry[1])
if word != "")
for entry in entries]