Commit graph

  • 4eb84c7f51 Log performance metrics for beancount, markdown to jsonl conversion Debanjum Singh Solanky 2022-09-10 22:47:54 +0300
  • ebd5039bd1 Merge branch 'master' into support-incremental-updates-of-embeddings Debanjum Singh Solanky 2022-09-10 22:11:43 +0300
  • ed8d432fdd Clean-up generated file after image search test run Debanjum Singh Solanky 2022-09-07 03:07:30 +0300
  • 030fab9bb2 Support incremental update of Markdown entries, embeddings Debanjum Singh Solanky 2022-09-10 21:30:04 +0300
  • 91aac83c6a Support incremental update of Beancount transactions, embeddings Debanjum Singh Solanky 2022-09-10 20:55:32 +0300
  • cfaf7aa6f4 Update Indexing Performance Section in Readme Debanjum Singh Solanky 2022-09-07 14:10:38 +0300
  • b01b4d7daa Extract logic to mark entries for embeddings update into helper function Debanjum Singh Solanky 2022-09-07 03:31:48 +0300
  • f97308bef2 Fix log message on writing JSONL data to file Debanjum Singh Solanky 2022-09-10 21:40:08 +0300
  • 899bfc5c3e Test incremental update triggered on calling text_search.setup Debanjum Singh Solanky 2022-09-07 03:06:29 +0300
  • c17a0fd05b Do not store word filters index to file. Not necessary for now Debanjum Singh Solanky 2022-09-07 02:43:58 +0300
  • 91d11ccb49 Only hash compiled entry to identify new/updated entries to update Debanjum Singh Solanky 2022-09-07 02:36:38 +0300
  • b9a6e80629 Make OrgNode tags stable sorted to find new entries for incremental updates Debanjum Singh Solanky 2022-09-07 01:38:30 +0300
  • 2f7a6af56a Support incremental update of org-mode entries and embeddings Debanjum Singh Solanky 2022-09-07 00:16:48 +0300
  • ec675d27d3 Suppress non-actionable HuggingFace FutureWarning shown on app start Debanjum Singh Solanky 2022-09-10 16:40:22 +0300
  • 1ac6a71ff0 Add --version flag to show installed version of khoj Debanjum Singh Solanky 2022-09-10 16:30:58 +0300
  • 372dcd2dbc
    Handle Empty Org Files or Org Files with No Headings Debanjum 2022-09-10 12:42:07 +0000
  • 976397bd82 Ignore empty #+TITLE, merge multiple #+TITLE for 0th level headings Debanjum Singh Solanky 2022-09-10 15:22:26 +0300
  • 2b58218b56 Reuse search models across sessions. Merge unused pytest fixtures Debanjum Singh Solanky 2022-09-10 14:15:43 +0300
  • 11917c6ddd Do not normalize absolute filenames for creating links in OrgNode Debanjum Singh Solanky 2022-09-10 13:26:03 +0300
  • 07b98d35f1 Use filename or #+TITLE as heading for 0th level content in org files Debanjum Singh Solanky 2022-09-10 13:18:39 +0300
  • d6bd7bf3e1 Fix initializing OrgNode level to string to parse org files Debanjum Singh Solanky 2022-09-10 13:11:58 +0300
  • d835467f2c Throw exception if no valid entries found in specified content files Debanjum Singh Solanky 2022-09-10 13:05:21 +0300
  • e00bb53336 Init word filter dictionary with default value as set to simplify code Debanjum Singh Solanky 2022-09-10 12:16:53 +0300
  • 4d776d9c7a Bump khoj version to 0.1.9 Debanjum Singh Solanky 2022-09-09 07:50:15 +0300
  • b58b7d7483
    Create App Directory, Fix Initialization GUI on First Run v0.1.8 Debanjum 2022-09-09 04:40:22 +0000
  • 588f598949 Pass empty list of `input_files' to FileBrowser on first run Debanjum Singh Solanky 2022-09-09 07:18:05 +0300
  • 3ddffdfba4 Create config directory before setting up logging to file under it Debanjum Singh Solanky 2022-09-09 07:15:28 +0300
  • 79894efc7a
    Resolve GUI Issues in Docker Build Debanjum 2022-09-08 07:55:06 +0000
  • 26ff66f38b (Re-)Enable image search via Docker image as image search issues fixed Debanjum Singh Solanky 2022-09-08 10:42:34 +0300
  • 17354aaffd Install pyqt system package in Docker image to get qt dependencies Debanjum Singh Solanky 2022-09-08 10:39:11 +0300
  • 5d3aeba22f Use --no-gui flag on starting Khoj from docker-compose Debanjum Singh Solanky 2022-09-08 10:37:39 +0300
  • e4d40e4d4d Update setup.py version, Readme. Remove faulty release badge for now Debanjum Singh Solanky 2022-09-07 14:51:03 +0300
  • 35d81de1a1 Update khoj version to 0.1.7 in setup.py v0.1.7 Debanjum Singh Solanky 2022-09-07 13:38:15 +0300
  • 762607fc9f Log processed entries by org_to_jsonl only if verbosity > 2 Debanjum Singh Solanky 2022-09-06 23:01:38 +0300
  • 490157cafa Setup File Filter for Markdown and Ledger content types Debanjum Singh Solanky 2022-09-06 15:27:31 +0300
  • 94cf3e97f3 Log app logs to file for posthoc debugging and performance analysis Debanjum Singh Solanky 2022-09-06 14:51:48 +0300
  • 0a78cd5477
    Create File Filter. Improve, Consolidate Filter Code Debanjum 2022-09-05 15:29:55 +0000
  • 3707a4cdd4 Improve date filter perf. Precompute date to entry map, Cache results Debanjum Singh Solanky 2022-09-05 18:21:29 +0300
  • 31503e7afd Do not pass embeddings as argument to filter.apply method Debanjum Singh Solanky 2022-09-05 15:46:54 +0300
  • 965bd052f1 Make search filters return entry ids satisfying filter Debanjum Singh Solanky 2022-09-05 03:17:41 +0300
  • 7dd20d764c Pre-compute file to entry map in file filter to mark ids to include faster Debanjum Singh Solanky 2022-09-05 02:51:15 +0300
  • 2890b4cd44 Simplify extracting entries satisfying file filter Debanjum Singh Solanky 2022-09-05 02:09:36 +0300
  • 7606724dbc Add file of each entry to entry dict in org_to_jsonl converter Debanjum Singh Solanky 2022-09-05 01:57:17 +0300
  • 7e083d3e96 Cache results for file filters passed in query for faster filtering Debanjum Singh Solanky 2022-09-05 01:51:11 +0300
  • f634399f23 Convert simple file filters with no path separator into regex Debanjum Singh Solanky 2022-09-05 01:45:18 +0300
  • 092b9e329d Setup Filters when configuring Text Search for each Search Type Debanjum Singh Solanky 2022-09-05 01:05:13 +0300
  • 1f9fd28b34 Create File Filter to filter files to query. Add tests for file filter Debanjum Singh Solanky 2022-09-04 19:38:29 +0300
  • e4418746f2 Create Abstract Base Class for Filters. Make Word, Date Filter Child of BaseFilter Debanjum Singh Solanky 2022-09-04 18:05:38 +0300
  • c9f6200007 Ignore pytest_cache directory from git using .gitignore Debanjum Singh Solanky 2022-09-04 17:19:22 +0300
  • f930324350 Rename explicit filter to word filter to be more specific Debanjum Singh Solanky 2022-09-04 17:18:47 +0300
  • d153d420fc
    Improve Latency of Explicit Filter Debanjum 2022-09-04 13:55:17 +0000
  • 6087862521 Use LRU helper class for explicit filter cache Debanjum Singh Solanky 2022-09-04 16:42:28 +0300
  • 8f3326c8d4 Create LRU helper class for caching Debanjum Singh Solanky 2022-09-04 16:31:46 +0300
  • 191a656ed7 Use word to entry map, list comprehension to speed up explicit filter Debanjum Singh Solanky 2022-09-04 15:09:09 +0300
  • 28d3dc1434 Deep copy entries, embeddings in filters. Defer till actual filtering Debanjum Singh Solanky 2022-09-04 02:22:42 +0300
  • 3308e68edf Cache explicitly filtered entries, embeddings by required, blocked words Debanjum Singh Solanky 2022-09-04 02:21:10 +0300
  • cdcee89ae5 Wrap words in quotes to trigger explicit filter from query Debanjum Singh Solanky 2022-09-04 02:12:56 +0300
  • 8d9f507df3 Load entries_by_word_set from file only once on first load of explicit filter Debanjum Singh Solanky 2022-09-04 00:37:37 +0300
  • 858d86075b Use regexes to check if any explicit filters in query. Test can_filter Debanjum Singh Solanky 2022-09-03 23:47:28 +0300
  • 546fad570d Use regex to extract include, exclude filter words from query Debanjum Singh Solanky 2022-09-03 23:33:52 +0300
  • b7d259b1ec Test Explicit Include, Exclude Filters Debanjum Singh Solanky 2022-09-03 23:00:09 +0300
  • ffb8e3988e Use Python Logging Framework to Time Performance of Explicit Filter Debanjum Singh Solanky 2022-09-03 22:14:37 +0300
  • 30c3eb372a Update Tests to Configure Filters and Setup Text Search Debanjum Singh Solanky 2022-09-03 22:13:25 +0300
  • c7de57b8ea Pre-compute entry word sets to improve explicit filter query performance Debanjum Singh Solanky 2022-09-03 16:01:54 +0300
  • 094bd18e57 Use python standard logging framework for app logs Debanjum Singh Solanky 2022-09-03 14:43:32 +0300
  • d0531c3064 Update URL QueryParam when Type set in Dropdown on Web Interface Debanjum Singh Solanky 2022-08-28 12:22:22 +0300
  • 2eae32d743 Time, Log Image Search Performance Debanjum Singh Solanky 2022-08-27 23:49:01 +0300
  • 3b5f9814d8 Revert cli.py Saba 2022-08-27 18:06:52 +0300
  • da59ec2917 Refactor Khoj - Panchayat integration to represent minimal changes required + name the new endpoint Panchayat Saba 2022-08-27 18:05:30 +0300
  • 1e15d266da #4: Add VDB metadata to the compiled field of data for the jsonl processor, and return only the post_id in the raw entry Saba 2022-08-27 17:31:30 +0300
  • c3ca99841b Scale down images to generate image embeddings faster, with less memory Debanjum Singh Solanky 2022-08-24 13:50:42 +0300
  • ea4fdd9134 Fix logic to ignore notes with no body. Add tests to prevent regression Debanjum Singh Solanky 2022-08-21 19:41:40 +0300
  • 5e107eedc0 Rename test_asymmetric_search to now more appropriate test_text_search Debanjum Singh Solanky 2022-08-21 18:36:14 +0300
  • 144986ebfd
    Fix, Improve Desktop GUI Splash Screen and Main Window Debanjum 2022-08-20 23:19:01 +0000
  • d6f624dc75
    Use MPS, CUDA to GPU Accelerate Query Performance Debanjum 2022-08-20 23:16:44 +0000
  • 5e6625ac68 Fix file browser to not add empty line when no file/dir selected Debanjum Singh Solanky 2022-08-21 02:03:28 +0300
  • 8098b8c3a8 Bring Configure Window to Top when Opened from System Tray Debanjum Singh Solanky 2022-08-20 23:38:43 +0300
  • 1c122a8a91 Place window near top so buttons are not hidden by OS bottom bar Debanjum Singh Solanky 2022-08-20 22:38:06 +0300
  • dfe2546c04 Set Khoj Icon on Main Desktop Window Debanjum Singh Solanky 2022-08-20 20:36:15 +0300
  • 1b1f8f9272 Move Splash screen text below icon. Set the text color to black Debanjum Singh Solanky 2022-08-20 20:32:31 +0300
  • 450f6441e2 Fix path to remove shared libraries when packaging the Windows app Debanjum Singh Solanky 2022-08-20 20:29:33 +0300
  • e6abe76875 Upgrade torch, torchvision package versions Debanjum Singh Solanky 2022-08-20 14:45:43 +0300
  • 972523e8a9 Re-enable tests for image search Debanjum Singh Solanky 2022-08-20 14:21:04 +0300
  • 82d2891765 Do not pass ML compute `device' around as argument to search funcs Debanjum Singh Solanky 2022-08-20 14:14:42 +0300
  • acc9091260 Use MPS on Apple Mac M1 to GPU accelerate Encode, Query Performance Debanjum Singh Solanky 2022-08-20 13:21:21 +0300
  • 7de9c58a1c Load models, corpus embeddings onto GPU device for text search, if available Debanjum Singh Solanky 2022-08-20 13:18:31 +0300
  • 7fe3e844d2 Fix setup of Reproducible Build environment in publish workflow v0.1.6 Debanjum Singh Solanky 2022-08-19 21:00:12 +0300
  • dc8dcc94a6 Bump Khoj.el package version to 0.1.6 Debanjum Singh Solanky 2022-08-19 20:48:42 +0300
  • a7b4d58865
    Fix Image Search and Improve Desktop App Debanjum 2022-08-19 17:37:09 +0000
  • b9a54c03ee Add transformers package into Khoj app to run image search Debanjum Singh Solanky 2022-08-19 18:42:49 +0300
  • ffbf15eff8 Add helper function to identify when app running as pyinstaller app Debanjum Singh Solanky 2022-08-18 23:17:21 +0300
  • 6c5c1c33c1 Turn off Tokenizers Parallelism. Khoj doesn't support it right now Debanjum Singh Solanky 2022-08-18 23:14:39 +0300
  • d4072974d7 Use of XMP metadata in Khoj Image Search is broken. Disable by default Debanjum Singh Solanky 2022-08-18 23:10:33 +0300
  • 7c4417126c Append files, directories selected by user to config in Desktop GUI Debanjum Singh Solanky 2022-08-18 22:42:44 +0300
  • 00ddcfdac8 Use .ico icon when packaging for Windows (and Linux) using Pynstaller Debanjum Singh Solanky 2022-08-18 22:07:49 +0300
  • 812838da54 Only exclude libtorch_cuda, libtorch_cpu under torch/lib on Linux Debanjum Singh Solanky 2022-08-18 20:54:59 +0300
  • 6ddcbe2e75 Remove files that triggered warnings during app start Debanjum Singh Solanky 2022-08-18 20:52:34 +0300
  • 60dacf3f2c Show splash screen on app start. Only supported on Windows, Linux Debanjum Singh Solanky 2022-08-18 20:50:25 +0300
  • 0079c13bf7 Set input-directories in config for image search type on Desktop GUI Debanjum Singh Solanky 2022-08-18 18:29:55 +0300
  • 082fe937b9 Reduce Windows App Size by Removing Unused Libraries under Torch/Lib Debanjum Singh Solanky 2022-08-18 11:25:52 +0300