sabaimran
ef21d78c99
Initial changes to support multiple search model configurations
...
- All search models are loaded into memory, and stored in a dictionary indexed by name
- Still need to add database migrations and create a UI for user to select their choice. Presently, it uses the default option
2023-12-05 00:35:40 -05:00
sabaimran
d2ddbef08f
Use a unique name for the temp PDF generated
2023-12-04 19:27:00 -05:00
sabaimran
d20746613a
Properly filter out empty PDFs for indexing
2023-12-04 16:15:17 -05:00
sabaimran
62a89f79b7
Merge pull request #577 from khoj-ai/fix/user-subscription-email-not-exists
...
Fix null exception when user does not exist for subscription
2023-12-03 15:14:31 -08:00
sabaimran
cc064ea57d
Fix circular import issue
2023-12-03 17:46:44 -05:00
sabaimran
21f8d63e89
If a user subscribes to Khoj with an email address that's not present in the DB, create an account
2023-12-03 17:28:40 -05:00
sabaimran
c5d297a9ed
Recursively search through folders for indexing
2023-12-03 16:17:28 -05:00
Debanjum Singh Solanky
a57d529f39
Fix path to system tray icon of Khoj desktop app
2023-12-03 00:12:50 -08:00
Debanjum Singh Solanky
106cdbe455
Release Khoj version 1.1.0
2023-11-30 20:09:08 -08:00
Debanjum Singh Solanky
10ce4ee11c
Ignore null params type check for markdown renderer in Obsidian client
2023-11-30 20:09:08 -08:00
Debanjum
02f40785aa
Merge Github workflows to dockerize for production ( #575 )
2023-11-30 18:49:16 -08:00
sabaimran
a5ffa2342f
Add documentation for local setup and fix admin panel bugs
...
- Wasn't able to login to the admin panel when KHOJ_DEBUG was not True. Fix this error so self-hosted users can get unblocked from accessing the admin settings
- Don't force users to set their KHOJ_DJANGO_SECRET_KEY
2023-11-30 17:55:27 -08:00
Debanjum Singh Solanky
9d4bfdf47c
Merge Github workflows to dockerize for production
2023-11-30 17:18:13 -08:00
Debanjum Singh Solanky
d587632700
Clear result before render thinking placeholder emoji in Obsidian chat
2023-11-30 13:53:09 -08:00
Debanjum
a0686428ff
Render Chat Responses as Markdown in Desktop, Obsidian Client ( #571 )
...
- Show temporary status message when copied to clipboard
- Render chat responses as markdown in Desktop client
- Render chat responses as markdown in chat modal of Obsidian client
- Render references of new responses in chat modal on Obsidian client. Use new style for references
- Properly stop `mediaRecorder` stream to clear microphone in-use state
- Render newlines when references expanded in Web, Desktop and Obsidian clients
2023-11-30 13:52:02 -08:00
Debanjum Singh Solanky
48719ee0dd
Render newline separation in chat references to improve readability
2023-11-30 13:16:48 -08:00
Debanjum Singh Solanky
1a31a2efcf
Render Khoj chat streaming response as md & show refs in Obsidian
...
- Use new style references for Khoj chat modal in Obsidian
- Khoj Chat responses in Obsidian had regressed to not show references
for new questions after modal has been opened. Now even those are
rendered, and use new references style
- Render chat response as markdown while it's being streamed
2023-11-30 13:02:00 -08:00
Debanjum Singh Solanky
0430fa67b6
Show temporary status message when copied to clipboard
2023-11-29 13:49:33 -08:00
Debanjum Singh Solanky
491a1a949a
Render chat responses as markdown in Desktop client too
2023-11-29 13:49:33 -08:00
Debanjum Singh Solanky
20ef5bfc93
Properly stop mediaRecorder stream to clear microphone in-use state
2023-11-29 13:48:35 -08:00
Debanjum Singh Solanky
8faa63c3c6
Convert config page buttons to use stronger yellow
2023-11-28 19:55:43 -08:00
Debanjum Singh Solanky
de5aa5c32e
Update pillow, aiohttp dependencies
2023-11-28 19:55:43 -08:00
sabaimran
fab57cc395
Fix pgvector installation instructions for Windows, Source
2023-11-28 14:46:09 -08:00
sabaimran
c4dcb51c91
Update headings for installation steps to indicate that local and docker setup are exclusive
2023-11-28 14:38:04 -08:00
Debanjum Singh Solanky
a6ca2076d5
Open link to Khoj app landing page from nav pane in current tab
2023-11-28 14:20:37 -08:00
Debanjum Singh Solanky
643e018947
Handle if user subscription field doesn't exists in telemetry func
...
Avoid null ref in the method when running Khoj server in anon mode
2023-11-28 14:15:14 -08:00
Debanjum Singh Solanky
110d7646fc
Use milder yellow as primary Khoj theme color for chat, buttons etc.
2023-11-28 14:15:14 -08:00
sabaimran
18254850ab
Set a default value for the khoj django secret key and add additional guidance for setting environment variables on first run
2023-11-28 09:39:44 -08:00
sabaimran
24b5aaef0a
Merge pull request #569 from khoj-ai/features/enforce-subscription-status
...
Enforce subscription state on the chat API access
2023-11-27 16:12:26 -08:00
sabaimran
6290b463f5
Compute size of the indexed data only if explicitly requested to avoid heavy load on the DB
2023-11-27 12:05:00 -08:00
sabaimran
eb5e3096e0
Change subscribed scope to premium
2023-11-27 11:39:20 -08:00
sabaimran
6e1ba11e59
Resolve merge conflicts for rendering chat response
2023-11-27 11:33:13 -08:00
sabaimran
239b31bc85
Clarify some of the langauge in the chat configuration docs
2023-11-27 10:44:05 -08:00
sabaimran
309ba7234c
Add instructions for setting up chat settings when locally hosting Khoj
2023-11-27 10:41:29 -08:00
sabaimran
5d8dbbdba4
Update instructions for Windows setup and add prerequisites for Docker
2023-11-27 10:32:02 -08:00
Debanjum Singh Solanky
71f2d54258
Render chat response as markdown while streaming on Web, Desktop clients
2023-11-26 20:27:10 -08:00
Debanjum Singh Solanky
9e714d032b
Fix Khoj telemetry server. Add server_version column
2023-11-26 15:05:43 -08:00
Debanjum
ebeae543ee
Speak to Khoj via Desktop, Web or Obsidian Client ( #566 )
...
- Create speech to text API endpoint
- Use OpenAI Whisper for ASR offline (by downloading Whisper model) or online (via OpenAI API)
- Add speech to text model configuration to Database
- Speak to Khoj from the Web, Desktop or Obsidian client
2023-11-26 14:32:11 -08:00
Debanjum Singh Solanky
b249bbb5b5
Limit max audio file size allowed for transcription on API endpoint
2023-11-26 14:19:46 -08:00
sabaimran
e438853b09
Add additional unit tests to verify behavior of unsubscribed/subscribed users
2023-11-26 13:09:00 -08:00
sabaimran
c18d52d1af
Add contributors to the README
2023-11-26 12:05:36 -08:00
Debanjum Singh Solanky
a79604b601
Fix return types of offline, online transcribe methods for python 3.9
2023-11-26 06:26:34 -08:00
Debanjum Singh Solanky
06f99ceb3c
Rename /api/speak API endpoint to /api/transcribe
2023-11-26 06:18:44 -08:00
Debanjum Singh Solanky
56a1a61c77
Remove unused button element retrieval code from web, desktop
2023-11-26 06:17:56 -08:00
Debanjum Singh Solanky
877532a167
Speak to Khoj from the Obsidian client
...
- Add transcription button with mic icon
- Collect audio recording on pressing mic
- Process and send audio recording to server for transcription
- Extract the functionality to flash status in chat input for reuse
2023-11-26 06:17:54 -08:00
Debanjum Singh Solanky
cc9eae5d18
Update default chat model to Mistral in GPT4AllProcessor config
2023-11-26 05:55:43 -08:00
Debanjum Singh Solanky
4636390f7f
Transcribe speech to text offline with Whisper
...
- Allow server admin to configure offline speech to text model during
initialization
- Use offline speech to text model to transcribe audio from clients
- Set offline whisper as default speech to text model as no setup api key reqd
2023-11-26 05:55:11 -08:00
Debanjum Singh Solanky
a0a7ab7ec8
Rename conversation.gpt4all package to conversation.offline
2023-11-26 04:19:32 -08:00
Debanjum Singh Solanky
499adf86a0
Move transcription using OpenAI API into independent package
2023-11-26 04:19:32 -08:00
Debanjum Singh Solanky
897170ab15
Use single db migration script for transcribe model, related updates
2023-11-26 04:19:32 -08:00