sij/khoj
1
0
Fork 0
mirror of https://github.com/khoj-ai/khoj.git synced 2024-12-18 18:47:11 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 23

Only auto load available chat models from Ollama provider for now

Browse source 
Allowing models from any openai proxy service makes it too unwieldy.
And a bunch of them do not even support this endpoint.
This commit is contained in:
Debanjum 2024-12-08 18:05:14 -08:00
parent 2c934162d3
commit 3fd8614a4b
1 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
src/khoj/utils/initialization.py
View file

@ -235,6 +235,10 @@ def initialization(interactive: bool = True):
# Get OpenAI configs with custom base URLs # Get OpenAI configs with custom base URLs
custom_configs = AiModelApi.objects.exclude(api_base_url__isnull=True) custom_configs = AiModelApi.objects.exclude(api_base_url__isnull=True)
# Only enable for whitelisted provider names (i.e Ollama) for now
# TODO: This is hacky. Will be replaced with more robust solution based on provider type enum
custom_configs = custom_configs.filter(name__in=["Ollama"])
for config in custom_configs: for config in custom_configs:
try: try:
# Create OpenAI client with custom base URL # Create OpenAI client with custom base URL