Commit graph

1131 commits

Author SHA1 Message Date
Chaiwat Saithongcum
fa3079bbbf
Add support for Google Generative AI (Gemini) embedder ()
* Add support for Google Generative AI (Gemini) embedder

* Add missing example in docker
Fix UI key elements in options
Add Gemini to data handling section
Patch issues with chunk handling during embedding

* remove dupe in env

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-31 09:29:38 -08:00
Sean Hatfield
8d302c3f67
Patch custom models endpoint ()
* prevent non admin users from changing llm settings via custom-models endpoint

* permission middleware to JSDOC

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-30 14:58:26 -08:00
Sean Hatfield
dd017c6cbb
Audio file validations ()
* add audio file validations

* patch sharp to support wavfile parsing

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-30 14:48:28 -08:00
Sean Hatfield
696af19c45
Patch unauthorized access to other user's pfps ()
* patch unauthorized viewing of other user's pfps

* inline return responses

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-30 14:36:51 -08:00
Sean Hatfield
0b7bf68f2c
Normalize paths on files uploaded to prevent arbitrary file writes ()
* normalize paths on files uploaded to prevent arbitrary file writes

* force normalize path in string parse

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-30 14:29:10 -08:00
Sean Hatfield
99b6dedc8b
Fix typo in frontend for SearXNG agent setup ()
fix typo in frontend for SearXNG agent setup
2024-12-30 14:11:20 -08:00
Sean Hatfield
bbc0bec524
Show scrollbar on rendered tables in chat ()
show scrollbar on rendered tables in chat

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-28 17:55:43 -08:00
timothycarambat
4b2bb529c9 enable leftover mlock setting 2024-12-28 17:48:24 -08:00
timothycarambat
2149fb709a Patch gemini dropdown to model id since names are wrong for the different versions
connect 
2024-12-28 17:27:32 -08:00
Sean Hatfield
dca27e7235
Fix styles of ChangeWarningModal ()
fix styles of ChangeWarningModal
2024-12-18 16:15:33 -08:00
timothycarambat
eb33e0f775 more table styles for lightmode 2024-12-18 13:00:02 -08:00
Sean Hatfield
f894b60bd8
Fix light mode table colors ()
* fix light mode table colors

* fix table styles from being overwritten in other sections that are not chat messages

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-18 11:49:59 -08:00
Timothy Carambat
a51de73aaa
update ollama performance mode () 2024-12-18 11:21:35 -08:00
wolfganghuse
af703427c7
fix wrong metadata assignment in MilvusProvider ()
fixed wrong metadata assignment
2024-12-18 10:33:18 -08:00
Timothy Carambat
d54b5dfc62
Remove fine-tuning flow ()
remove fine-tuning flow
2024-12-18 10:24:02 -08:00
Timothy Carambat
b082c8e441
Add support for gemini authenticated models endpoint ()
* Add support for gemini authenticated models endpoint
add customModels entry
add un-authed fallback to default listing
separate models by expiermental status
resolves 

* add back improved logic for apiVersion decision making
2024-12-17 15:20:26 -08:00
Timothy Carambat
71cd5e5b28
Enable default roles to be able to use attachments but not upload documents ()
* Enable default users to be able to add attachments, but not files to chats
2024-12-16 15:28:22 -08:00
Sean Hatfield
f8885a43e4
Append writable fields to dev API new workspace endpoint ()
* add writible fields to dev api new workspace endpoint

* lint

* implement validations for workspace model

* update swagger comments

* simplify validations for workspace on frontend and API

* cleanup validations

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-16 15:12:20 -08:00
Timothy Carambat
dd7c4675d3
LLM performance metric tracking ()
* WIP performance metric tracking

* fix: patch UI trying to .toFixed() null metric
Anthropic tracking migraiton
cleanup logs

* Apipie implmentation, not tested

* Cleanup Anthropic notes, Add support for AzureOpenAI tracking

* bedrock token metric tracking

* Cohere support

* feat: improve default stream handler to track for provider who are actually OpenAI compliant in usage reporting
add deepseek support

* feat: Add FireworksAI tracking reporting
fix: improve handler when usage:null is reported (why?)

* Add token reporting for GenericOpenAI

* token reporting for koboldcpp + lmstudio

* lint

* support Groq token tracking

* HF token tracking

* token tracking for togetherai

* LiteLLM token tracking

* linting + Mitral token tracking support

* XAI token metric reporting

* native provider runner

* LocalAI token tracking

* Novita token tracking

* OpenRouter token tracking

* Apipie stream metrics

* textwebgenui token tracking

* perplexity token reporting

* ollama token reporting

* lint

* put back comment

* Rip out LC ollama wrapper and use official library

* patch images with new ollama lib

* improve ollama offline message

* fix image handling in ollama llm provider

* lint

* NVIDIA NIM token tracking

* update openai compatbility responses

* UI/UX show/hide metrics on click for user preference

* update bedrock client

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2024-12-16 14:31:17 -08:00
timothycarambat
15abc3f803 Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2024-12-16 13:16:51 -08:00
timothycarambat
55c488d745 remove dependabot 2024-12-16 13:16:39 -08:00
Sean Hatfield
ae510619f0
Purge cached docs and remove docs from all workspaces on vectorDB/embedder changes ()
* wip remove all docs clear vector db on embedder/vector db change

* purge all cached docs and remove docs from workspaces on vectordb/embedder change

* lint

* remove unneeded console log

* remove reset vector stores endpoint and move to server side updateENV with postUpdate check

* reset embed module

* remove unused import

* simplify deletion process
rescoped document deletion to be more general for speed, everything needs to be reset anyway
fixed issue where unembedded docs not in any workspaces, but cached, were not removed

* add back missing readme file
update warning text modals

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-16 12:16:20 -08:00
wolfganghuse
d145602d5a
Add attachments to GenericOpenAI prompt ()
* added attachments to genericopenai prompt

* add devnote

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-16 12:03:51 -08:00
Timothy Carambat
ff024286d0
Add new workspace user management endpoint ()
deprecate old endpoint which users workspace ID vs slug
resolves 
2024-12-16 11:50:34 -08:00
timothycarambat
827c3f4678 repatch scout cli 2024-12-13 18:30:54 -08:00
Sean Hatfield
79cdcd4e64
Add thread name to workspaces get endpoint ()
add thread name to workspaces get endpoint

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-13 17:53:54 -08:00
Sean Hatfield
f651ca8628
APIPie LLM provider improvements ()
* fix apipie streaming/sort by chat models

* lint

* linting

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-13 14:18:02 -08:00
Timothy Carambat
afbb65f484
Pin all docker-scout CI versions to 1.15.1 for now 2024-12-12 15:01:54 -08:00
Andy Santana
0f52afdb9c
Fix(2753): Replace React Router Navigate with window.location for SSO state refresh ()
* fix(2753): update SSO redirect to use window.location.replace

* fix(2753): remove unused import

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-12 13:33:30 -08:00
Timothy Carambat
a46eb2418a
add Gitlab to watchable documents () 2024-12-12 10:44:11 -08:00
Timothy Carambat
a89d8fcfe4
patch ZH typo () 2024-12-12 10:24:42 -08:00
Timothy Carambat
538078747d
Add vector search API endpoint ()
* Add vector search API endpoint

* Add missing import

* Modify the data that is returned

* Change similarityThreshold to scoreThreshold

As this is what is actually returned by the search

* Removing logging (oops!)

* chore: regen swagger docs for new endpoint
fix: update function to sanity check values to prevent crashes during search

---------

Co-authored-by: Scott Bowler <scott@dcsdigital.co.uk>
2024-12-12 10:12:32 -08:00
Timothy Carambat
e4a556d551
Add support for hiding sidebar ()
* Add support for hiding sidebar
Support cmd/ctrl + shift +s for quick hide/show

* patch sidebar padding on collapse

* update Key for sidebar setting
2024-12-11 17:18:38 -08:00
Sean Hatfield
426e2360b3
Redirect to default thread on thread deletion ()
* redirect to default thread on thread deletion

* reset submodule

* handle redirect on bulk delete thread

* redirect on bulk thread delete only if deleted thread is selected

* redirect only on single delete of active thread

* lint

* patch threadSlug for clarity

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-11 17:00:30 -08:00
timothycarambat
f8e91e1ffa patch gemini-2.0-key 2024-12-11 16:52:31 -08:00
timothycarambat
66520b48a4 silence dependabot for now 2024-12-11 14:48:35 -08:00
Sean Hatfield
71a6646b47
Fix timestamp bug in embed widget ()
* fix timestamp bug in embed widget

* bump embed for formatDate fallback

* bump embed module

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-11 14:15:15 -08:00
Sean Hatfield
9bc01afa7d
Fix scraping failed bug in link/bulk link scrapers ()
* fix scraping failed bug in link/bulk link scrapers

* reset submodule

* swap to networkidle2 as a safe mix for SPA and API-loaded pages, but also not hang on request heavy pages

* lint

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-11 14:01:52 -08:00
Logan Reeder
6bc21860e4
Fixed a typo in README () 2024-12-11 13:43:18 -08:00
timothycarambat
69b672b625 add gemini 1206 and gemini-2.0-flash exp models
connect 
2024-12-11 09:04:29 -08:00
Timothy Carambat
a69997a715
update chat model filters for openai () 2024-12-11 08:55:10 -08:00
timothycarambat
a0c5d898f0 patch docs with proper input for OpenAI compatible embeddings
resolves 
2024-12-11 08:15:52 -08:00
timothycarambat
4b09a06590 persist token window for NIM and not only on model change 2024-12-05 11:57:07 -08:00
Timothy Carambat
b2dd35fe15
Add Support for NVIDIA NIM ()
* Add Support for NVIDIA NIM

* update README

* linting
2024-12-05 10:38:23 -08:00
timothycarambat
6c9e234227 patch button normalization for desktop builds 2024-11-26 11:48:28 -08:00
Sean Hatfield
9608599dd2
Community hub integration UX improvements ()
* add empty states to your account hub page + disconnect button for api key

* lint

* lint

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-11-26 11:39:37 -08:00
timothycarambat
c3d098fdb9 Patch light mode on Community Hub import flow 2024-11-26 10:31:38 -08:00
Sean Hatfield
05c530221b
Community hub integration ()
* wip hub connection page fe + backend

* lint

* implement backend for local hub items + placeholder endpoints to fetch hub app data

* fix hebrew translations

* revamp community integration flow

* change sidebar

* Auto import if id in URL param
remove preview in card screen and instead go to import flow

* get user's items + team items from hub + ui improvements to hub settings

* lint

* fix merge conflict

* refresh hook for community items

* add fallback for user items

* Disable bundle items by default on all instances

* remove translations (will complete later)

* loading skeleton

* Make community hub endpoints admin only
show visibility on items
combine import/apply for items to they are event logged for review

* improve middleware and import flow

* community hub ui updates

* Adjust importing process

* community hub to dev

* Add webscraper preload into imported plugins

* add runtime property to plugins

* Fix button status on imported skill change
show alert on skill change
Update markdown type and theme on import of agent skill

* update documentaion paths

* remove unused import

* linting

* review loading state

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-11-26 09:59:43 -08:00
timothycarambat
8c9e9f2ec1 fix advanced setting fields hover onlight mode 2024-11-25 21:08:52 -08:00
Timothy Carambat
f7289cd90f
Normalize Input Fields ()
* WIP field normalization

* more norms
2024-11-25 21:07:23 -08:00