Commit graph

1163 commits

Author SHA1 Message Date
Timothy Carambat
dd7c4675d3
LLM performance metric tracking ()
* WIP performance metric tracking

* fix: patch UI trying to .toFixed() null metric
Anthropic tracking migraiton
cleanup logs

* Apipie implmentation, not tested

* Cleanup Anthropic notes, Add support for AzureOpenAI tracking

* bedrock token metric tracking

* Cohere support

* feat: improve default stream handler to track for provider who are actually OpenAI compliant in usage reporting
add deepseek support

* feat: Add FireworksAI tracking reporting
fix: improve handler when usage:null is reported (why?)

* Add token reporting for GenericOpenAI

* token reporting for koboldcpp + lmstudio

* lint

* support Groq token tracking

* HF token tracking

* token tracking for togetherai

* LiteLLM token tracking

* linting + Mitral token tracking support

* XAI token metric reporting

* native provider runner

* LocalAI token tracking

* Novita token tracking

* OpenRouter token tracking

* Apipie stream metrics

* textwebgenui token tracking

* perplexity token reporting

* ollama token reporting

* lint

* put back comment

* Rip out LC ollama wrapper and use official library

* patch images with new ollama lib

* improve ollama offline message

* fix image handling in ollama llm provider

* lint

* NVIDIA NIM token tracking

* update openai compatbility responses

* UI/UX show/hide metrics on click for user preference

* update bedrock client

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2024-12-16 14:31:17 -08:00
timothycarambat
15abc3f803 Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2024-12-16 13:16:51 -08:00
timothycarambat
55c488d745 remove dependabot 2024-12-16 13:16:39 -08:00
Sean Hatfield
ae510619f0
Purge cached docs and remove docs from all workspaces on vectorDB/embedder changes ()
* wip remove all docs clear vector db on embedder/vector db change

* purge all cached docs and remove docs from workspaces on vectordb/embedder change

* lint

* remove unneeded console log

* remove reset vector stores endpoint and move to server side updateENV with postUpdate check

* reset embed module

* remove unused import

* simplify deletion process
rescoped document deletion to be more general for speed, everything needs to be reset anyway
fixed issue where unembedded docs not in any workspaces, but cached, were not removed

* add back missing readme file
update warning text modals

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-16 12:16:20 -08:00
wolfganghuse
d145602d5a
Add attachments to GenericOpenAI prompt ()
* added attachments to genericopenai prompt

* add devnote

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-16 12:03:51 -08:00
Timothy Carambat
ff024286d0
Add new workspace user management endpoint ()
deprecate old endpoint which users workspace ID vs slug
resolves 
2024-12-16 11:50:34 -08:00
timothycarambat
827c3f4678 repatch scout cli 2024-12-13 18:30:54 -08:00
Sean Hatfield
79cdcd4e64
Add thread name to workspaces get endpoint ()
add thread name to workspaces get endpoint

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-13 17:53:54 -08:00
Sean Hatfield
f651ca8628
APIPie LLM provider improvements ()
* fix apipie streaming/sort by chat models

* lint

* linting

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-13 14:18:02 -08:00
Timothy Carambat
afbb65f484
Pin all docker-scout CI versions to 1.15.1 for now 2024-12-12 15:01:54 -08:00
Andy Santana
0f52afdb9c
Fix(2753): Replace React Router Navigate with window.location for SSO state refresh ()
* fix(2753): update SSO redirect to use window.location.replace

* fix(2753): remove unused import

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-12 13:33:30 -08:00
Timothy Carambat
a46eb2418a
add Gitlab to watchable documents () 2024-12-12 10:44:11 -08:00
Timothy Carambat
a89d8fcfe4
patch ZH typo () 2024-12-12 10:24:42 -08:00
Timothy Carambat
538078747d
Add vector search API endpoint ()
* Add vector search API endpoint

* Add missing import

* Modify the data that is returned

* Change similarityThreshold to scoreThreshold

As this is what is actually returned by the search

* Removing logging (oops!)

* chore: regen swagger docs for new endpoint
fix: update function to sanity check values to prevent crashes during search

---------

Co-authored-by: Scott Bowler <scott@dcsdigital.co.uk>
2024-12-12 10:12:32 -08:00
Timothy Carambat
e4a556d551
Add support for hiding sidebar ()
* Add support for hiding sidebar
Support cmd/ctrl + shift +s for quick hide/show

* patch sidebar padding on collapse

* update Key for sidebar setting
2024-12-11 17:18:38 -08:00
Sean Hatfield
426e2360b3
Redirect to default thread on thread deletion ()
* redirect to default thread on thread deletion

* reset submodule

* handle redirect on bulk delete thread

* redirect on bulk thread delete only if deleted thread is selected

* redirect only on single delete of active thread

* lint

* patch threadSlug for clarity

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-12-11 17:00:30 -08:00
timothycarambat
f8e91e1ffa patch gemini-2.0-key 2024-12-11 16:52:31 -08:00
timothycarambat
66520b48a4 silence dependabot for now 2024-12-11 14:48:35 -08:00
Sean Hatfield
71a6646b47
Fix timestamp bug in embed widget ()
* fix timestamp bug in embed widget

* bump embed for formatDate fallback

* bump embed module

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-11 14:15:15 -08:00
Sean Hatfield
9bc01afa7d
Fix scraping failed bug in link/bulk link scrapers ()
* fix scraping failed bug in link/bulk link scrapers

* reset submodule

* swap to networkidle2 as a safe mix for SPA and API-loaded pages, but also not hang on request heavy pages

* lint

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-12-11 14:01:52 -08:00
Logan Reeder
6bc21860e4
Fixed a typo in README () 2024-12-11 13:43:18 -08:00
timothycarambat
69b672b625 add gemini 1206 and gemini-2.0-flash exp models
connect 
2024-12-11 09:04:29 -08:00
Timothy Carambat
a69997a715
update chat model filters for openai () 2024-12-11 08:55:10 -08:00
timothycarambat
a0c5d898f0 patch docs with proper input for OpenAI compatible embeddings
resolves 
2024-12-11 08:15:52 -08:00
timothycarambat
4b09a06590 persist token window for NIM and not only on model change 2024-12-05 11:57:07 -08:00
Timothy Carambat
b2dd35fe15
Add Support for NVIDIA NIM ()
* Add Support for NVIDIA NIM

* update README

* linting
2024-12-05 10:38:23 -08:00
timothycarambat
6c9e234227 patch button normalization for desktop builds 2024-11-26 11:48:28 -08:00
Sean Hatfield
9608599dd2
Community hub integration UX improvements ()
* add empty states to your account hub page + disconnect button for api key

* lint

* lint

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-11-26 11:39:37 -08:00
timothycarambat
c3d098fdb9 Patch light mode on Community Hub import flow 2024-11-26 10:31:38 -08:00
Sean Hatfield
05c530221b
Community hub integration ()
* wip hub connection page fe + backend

* lint

* implement backend for local hub items + placeholder endpoints to fetch hub app data

* fix hebrew translations

* revamp community integration flow

* change sidebar

* Auto import if id in URL param
remove preview in card screen and instead go to import flow

* get user's items + team items from hub + ui improvements to hub settings

* lint

* fix merge conflict

* refresh hook for community items

* add fallback for user items

* Disable bundle items by default on all instances

* remove translations (will complete later)

* loading skeleton

* Make community hub endpoints admin only
show visibility on items
combine import/apply for items to they are event logged for review

* improve middleware and import flow

* community hub ui updates

* Adjust importing process

* community hub to dev

* Add webscraper preload into imported plugins

* add runtime property to plugins

* Fix button status on imported skill change
show alert on skill change
Update markdown type and theme on import of agent skill

* update documentaion paths

* remove unused import

* linting

* review loading state

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-11-26 09:59:43 -08:00
timothycarambat
8c9e9f2ec1 fix advanced setting fields hover onlight mode 2024-11-25 21:08:52 -08:00
Timothy Carambat
f7289cd90f
Normalize Input Fields ()
* WIP field normalization

* more norms
2024-11-25 21:07:23 -08:00
Timothy Carambat
c9d49a5f32
Fix markdown issue where type is missing in backticks () 2024-11-25 17:47:13 -08:00
Tuan Nguyen
b2c18ba41e
Fix typo with GCP deploy guideline () 2024-11-25 17:38:27 -08:00
timothycarambat
8dcf23748c fix mistral key on embedder selection 2024-11-22 16:47:27 -08:00
timothycarambat
62be0cd0c5 add gemini-exp-1121 to expiermental set 2024-11-22 09:36:44 -08:00
timothycarambat
e4f47c1abf linting 2024-11-21 15:49:59 -08:00
timothycarambat
56793ed9a0 Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2024-11-21 12:43:36 -08:00
timothycarambat
f6ab3313c7 patch baseURL in builder for logo 2024-11-21 12:43:27 -08:00
Debugs
c30ebb7fb1
feat: Add Vietnamese translations and configuration ()
* Create common.js

update file common.js language vietnam

* Update resources.js

* Update common.js

* Update resources.js

* Update common.js

* Update resources.js

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-11-21 12:09:10 -08:00
Sean Hatfield
190a481536
Adjustable font size in chat input ()
* adjustable prompt input text sizing

* dev build

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-11-21 12:07:46 -08:00
hdelossantos
304796ec59
feat: support setting maxConcurrentChunks for Generic OpenAI embedder ()
* exposes `maxConcurrentChunks` parameter for the generic openai embedder through configuration. This allows setting a batch size for endpoints which don't support the default of 500

* Update new field to new UI
make getting to ensure proper type and format

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-11-21 11:29:44 -08:00
Timothy Carambat
b66017d024
Pr 2653 branch ()
* feat: initial setup for Dependabot

* remove embed folder check

---------

Co-authored-by: Philipp Eckel <philipp.eckel@intive.com>
2024-11-21 11:09:03 -08:00
Sean Hatfield
9f38b9337b
Mistral embedding engine support ()
* add mistral embedding engine support

* remove console log + fix data handling onboarding

* update data handling description

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2024-11-21 11:05:55 -08:00
timothycarambat
246152c024 Add gemini-exp-1121
resolves 
2024-11-21 11:02:43 -08:00
Sean Hatfield
55fc9cd6b1
TogetherAI Llama 3.2 vision models support ()
* togetherai llama 3.2 vision models support

* remove console log

* fix listing to reflect what is on the chart

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2024-11-21 10:42:42 -08:00
Timothy Carambat
5e698534fe
Add plaintext file extensions () 2024-11-20 09:56:03 -08:00
Timothy Carambat
26e2d8cc3b
Add more expiermental models from Gemini () 2024-11-20 09:52:33 -08:00
Timothy Carambat
907a03bb67
Pr 2660 branch ()
* Add a basic Traditional Chinese(zh_TW) locale

* patch lang code

---------

Co-authored-by: Peter Dave Hello <hsu@peterdavehello.org>
2024-11-20 09:34:53 -08:00
timothycarambat
363f51ab51 refresh theme without reloading page 2024-11-19 20:38:07 -08:00