anything-llm/server/utils
Timothy Carambat dd7c4675d3
LLM performance metric tracking ()
* WIP performance metric tracking

* fix: patch UI trying to .toFixed() null metric
Anthropic tracking migraiton
cleanup logs

* Apipie implmentation, not tested

* Cleanup Anthropic notes, Add support for AzureOpenAI tracking

* bedrock token metric tracking

* Cohere support

* feat: improve default stream handler to track for provider who are actually OpenAI compliant in usage reporting
add deepseek support

* feat: Add FireworksAI tracking reporting
fix: improve handler when usage:null is reported (why?)

* Add token reporting for GenericOpenAI

* token reporting for koboldcpp + lmstudio

* lint

* support Groq token tracking

* HF token tracking

* token tracking for togetherai

* LiteLLM token tracking

* linting + Mitral token tracking support

* XAI token metric reporting

* native provider runner

* LocalAI token tracking

* Novita token tracking

* OpenRouter token tracking

* Apipie stream metrics

* textwebgenui token tracking

* perplexity token reporting

* ollama token reporting

* lint

* put back comment

* Rip out LC ollama wrapper and use official library

* patch images with new ollama lib

* improve ollama offline message

* fix image handling in ollama llm provider

* lint

* NVIDIA NIM token tracking

* update openai compatbility responses

* UI/UX show/hide metrics on click for user preference

* update bedrock client

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2024-12-16 14:31:17 -08:00
..
agents Add Support for NVIDIA NIM () 2024-12-05 10:38:23 -08:00
AiProviders LLM performance metric tracking () 2024-12-16 14:31:17 -08:00
BackgroundWorkers Add winston logging for production () 2024-07-03 16:39:33 -07:00
boot Add RAG agent plugin to API agent () 2024-08-23 09:32:19 -07:00
chats LLM performance metric tracking () 2024-12-16 14:31:17 -08:00
collectorApi [BETA] Live document sync () 2024-06-21 13:38:50 -07:00
comKey [BETA] Live document sync () 2024-06-21 13:38:50 -07:00
database Full developer api () 2023-08-23 19:15:07 -07:00
DocumentManager Enable ability to do full-text query on documents () 2024-02-21 13:15:45 -08:00
EmbeddingEngines linting 2024-11-21 15:49:59 -08:00
EncryptionManager [BETA] Live document sync () 2024-06-21 13:38:50 -07:00
files Purge cached docs and remove docs from all workspaces on vectorDB/embedder changes () 2024-12-16 12:16:20 -08:00
helpers LLM performance metric tracking () 2024-12-16 14:31:17 -08:00
http Add support for custom agent skills via plugins () 2024-09-10 17:06:02 -07:00
logger patch logger for full logs 2024-07-19 18:35:41 -07:00
middleware Community hub integration () 2024-11-26 09:59:43 -08:00
PasswordRecovery Strengthen field validations on user Updates () 2024-04-26 16:46:04 -07:00
prisma Remove unused deps () 2024-07-25 10:21:03 -07:00
telemetry Replace custom sqlite dbms with prisma () 2023-09-28 14:00:03 -07:00
TextSplitter Add header static class for metadata assembly () 2024-11-04 11:47:46 -08:00
TextToSpeech Tts open ai compatible endpoints () 2024-10-15 21:39:31 -07:00
vectorDbProviders Add header static class for metadata assembly () 2024-11-04 11:47:46 -08:00
vectorStore Purge cached docs and remove docs from all workspaces on vectorDB/embedder changes () 2024-12-16 12:16:20 -08:00