anything-llm/server
Timothy Carambat dd7c4675d3
LLM performance metric tracking ()
* WIP performance metric tracking

* fix: patch UI trying to .toFixed() null metric
Anthropic tracking migraiton
cleanup logs

* Apipie implmentation, not tested

* Cleanup Anthropic notes, Add support for AzureOpenAI tracking

* bedrock token metric tracking

* Cohere support

* feat: improve default stream handler to track for provider who are actually OpenAI compliant in usage reporting
add deepseek support

* feat: Add FireworksAI tracking reporting
fix: improve handler when usage:null is reported (why?)

* Add token reporting for GenericOpenAI

* token reporting for koboldcpp + lmstudio

* lint

* support Groq token tracking

* HF token tracking

* token tracking for togetherai

* LiteLLM token tracking

* linting + Mitral token tracking support

* XAI token metric reporting

* native provider runner

* LocalAI token tracking

* Novita token tracking

* OpenRouter token tracking

* Apipie stream metrics

* textwebgenui token tracking

* perplexity token reporting

* ollama token reporting

* lint

* put back comment

* Rip out LC ollama wrapper and use official library

* patch images with new ollama lib

* improve ollama offline message

* fix image handling in ollama llm provider

* lint

* NVIDIA NIM token tracking

* update openai compatbility responses

* UI/UX show/hide metrics on click for user preference

* update bedrock client

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2024-12-16 14:31:17 -08:00
..
endpoints LLM performance metric tracking () 2024-12-16 14:31:17 -08:00
jobs add Gitlab to watchable documents () 2024-12-12 10:44:11 -08:00
models Purge cached docs and remove docs from all workspaces on vectorDB/embedder changes () 2024-12-16 12:16:20 -08:00
prisma Add index leftover from prisma migration from PR 2024-10-29 16:35:56 -07:00
storage 2488 novita ai llm integration () 2024-11-04 11:34:29 -08:00
swagger Add new workspace user management endpoint () 2024-12-16 11:50:34 -08:00
utils LLM performance metric tracking () 2024-12-16 14:31:17 -08:00
.env.example LLM performance metric tracking () 2024-12-16 14:31:17 -08:00
.flowconfig devcontainer v1 () 2024-01-08 15:31:06 -08:00
.gitignore Add support for custom agent skills via plugins () 2024-09-10 17:06:02 -07:00
.nvmrc Implement Chroma Support () 2023-06-07 21:31:35 -07:00
index.js Community hub integration () 2024-11-26 09:59:43 -08:00
jsconfig.json devcontainer v1 () 2024-01-08 15:31:06 -08:00
nodemon.json Full developer api () 2023-08-23 19:15:07 -07:00
package.json Community hub integration () 2024-11-26 09:59:43 -08:00
yarn.lock Community hub integration () 2024-11-26 09:59:43 -08:00