anything-llm/server/endpoints/api
Timothy Carambat dd7c4675d3
LLM performance metric tracking ()
* WIP performance metric tracking

* fix: patch UI trying to .toFixed() null metric
Anthropic tracking migraiton
cleanup logs

* Apipie implmentation, not tested

* Cleanup Anthropic notes, Add support for AzureOpenAI tracking

* bedrock token metric tracking

* Cohere support

* feat: improve default stream handler to track for provider who are actually OpenAI compliant in usage reporting
add deepseek support

* feat: Add FireworksAI tracking reporting
fix: improve handler when usage:null is reported (why?)

* Add token reporting for GenericOpenAI

* token reporting for koboldcpp + lmstudio

* lint

* support Groq token tracking

* HF token tracking

* token tracking for togetherai

* LiteLLM token tracking

* linting + Mitral token tracking support

* XAI token metric reporting

* native provider runner

* LocalAI token tracking

* Novita token tracking

* OpenRouter token tracking

* Apipie stream metrics

* textwebgenui token tracking

* perplexity token reporting

* ollama token reporting

* lint

* put back comment

* Rip out LC ollama wrapper and use official library

* patch images with new ollama lib

* improve ollama offline message

* fix image handling in ollama llm provider

* lint

* NVIDIA NIM token tracking

* update openai compatbility responses

* UI/UX show/hide metrics on click for user preference

* update bedrock client

---------

Co-authored-by: shatfield4 <seanhatfield5@gmail.com>
2024-12-16 14:31:17 -08:00
..
admin LLM performance metric tracking () 2024-12-16 14:31:17 -08:00
auth Full developer api () 2023-08-23 19:15:07 -07:00
document Patch v1/document/upload filename charset encoding () 2024-10-25 12:03:19 -07:00
embed fix validation issue 2024-08-07 14:24:24 -07:00
openai patch docs with proper input for OpenAI compatible embeddings 2024-12-11 08:15:52 -08:00
system Bug/make swagger json output openapi 3 compliant () 2024-09-04 15:40:24 -07:00
userManagement Simple SSO feature for login flows from external services () 2024-10-29 15:30:53 -07:00
workspace Add thread name to workspaces get endpoint () 2024-12-13 17:53:54 -08:00
workspaceThread Feature/thread creation slug name () 2024-10-21 13:09:55 -07:00
index.js Developer API access for embed chat widgets () 2024-08-07 11:36:32 -07:00