sij/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2025-03-14 14:12:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
anything-llm/collector
History
Timothy Carambat d1ca16f7f8
Add tokenizer improvments via Singleton class and estimation () 
* Add tokenizer improvments via Singleton class
linting

* dev build

* Estimation fallback when string exceeds a fixed byte size

* Add notice to tiktoken on backend
2025-01-30 17:55:03 -08:00
..
extensions Allow 127.0.0.1 as valid URL for scraping () 2024-10-31 09:57:28 -07:00
hotdir Document Processor v2 () 2023-12-14 15:14:56 -08:00
middleware [BETA] Live document sync () 2024-06-21 13:38:50 -07:00
processLink Add tokenizer improvments via Singleton class and estimation () 2025-01-30 17:55:03 -08:00
processRawText Add tokenizer improvments via Singleton class and estimation () 2025-01-30 17:55:03 -08:00
processSingleFile Add tokenizer improvments via Singleton class and estimation () 2025-01-30 17:55:03 -08:00
storage feat: Embed on-instance Whisper model for audio/mp4 transcribing () 2023-12-15 11:20:13 -08:00
utils Add tokenizer improvments via Singleton class and estimation () 2025-01-30 17:55:03 -08:00
.env.example devcontainer v1 () 2024-01-08 15:31:06 -08:00
.gitignore Document Processor v2 () 2023-12-14 15:14:56 -08:00
.nvmrc Document Processor v2 () 2023-12-14 15:14:56 -08:00
index.js Add 3GB file size limit to body parser middlewares () 2024-09-30 11:19:41 -07:00
nodemon.json Document Processor v2 () 2023-12-14 15:14:56 -08:00
package.json Audio file validations () 2024-12-30 14:48:28 -08:00
yarn.lock Audio file validations () 2024-12-30 14:48:28 -08:00