sij/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2025-04-26 14:29:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
994 commits 42 branches 15 tags 159 MiB
Commit graph

4 commits

Author SHA1 Message Date
Sean Hatfield
2797298507
Fix depth handling in bulk link scraper () 
fix depth handling in bulk link scraper
 2024-08-12 11:44:35 -07:00
Sean Hatfield
fc375f4036
[FIX] Bulk link scraper bug fix () 
patch website depth data connector to work for other links that are not root url
 2024-07-01 16:59:28 -07:00
timothycarambat
b5ac944475 patch: bulk-scraper, update when folder is made and path creation params 2024-05-14 12:57:23 -07:00
Sean Hatfield
612a7e1662
[FEAT] Website depth scraping data connector () 
* WIP website depth scraping, (sort of works)

* website depth data connector stable + add maxLinks option

* linting + loading small ui tweak

* refactor website depth data connector for stability, speed, & readability

* patch: remove console log
Guard clause on URL validitiy check
reasonable overrides

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
 2024-05-14 12:49:14 -07:00