mirror of
https://github.com/khoj-ai/khoj.git
synced 2025-02-17 08:04:21 +00:00
c1128a1ad8
- Chat actors are narrow agents (prompt + ML model)
Chat actors are different from the Chat director. who orchestrates
the narrow actor agents to synthesize final response to the user
- Test Chat Actor Capabilities
1. Answer from retrieved notes
2. Answer from chat history
3. Answer general questions
4. Carry out multi-turn conversation
5. Say don't know when answer not in provided context
6. Answers that require current date awareness
7. Date-aware aggregation across multiple different notes
8. Ask clarification questions if no unambiguous answer in provided context
This test is expected to fail as the chat is not capable of doing
this consistently yet. But having the test allows assessing chat quality
- Use Openai API Key from OPENAI_API_KEY environment variable
- Gitignore .env file, python virtualenv directory
Put OpenAI API Key in .env file to run chatbot tests via vscode
The .env file is default location for importing env vars
|
||
|---|---|---|
| .. | ||
| data | ||
| __init__.py | ||
| conftest.py | ||
| test_beancount_to_jsonl.py | ||
| test_chatbot.py | ||
| test_cli.py | ||
| test_client.py | ||
| test_date_filter.py | ||
| test_file_filter.py | ||
| test_helpers.py | ||
| test_image_search.py | ||
| test_jsonl_to_jsonl.py | ||
| test_markdown_to_jsonl.py | ||
| test_org_to_jsonl.py | ||
| test_orgnode.py | ||
| test_rawconfig.py | ||
| test_text_search.py | ||
| test_word_filter.py | ||