Comments (8)
Now the token limit is larger than 4096. We need to modify the frontend so that the app can handle large chunks.
from bedrock-claude-chat.
Now the token limit is larger than 4096. We need to modify the frontend so that the app can handle large chunks.
Thanks for the reply. I'm also wondering how knowledge database can resolve some issues like paraphrasing? For example, if I ask the same question in an alternative way, the response will be "Unfortunately, the contexts provided do not contain any information ... "
from bedrock-claude-chat.
Now the app has limitation shown as the attached. If you need to paste all contexts to the chat, we need to modify the MAX value. Please note that this parameter is not related to RAG.
from bedrock-claude-chat.
Now the app has limitation shown as the attached. If you need to paste all contexts to the chat, we need to modify the MAX value. Please note that this parameter is not related to RAG.
Now the app has limitation shown as the attached. If you need to paste all contexts to the chat, we need to modify the MAX value. Please note that this parameter is not related to RAG.
Thanks for the reply. When can I see this? I'm still confused with how maximum token number is related to paraphrasing capability of knowledge database.
from bedrock-claude-chat.
@dezhouc2
https://github.com/aws-samples/bedrock-claude-chat/pull/449/files
I have increased the max token.
from bedrock-claude-chat.
@k70suK3-k06a7ash1 Thank you so much!
@dezhouc2 I'd be appreciated if you could wait until the PR merged.
from bedrock-claude-chat.
@dezhouc2
Sorry, I misunderstood. The concepts of context window and max tokens are different. The context window (currently 200K) pertains to the input to the LLM, while max tokens (the 4096 you mentioned) is a parameter related to the output. The context window is set automatically, so considering that the current context window size of 200K is sufficient for most issues, your problem likely arises from not being captured in the search results. Please try increasing the number of search results and try again. If it still doesn't work, you will need to check the cited search results in the CloudWatch logs.
from bedrock-claude-chat.
This issue has been labeled as "stale" due to no response by the reporter within 1 month (and 14 days after last commented by someone). And it will be closed automatically 14 days later if not responded.
from bedrock-claude-chat.
Related Issues (20)
- [BUG] Chat input textarea partially hidden and inaccessible on narrow screens (<1024px)
- [BUG] Stuttery auto-scroll to the bottom of the page when outputting code HOT 7
- [Feature Request] Adding option to distable StandbyReplicas for OpenSearch Serverless
- [Feature Request] Add Admin Page for Managing All User Bots
- [Feature Request] Exclusive control for embedding
- [Feature Request] Refactoring Agent functionality with Converse API tool
- [BUG] Issue when calling API's HOT 1
- [BUG]`Admin` users cannot create / publish customized bot through frontend
- [Feature Request] Add commit hook
- ValidationException when trying create a Bot HOT 4
- [Feature Request]Ability to connect to existing Knowledge Base HOT 6
- [BUG] Not able to cdk deploy . Error Insufficient Lake Formation permission(s): Required Create Database on Catalog (Service: AWSGlue; Status Code: 400 HOT 3
- [BUG] Chat Regenerate does not respect websocket preferences HOT 1
- [Feature Request] Run the python or another languages codes using ECR images or docker hub
- [Feature Request] Support deployment from SageMaker Code Editor HOT 3
- [Feature Request] Private Streaming and Backend APIs
- [BUG] Cannot remember context/chat history in Published (Bot) API HOT 5
- [BUG] Lambda based Youtube video transcript download seems to be blocked HOT 2
- [Feature Request] Reports Section
- Login button doesn't work with Route53 A record pointing to cloudfront distribution
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bedrock-claude-chat.