[Bug] Image understanding and paraphrase accuracy about bedrock-claude-chat HOT 8 OPEN

Now the token limit is larger than 4096. We need to modify the frontend so that the app can handle large chunks.

from bedrock-claude-chat.

Now the token limit is larger than 4096. We need to modify the frontend so that the app can handle large chunks.

Thanks for the reply. I'm also wondering how knowledge database can resolve some issues like paraphrasing? For example, if I ask the same question in an alternative way, the response will be "Unfortunately, the contexts provided do not contain any information ... "

from bedrock-claude-chat.

Now the app has limitation shown as the attached. If you need to paste all contexts to the chat, we need to modify the MAX value. Please note that this parameter is not related to RAG.

from bedrock-claude-chat.

Now the app has limitation shown as the attached. If you need to paste all contexts to the chat, we need to modify the MAX value. Please note that this parameter is not related to RAG.

Now the app has limitation shown as the attached. If you need to paste all contexts to the chat, we need to modify the MAX value. Please note that this parameter is not related to RAG.

Thanks for the reply. When can I see this? I'm still confused with how maximum token number is related to paraphrasing capability of knowledge database.

from bedrock-claude-chat.

@dezhouc2
https://github.com/aws-samples/bedrock-claude-chat/pull/449/files

I have increased the max token.

from bedrock-claude-chat.

@k70suK3-k06a7ash1 Thank you so much!
@dezhouc2 I'd be appreciated if you could wait until the PR merged.

from bedrock-claude-chat.

@dezhouc2
Sorry, I misunderstood. The concepts of context window and max tokens are different. The context window (currently 200K) pertains to the input to the LLM, while max tokens (the 4096 you mentioned) is a parameter related to the output. The context window is set automatically, so considering that the current context window size of 200K is sufficient for most issues, your problem likely arises from not being captured in the search results. Please try increasing the number of search results and try again. If it still doesn't work, you will need to check the cited search results in the CloudWatch logs.

from bedrock-claude-chat.

This issue has been labeled as "stale" due to no response by the reporter within 1 month (and 14 days after last commented by someone). And it will be closed automatically 14 days later if not responded.

from bedrock-claude-chat.