FloTorch Version
v3.0.1
Bug Description
While executing a batch of experiments with guardrails configured, some experiments fail unexpectedly. The failures occur inconsistently
Steps to Reproduce
Steps to Reproduce
Login to FloTorch.ai
Click on Get Started button
click on Create Project
Enter the Project Name, select the region
Navigate to the Knowledge Bases selection section.
Select an AWS Bedrock Knowledge Base for embedding.Click on Next
Select the N shot prompt and attach the N shot prompt file
Select the KNN value
Select the any of the inferencing models
Select the inferencing model temperature
Click on Next button
Select the Ragas evaluation, embedding model and Inferencing model
Click on Submit
Expected Behavior:
All experiments should execute successfully, and guardrails should apply seamlessly without causing execution failures.
Actual Behavior:
Some experiments fail partway through execution when guardrails are enabled.
Browser and Version
135.0.7049.115
Runtime Version
3.12
Error Messages
Additional Context
No response
FloTorch Version
v3.0.1
Bug Description
While executing a batch of experiments with guardrails configured, some experiments fail unexpectedly. The failures occur inconsistently
Steps to Reproduce
Steps to Reproduce
Login to FloTorch.ai
Click on Get Started button
click on Create Project
Enter the Project Name, select the region
Navigate to the Knowledge Bases selection section.
Select an AWS Bedrock Knowledge Base for embedding.Click on Next
Select the N shot prompt and attach the N shot prompt file
Select the KNN value
Select the any of the inferencing models
Select the inferencing model temperature
Click on Next button
Select the Ragas evaluation, embedding model and Inferencing model
Click on Submit
Expected Behavior:
All experiments should execute successfully, and guardrails should apply seamlessly without causing execution failures.
Actual Behavior:
Some experiments fail partway through execution when guardrails are enabled.
Browser and Version
135.0.7049.115
Runtime Version
3.12
Error Messages
Additional Context
No response