FloTorch Version
v3.0.1
Bug Description
When multiple guardrail options are selected (including "None") along with multiple models, the system is expected to generate experiments for each combination of model and guardrail. However, experiments are not being generated for the "None" guardrail option, which leads to an incomplete experiment set.
Steps to Reproduce
Steps to Reproduce
Login to FloTorch.ai
Click on Get Started button
click on Create Project
Enter the Project Name, select the region
Navigate to the Knowledge Bases selection section.
Select an AWS Bedrock Knowledge Base for embedding.Click on Next
Select the N shot prompt and attach the N shot prompt file
Select the KNN value
Select the any of the inferencing models
Select the inferencing model temperature
Click on Next button
From the guardrail dropdown, select multiple options including "None" and other available guardrails.
Select the Ragas evaluation, embedding model and Inferencing model
Expected Result:
Experiments should be generated for all model and guardrail combinations, including those where the guardrail is set to "None".
Actual Result:
Experiments are only generated for guardrail options other than "None". No experiments are created for the "None" guardrail case.
Browser and Version
135.0.7049.115
Runtime Version
3.12
Error Messages
Additional Context
No response
FloTorch Version
v3.0.1
Bug Description
When multiple guardrail options are selected (including "None") along with multiple models, the system is expected to generate experiments for each combination of model and guardrail. However, experiments are not being generated for the "None" guardrail option, which leads to an incomplete experiment set.
Steps to Reproduce
Steps to Reproduce
Login to FloTorch.ai
Click on Get Started button
click on Create Project
Enter the Project Name, select the region
Navigate to the Knowledge Bases selection section.
Select an AWS Bedrock Knowledge Base for embedding.Click on Next
Select the N shot prompt and attach the N shot prompt file
Select the KNN value
Select the any of the inferencing models
Select the inferencing model temperature
Click on Next button
From the guardrail dropdown, select multiple options including "None" and other available guardrails.
Select the Ragas evaluation, embedding model and Inferencing model
Expected Result:
Experiments should be generated for all model and guardrail combinations, including those where the guardrail is set to "None".
Actual Result:
Experiments are only generated for guardrail options other than "None". No experiments are created for the "None" guardrail case.
Browser and Version
135.0.7049.115
Runtime Version
3.12
Error Messages
Additional Context
No response