FloTorch Version
V3.0.0
Bug Description
The Human Evaluation cost is not being shown for Sage Maker models.
Steps to Reproduce
Login to FloTorch.ai
Click on Get Started button
click on Create Project
Enter the Project Name, select the region
Upload the knowledge base pdf file
Upload the Ground Truth json file
Click on Next
Select the Chunk sizes
Select the chuck overlap percentage
Select the Embedding model and Vector dimension as 1024
Select the indexing algorithm
Select the N shot prompt and attach the N shot prompt file
Select the KNN value
Select the any of the inferencing models
Select the inferencing model temperature
Click on Next button
Select the Ragas evaluation, embedding model and Inferencing model
Click on Submit
Click on choose 2 - 3 experiments for human evaluation and Select any two completed models related to Sagemaker
Give a question
Expected : If the user selects Human Evaluation, the Sage Maker cost should be displayed in the experiment details for that particular experiment.
Actual : If the user selects Human Evaluation, the Sage Maker cost is not being shown in the experiment details for that particular experiment.
Browser and Version
134.0.6998.89
Runtime Version
python 3.12
Error Messages
Additional Context
No response
FloTorch Version
V3.0.0
Bug Description
The Human Evaluation cost is not being shown for Sage Maker models.
Steps to Reproduce
Login to FloTorch.ai
Click on Get Started button
click on Create Project
Enter the Project Name, select the region
Upload the knowledge base pdf file
Upload the Ground Truth json file
Click on Next
Select the Chunk sizes
Select the chuck overlap percentage
Select the Embedding model and Vector dimension as 1024
Select the indexing algorithm
Select the N shot prompt and attach the N shot prompt file
Select the KNN value
Select the any of the inferencing models
Select the inferencing model temperature
Click on Next button
Select the Ragas evaluation, embedding model and Inferencing model
Click on Submit
Click on choose 2 - 3 experiments for human evaluation and Select any two completed models related to Sagemaker
Give a question
Expected : If the user selects Human Evaluation, the Sage Maker cost should be displayed in the experiment details for that particular experiment.
Actual : If the user selects Human Evaluation, the Sage Maker cost is not being shown in the experiment details for that particular experiment.
Browser and Version
134.0.6998.89
Runtime Version
python 3.12
Error Messages
Additional Context
No response