FloTorch Version
V2.0.3
Bug Description
DeepSeek Models are producing Inaccurate Answers and resulting the Poor Evaluation Metrics
Steps to Reproduce
- Login to FloTorch.ai
- Click on Create Project
- Enter the details of the Project, select the Region
- Select the Knowledge base type from the drop down
- Upload the Knowledge Base
- Upload the Ground Truth json file and click on Next button
- Select the Chucking, Embedding Model, Vector Dimension and Indexing Algorithm from the drop down and click on Next button
- Select the N shot Prompts, and upload the N shot prompt file
- Select the KNN value from the KNN dropdown
- Select any of the Deepseek model's from Inferencing Model dropdown
- Select the Inferencing Model Temperature and click on Next
- Select the Evaluation Service as Ragas, Embedding model and Inferencing Model from the dropdown and click on Submit button
- Select the Valid experiments and click on Run button
- Click on Confirm button
Expected Result : Generated Answers should be accurate and should match with the Ground Truth Answers.
Actual Result : Generated Answers are inaccurate and not matching with the Ground Truth Answers.
Browser and Version
Chrome version : 133.0.6943.54
Runtime Version
Version : 3.12
Error Messages
Additional Context
No response
FloTorch Version
V2.0.3
Bug Description
DeepSeek Models are producing Inaccurate Answers and resulting the Poor Evaluation Metrics
Steps to Reproduce
Expected Result : Generated Answers should be accurate and should match with the Ground Truth Answers.
Actual Result : Generated Answers are inaccurate and not matching with the Ground Truth Answers.
Browser and Version
Chrome version : 133.0.6943.54
Runtime Version
Version : 3.12
Error Messages
Additional Context
No response