openenv-workflow-agent / graders /easy_grader.py
Imsachin010's picture
update graders to ensure strictly fractional scores and run all 3 tasks
6ca88b7
raw
history blame contribute delete
229 Bytes
from graders.base import BaseGrader
class EasyGrader(BaseGrader):
def grade(self, trajectory, ground_truth):
# simple logic
if len(trajectory) > 0:
return 0.95 # 🔥 NOT 1.0
return 0.1