openenv-workflow-agent / graders /medium_grader.py
Imsachin010's picture
update graders to ensure strictly fractional scores and run all 3 tasks
6ca88b7
raw
history blame contribute delete
190 Bytes
from graders.base import BaseGrader
class MediumGrader(BaseGrader):
def grade(self, trajectory, ground_truth):
if len(trajectory) > 1:
return 0.6
return 0.2