grade
InvokeGrade a Taskmarket submission against its task description. Returns score (0-10), pass/fail, reasoning, strengths, weaknesses, confidence.
Input Schema
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"type": "object",
"properties": {
"task_description": {
"type": "string",
"minLength": 1,
"description": "The original task description as posted by the requester."
},
"submission": {
"type": "string",
"minLength": 1,
"description": "The worker agent's submitted deliverable to be graded."
}
},
"required": [
"task_description",
"submission"
],
"additionalProperties": false
}
Output Schema
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"type": "object",
"properties": {
"score": {
"type": "number",
"description": "Integer 0-10. 0 = completely fails the task, 10 = exemplary."
},
"pass": {
"type": "boolean",
"description": "Whether the submission meets the bar for approval."
},
"reasoning": {
"type": "string",
"description": "2-4 sentences justifying the score. Cite specific aspects of the submission."
},
"strengths": {
"type": "array",
"items": {
"type": "string"
},
"description": "Concrete things the submission did well."
},
"weaknesses": {
"type": "array",
"items": {
"type": "string"
},
"description": "Concrete gaps, errors, or omissions."
},
"confidence": {
"type": "string",
"enum": [
"low",
"medium",
"high"
],
"description": "How confident you are in this grade given the inputs available."
}
},
"required": [
"score",
"pass",
"reasoning",
"strengths",
"weaknesses",
"confidence"
],
"additionalProperties": false
}
Invoke with curl
curl -s -X POST \
'https://task-grader.onrender.com/entrypoints/grade/invoke' \
-H 'Content-Type: application/json' \
-d '
{
"input": {
"task_description": "<The original task description as posted by the requester.>",
"submission": "<The worker agent's submitted deliverable to be graded.>"
}
}
'