“Gradescope focuses on making assessment workflows more efficient.”
“- Grouping similar student answers.”
“- Applying consistent grading rubrics.”
“- Supporting handwritten answer recognition.”
“- Facilitating individual and group grading.”
“- Supporting automated grading of certain objective short-answer questions.”
“Reliability assessment: Strong for streamlining consistent marking, but not a fully autonomous solution for complex essays.”
“Gradescope | Strong for defined answers | Primarily human-assisted | University examinations”
“An important limitation is that its AI-assisted answer grouping is not equivalent to fully automated essay evaluation.”
“Online assignment short-answer questions can be automatically graded against specified answers, while free-response fields require manual grading.”
“Reliability assessment: Strong for streamlining consistent marking, but not a fully autonomous solution for complex essays.”
“Gradescope | Strong for defined answers | Primarily human-assisted | University examinations”
“Turnitin is often included in discussions about automated assessment, but it is important not to confuse its different functions.”
“- Text similarity checking.”
“- Academic integrity support.”
“- AI-generated writing detection.”
“- Writing feedback tools.”
“Reliability assessment: Useful as a supplementary academic integrity tool, not as an independent essay-grading system.”
“Its AI detection feature does not determine whether an essay deserves a particular academic grade.”
“Turnitin also cautions that its AI detector can misidentify human-written or AI-generated text.”
“It should not be the sole basis for an academic misconduct decision.”
“Turnitin | Not a primary grading function | Not a primary grading function | Academic integrity”
“Canvas has introduced AI-assisted grading capabilities that use assignment rubrics to generate suggested scores and feedback.”
“- Suggesting rubric-based scores.”
“- Generating feedback comments.”
“- Helping instructors process written assignments.”
“- Supporting more consistent application of grading criteria.”
“Reliability assessment: Useful for accelerating rubric-based marking, but teacher approval remains essential.”
“- It does not independently verify factual claims.”
“- It does not evaluate the credibility of cited sources.”
“- It may not identify attempts to manipulate grading instructions.”
“- It does not automatically check every formatting requirement.”
“Reliability assessment: Useful for accelerating rubric-based marking, but teacher approval remains essential.”
“ETS e-rater is one of the more established automated essay-scoring technologies.”
“A significant advantage is its long history of operational use and research validation.”
“- Grammar and mechanics evaluation.”
“- Vocabulary and language complexity.”
“- Organization and development.”
“- Writing-style analysis.”
“- Automated feedback.”
“The system can also flag off-topic or anomalous responses for further review.”
“Reliability assessment: Strong for appropriately designed writing assessments, particularly when combined with human scoring.”
“It is not a substitute for evaluating the truth or depth of every argument.”
“ETS e-rater | Limited application | Strong in validated contexts | Standardized writing assessment”
“Pearson's Intelligent Essay Assessor uses natural language processing and machine learning to assess essays and short answers.”
“- Evaluating semantic content.”
“- Assessing responses against established scoring patterns.”
“- Processing large volumes of student work.”
“- Supporting consistent scoring across assessments.”
“One important distinction is that IEA aims to assess meaning, rather than simply counting grammatical errors or evaluating vocabulary complexity.”
“Reliability assessment: A mature option for standardized, appropriately calibrated assessments.”
“Pearson IEA | Strong in calibrated contexts | Strong in calibrated contexts | Large-scale assessment”
“Human validation and monitoring remain important, particularly when scores have significant consequences.”
