Introduction
University admissions in the UK are highly competitive, with thousands of students vying for a limited number of spots. One of the key factors in the admissions process is the personal statement, which can be a time-consuming and subjective aspect of the application. To streamline this process, many universities are turning to automated essay scoring systems, powered by advanced AI models like ChatGPT, Claude, and Gemini. In this post, we’ll explore how to build a ChatGPT-powered automated essay scoring system for UK university admissions, and provide guidance on how to implement this technology effectively.
The Prompt
To build an effective automated essay scoring system, we need to start with a well-crafted prompt that can elicit a high-quality response from the AI model. Here’s an example prompt:
Score the following personal statement essay for a UK university admissions application, based on the criteria of coherence, relevance, and overall quality: {essay_text}
Prompt Anatomy: How It Works
Variables Guide
The prompt uses several variables that need to be defined and explained. Here’s a guide to the variables used in the prompt:
| Variable | What to put here |
|---|---|
{essay_text} |
The text of the personal statement essay to be scored scoring_rubric|The criteria and standards used to evaluate the essay university_name|The name of the university or institution to which the student is applying degree_program|The degree program or course to which the student is applying |
Try It Yourself
To see how the prompt works in practice, try using the following interactive tester:
Fill in the fields below and click Run Test to see the AI output in real time. Limited to 3 free tests per hour.
Sample Output
Here’s an example of what the output might look like:
The essay scores 8 out of 10 in terms of coherence, 7 out of 10 in terms of relevance, and 8 out of 10 in terms of overall quality. The essay demonstrates a clear and well-organized structure, with effective use of transitions and connecting words. However, there are some areas for improvement, such as providing more specific examples and using more precise language.
5 Powerful Variations
Here are five variations of the prompt that can be used in different situations:
Score the following personal statement essay for a UK university admissions application, based on the criteria of coherence, relevance, and overall quality, and provide feedback and suggestions for improvement: {essay_text}
Score the following personal statement essay for a UK university admissions application, based on the criteria of coherence, relevance, overall quality, and tone, using the following weights: coherence (30%), relevance (25%), overall quality (20%), and tone (25%): {essay_text}
Score the following personal statement essay for a UK university admissions application, based on the criteria of coherence, relevance, and overall quality, taking into account the following contextual information: {contextual_info}: {essay_text}
Compare and contrast the following two personal statement essays for a UK university admissions application, based on the criteria of coherence, relevance, and overall quality, and provide a score or grade for each essay: {essay_text1} and {essay_text2}
Evaluate the following personal statement essay for a UK university admissions application, based on the criteria of coherence, relevance, overall quality, and fit with the university’s values and mission, using a holistic approach that considers the essay as a whole: {essay_text}
Which AI Models Work Best?
The choice of AI model depends on the specific requirements and constraints of the project. Here’s a comparison of the three AI models used in this example:
UK University Admissions Essay ScoringUltimately, the choice of AI model will depend on the specific needs and goals of the project, as well as the level of complexity and nuance required in the scoring system.
Pro Tips for Best Results
- Use a well-defined and clear prompt that elicits a high-quality response from the AI model.
- Provide relevant and accurate contextual information to inform the scoring process.
- Use a combination of quantitative and qualitative evaluation criteria to ensure a comprehensive and nuanced assessment of the essay.
Common Mistakes to Avoid
- Over-reliance on a single AI model or scoring system, which can lead to biases and inconsistencies.
- Failure to provide adequate contextual information, which can result in inaccurate or incomplete assessments.
- Inadequate validation and testing of the scoring system, which can lead to errors and inconsistencies in the results.
Use Cases by Industry
The automated essay scoring system can be applied to a variety of industries and use cases, including:
In education, the system can be used to streamline the admissions process, reduce the workload of admissions staff, and provide more accurate and consistent evaluations of student essays.
In employment, the system can be used to evaluate the writing skills and qualifications of job applicants, and to provide more efficient and effective hiring processes.
In research, the system can be used to evaluate the quality and validity of research papers and academic articles, and to provide more accurate and consistent assessments of research quality.
In government, the system can be used to evaluate the effectiveness of policy initiatives and programs, and to provide more accurate and consistent assessments of policy impact.
In non-profit organizations, the system can be used to evaluate the effectiveness of fundraising campaigns and outreach programs, and to provide more accurate and consistent assessments of program impact.
