In this lesson:
Score Monitoring
- Each submission is reviewed by at least three Judges.
- Technovation monitors all judge feedback and scores to ensure equitable judging, constructive and division-appropriate feedback, and overall quality of scores and comments.
- Technovation looks for certain indicators, listed below, to determine if the judge should review/edit the score. If a score needs to be reviewed, staff will reach out to the judge via email.
- Feedback and scores are shared as-is to the teams. Score monitoring helps to ensure that what is shared is age appropriate and reflective of the team's work.
The following behaviours may result in Technovation reaching out to the judge via email:
- Assigning low or high scores to teams without evidence from the rubric
- all judging decisions must be made based on the rubric guidelines
- Scoring submissions very quickly
- we ask you to take your time and consider the team’s learning journey
- Failing to leave helpful feedback on each submission
- our participants use your feedback to continue learning
- Using harsh and negative tone when providing feedback
- many participants are early in their learning journey, encouragement is an important step to keep the girls motivated
- Not leaving comments, leaving repeating comments across submissions, inappropriate/nonsensical language in comments
- Incomplete scores
- Any other malicious act that results in unfair feedback or scores
3 Strike Policy
Judges will receive an email for each score that needs to be addressed. They will have 72 hours from receipt of the email from Technovation staff to update their score and/or feedback. If no updates are made during this timeframe, the score may be deleted.
The following 3 Strike Policy is in place for Judges who have repeated score violations:
Strike 1: 1 email and no action on 1 submission by provided deadline
Strike 2: 3 emails and no action on 3 submissions by provided deadline
Strike 3: 5 emails and no action on 5 submissions by provided deadline → suspended from getting new submissions until others are fixed
Judges cannot be brought down a strike level, even as adjustments are made past the deadline
Check-In Questions
After scoring your first submission, take a moment and think about the questions below.
These questions will help you think about your process and ensure that any concerns or concerning behaviours are addressed before moving on to other submissions.
It is not required to go through all check-in questions, question 1 is highly recommended.
- Recommended– Were there any areas of the rubric or guidelines that you require clarification on?
- If there are reach out in the Judge Slack or email [email protected]
- Did you approach each project with an open mind, considering the unique perspectives and abilities of the young participants?
- Did you provide clear and specific feedback for each project to ensure the participants can understand and learn from it?
- Did you maintain a positive and encouraging tone in my feedback, acknowledging the efforts and creativity of the participants?
- Did you consider the potential impact of your feedback on the girls’ motivation and confidence?
- Did you adapt your feedback style to match the age and experience level of the participants?
- How can you improve your review process for future evaluations of projects?
Judge Resources
We provide a variety of resources Judges can use during their volunteer experience.
Judges use our provided rubrics to assess submissions.
RPE Judges will likely be assigned to a single division.
Virtual Judges will review submissions from any of the 3 divisions from around the world.
Visit this page to see:
- Judging FAQS
- guidelines on how to address common judging questions
- learn about the certificates
- addressing bias
This community Slack workspace is a place to ask questions, share stories, and connect with fellow judges.
The Technovation Team will post updates on scores needed, and additional opportunities or specific asks within judging.
Once you are registered as a Judge, you will automatically receive weekly updates about judging from the Technovation Team.
Our newsletters are designed to provide helpful tips, deadline reminders, and motivation through your Judging experience!
The Volunteer Engagement Team is available to support throughout judging during the week.
Email us with any questions, issues, or highlights at [email protected]
*Add the above email to your contact list as this is where newsletters and asks to update scores will come from.
I still have a question
You can always reach out to Technovation’s Volunteer Engagement Team on Slack or at [email protected].
Go to the next page to indicate you are done training, by clicking “Next Topic” in the bottom right.