In this lesson:
Score Monitoring
- Each team submission is reviewed by at least three Judges.
- Technovation monitors all judge feedback and scores to ensure equitable judging, constructive and division-appropriate feedback, and overall quality of scores and comments.
- Technovation looks for certain indicators, listed below, to determine if the judge should review/edit the score. If a score needs to be reviewed, staff will reach out to the judge via email.
- Feedback and scores are shared as-is to the teams. Score monitoring helps to ensure that what is shared is age appropriate and reflective of the team's work.
Assigning very low or high scores without evidence from the rubric. All decisions must follow rubric guidelines.
Scoring submissions very fast without taking time to consider the team’s full learning journey.
Failing to leave thoughtful feedback. Participants rely on your comments to continue growing.
Many participants are early learners. Encouragement is essential to keep them motivated.
No comments, repeated comments across submissions, or inappropriate/nonsensical language.
Incomplete scores, or any action that results in unfair or biased feedback.
3 Strike Policy
Judges will receive an email for each score that needs to be addressed. They will have 72 hours from receipt of the email from Technovation staff to update their score and/or feedback. If no updates are made during this timeframe, the score may be deleted.Â
The following 3 Strike Policy is in place for Judges who have repeated score violations:
Strike 1: 1 email and no action on 1 submission by provided deadline
Strike 2: 3 emails and no action on 3 submissions by provided deadline
Strike 3: 5 emails and no action on 5 submissions by provided deadline → suspended from getting new submissions until others are fixed
Judges cannot be brought down a strike level, even as adjustments are made past the deadline
Check-In Questions
After scoring your first submission, take a moment and think about the questions below.
These questions will help you reflect on your process and ensure that any concerns or concerning behaviours are addressed before moving on to other submissions.
It is not required to go through all check-in questions, but Question 1 is highly recommended.
-
1Did you approach each project with an open mind, considering the unique perspectives and abilities of the young participants?
-
2Did you provide clear and specific feedback for each project to ensure the participants can understand and learn from it?
-
3Did you maintain a positive and encouraging tone in your feedback, acknowledging the efforts and creativity of the participants?
-
4Did you consider the potential impact of your feedback on the girls’ motivation and confidence?
-
5Did you adapt your feedback style to match the age and experience level of the participants?
-
6How can you improve your review process for future evaluations of projects?
Judge Resources
We provide a variety of resources Judges can use during their volunteer experience.Â
Judges use our provided rubrics to assess submissions.Â
RPE Judges will likely be assigned to a single division.
Virtual Judges will review submissions from any of the 3 divisions from around the world.
This document addresses issues Judges may encounter with submissions and how to address them.Â
Issues include, but are not limited to:
- Videos set to private
- Submission not in English
- Technical and pitch video are switched
- And more
This community Slack workspace is a place to ask questions, share stories, and connect with fellow judges.
The Technovation Team will post updates on scores needed, and additional opportunities or specific asks within judging.
Once you are registered as a Judge, you will automatically receive weekly updates about judging from the Technovation Team.
Our newsletters are designed to provide helpful tips, deadline reminders, and motivation through your Judging experience!Â
The Volunteer Engagement Team is available to support throughout judging during the week.
Email us with any questions, issues, or highlights at volunteers@technovation.orgÂ
*Add the above email to your contact list as this is where newsletters and asks to update scores will come from.
I still have a question
You can always reach out to Technovation’s Volunteer Engagement Team on Slack or at volunteers@technovation.org.
Go to the next page to indicate you are done training, by clicking “Next Topic” in the bottom right.
