Hi, how does one provide suggestions to the judging process? I had the following specific comments:
- While judging, the team names (schools) should be masked. The judges should not know who they are scoring. This is good practice in any competition to increase objectivity. Not at all suggesting there is explicit bias anywhere but its just the right thing to do.
- I've observed different judges rank different teams for the same session. I don't know if there is normalization done at the end, but if there isn't, ideally a single judge should be involved in all score sheets to ensure scoring is distributed using the same interpretation of rubrics as well as the same scoring points. This is because several of the rubrics are open to subjectivity. For example - "Is a game title present?" - one judge can be given points to this if a team added a name for the scratch project, whilst another can have points taken away for this same rubric because they did not add an explicit title in the Intro screen. Neither interpretation is wrong, but if interpretations are different for the same session, then it is unfair to the kids competing. This also holds true for the very subjective rubrics like "quality of backgrounds". One judge may give a 2 and another a 4 for the same background.