Hi, how does one provide suggestions to the judging process? I had the following specific comments:
- While judging, the team names (schools) should be masked. The judges should not know who they are scoring. This is good practice in any competition to increase objectivity. Not at all suggesting there is explicit bias anywhere but its just the right thing to do.
- I've observed different judges rank different teams for the same session. I don't know if there is normalization done at the end, but if there isn't, ideally a single judge should be involved in all score sheets to ensure scoring is distributed using the same interpretation of rubrics as well as the same scoring points. The rubrics, for example are open to subjectivity. For example - "Is a game title present" - folks can be given points for "Is the game titled" simply by adding a name for the scratch project, and folks can have points taken away for this same rubric because they did not add an explicit title in the Intro screen by a different judge. Neither interpretation is wrong, but if interpretations are different for the same session, then it is unfair to the kids competing. This also holds true for the very subjective rubrics like "quality of backgrounds". One judge may give a 2 and another a 4 for the same background.