School Rankings

For anything Science Olympiad-related that might not fall under a specific event or competition.
User avatar
sciolyperson1
Exalted Member
Exalted Member
Posts: 1074
Joined: April 23rd, 2018, 7:13 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 529 times
Been thanked: 601 times
Contact:

School Rankings

Post by sciolyperson1 »

Hi all,
As you may have heard, Klebb, AC (builderguy135) and I have been working on a spreadsheet that ranks all teams in the nation based on competition performance. We've decided to release the spreadsheet here!

How are competitions rated?
Competitions are rated based on a variety of factors such as date, team count, school count, event count, and other factors to determine a score (approximately varying between 0 and 100).

A team's score is then calculated for each competition by comparing their superscore to the top score. Then, a school's total score is calculated based on a combination of the competitions that they have attended.

Why are there only 100 schools?
It's kinda toxic ¯\_(ツ)_/¯

Why is copy/paste export disabled?
See below. We also understand that there's ways to bypass it: we can't stop you, but we hope "please don't" is enough.

Why is my school ranked lower than that other school?
No.

Is there a division B one?
No.


Disclaimer:
These rankings, while mathematically objective in nature, are by no means official. Some of the criterion and weights are subjective based on how we designed the algorithm. Do not take these rankings as fact, and don't get too caught up in them! This was more an interesting way to visualize data for us.

We also request that you do not use this data in any other manner, such as predictions.
Last edited by sciolyperson1 on December 30th, 2020, 5:20 pm, edited 1 time in total.
These users thanked the author sciolyperson1 for the post (total 9):
builderguy135 (December 30th, 2020, 5:19 pm) • yoshiketchup (December 30th, 2020, 5:20 pm) • Godspeed (December 30th, 2020, 5:27 pm) • kh.aotic (December 30th, 2020, 5:30 pm) • lumosityfan (December 30th, 2020, 5:43 pm) • pepperonipi (December 30th, 2020, 6:01 pm) • MadCow2357 (January 1st, 2021, 2:51 pm) • Giantpants (January 4th, 2021, 12:06 am) • pumptato-cat (July 1st, 2022, 7:16 pm)
SoCal Planning Team & BirdSO Tournament Director
WW-P HSN '22, Community MS '18
Sciolyperson1's Userpage
User avatar
pepperonipi
Moderator
Moderator
Posts: 205
Joined: January 21st, 2019, 11:38 am
Division: C
State: FL
Pronouns: She/Her/Hers
Has thanked: 174 times
Been thanked: 336 times

Re: School Rankings

Post by pepperonipi »

Will you share what the algorithm is?

I think this is super cool, but some of the numbers make no sense by simple observation. I'm also curious what factors you think are important in the design of an algorithm to rank schools throughout the nation.
happy new season!

University of Florida
My Wiki Page | WikiProject SciOly and Scioly.org | Pi-Bot

2019: Code, Fermi, Thermo
2020: Detector, Orni, Code (Substitution: Penn)
2021: Detector, Orni, Circuit, WICI
User avatar
builderguy135
Exalted Member
Exalted Member
Posts: 736
Joined: September 8th, 2018, 12:24 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 191 times
Been thanked: 143 times
Contact:

Re: School Rankings

Post by builderguy135 »

pepperonipi wrote: December 30th, 2020, 6:03 pm Will you share what the algorithm is?

I think this is super cool, but some of the numbers make no sense by simple observation. I'm also curious what factors you think are important in the design of an algorithm to rank schools throughout the nation.
First, each competition is awarded a weight. The exact formula is extremely complicated, but it takes the following factors into consideration:
  • Date - Invitationals that are later in the season are worth more.
  • # of Teams - More teams = Harder competition.
  • # of Schools - More schools = Harder competition.
  • Non-HS - Non-HS invitationals generally attract more competitive teams.
  • T25 "Bonus" - A bonus for the presence of teams that were in the top 25 in 2019 Nationals.
  • In Person - In person competitions are given a small bonus.
  • Events - A small bonus is given to teams with more events.
  • In State - A penalty is applied if a competition restricts registrations to within a state, since this decreases competitiveness.
Then, the competition is superscored and each team is assigned a score. The weight of each competition is then given in its fullest to the team that won the superscore, and points are awarded to teams by dividing the number of points that the superscore winner obtained by the number of points the team scored, then multiplying by the weight of the competition.

Finally, a ranking score is given to each team by taking the maximum value of the following expressions:
  • 80% of the highest competition score of the team
  • 70% of the highest competition score of the team + 20% of the second highest
  • 60% of the highest competition score of the team + 30% of the second highest + 10% of the third highest
There are still many issues with the formula, and we're working on improving it - for instance, a team that scores 30 points should not be awarded the same number of points as a team which wins a competition by scoring 300 points in two competitions of equal value.

Just out of curiosity, which numbers do you think need to be adjusted? We're still trying to improve the formula, and we're open to any suggestions.
Last edited by builderguy135 on December 30th, 2020, 6:36 pm, edited 1 time in total.
These users thanked the author builderguy135 for the post:
pb5754 (December 31st, 2020, 10:23 am)
West Windsor-Plainsboro High School North '22
BirdSO Co-Director
My Userpage
User avatar
SilverBreeze
Exalted Member
Exalted Member
Posts: 306
Joined: November 28th, 2019, 3:42 pm
Division: C
State: CA
Has thanked: 156 times
Been thanked: 289 times

Re: School Rankings

Post by SilverBreeze »

I think in-person should get a penalty, since COVID restrictions reduce competitiveness when many strong teams can't attend.
UGA's score seems a bit high.
These users thanked the author SilverBreeze for the post (total 2):
builderguy135 (January 1st, 2021, 11:38 am) • MorningCoffee (January 1st, 2021, 3:15 pm)
Troy SciOly 2019 - 2023
Captain 2021-2023
Former Events: Ecology, Water Quality, Green Gen, Ornithology, Forestry, Disease Detectives, Forensics, Chem Lab, Env Chem, Sounds, Dynamic Planet, Crime Busters, Potions & Poisons, Exp Design, Towers, Mystery Arch, Reach for the Stars, Mission Possible
knightmoves
Member
Member
Posts: 629
Joined: April 26th, 2018, 6:40 pm
Has thanked: 4 times
Been thanked: 108 times

Re: School Rankings

Post by knightmoves »

You're assuming a somewhat equivalent field at each competition when you do this. I suspect you might do better to view, for example, School A scoring 5% of the no-show score for a tournament, and School B scoring 15% of the no-show score as a vote that School A is 10 percentage points better than School B. So if A beats B narrowly 3 times, the algorithm will rank A above B, but not by far. If C blew B out of the water a couple of times, but has never seen A in competition, you'd rank C well above B, and so by inference above A.

You can probably adapt a score voting algorithm to do this.
User avatar
sciolyperson1
Exalted Member
Exalted Member
Posts: 1074
Joined: April 23rd, 2018, 7:13 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 529 times
Been thanked: 601 times
Contact:

Re: School Rankings

Post by sciolyperson1 »

knightmoves wrote: January 3rd, 2021, 4:56 pm You're assuming a somewhat equivalent field at each competition when you do this. I suspect you might do better to view, for example, School A scoring 5% of the no-show score for a tournament, and School B scoring 15% of the no-show score as a vote that School A is 10 percentage points better than School B. So if A beats B narrowly 3 times, the algorithm will rank A above B, but not by far. If C blew B out of the water a couple of times, but has never seen A in competition, you'd rank C well above B, and so by inference above A.

You can probably adapt a score voting algorithm to do this.
That's a great idea, I'll think about it further.

As for equal fields at competition, we score each competition, then assign points to each school - so weights are balanced to each individual competition, and no competition is weighted equally.
SoCal Planning Team & BirdSO Tournament Director
WW-P HSN '22, Community MS '18
Sciolyperson1's Userpage
User avatar
builderguy135
Exalted Member
Exalted Member
Posts: 736
Joined: September 8th, 2018, 12:24 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 191 times
Been thanked: 143 times
Contact:

Re: School Rankings

Post by builderguy135 »

Agreed with everything sciolyperson1 said above, but I also wanted to add that it's really difficult to implement a true rating system - ELO and GLICKO wouldn't work, and multiplayer rating systems such as TrueSkill wouldn't work either, as that would not only not account for scores (only placements), but it also wouldn't account for teams that send junior varsity or non-main teams to competitions. The best way is to count only the competitions that a team places the best at, and giving each rating points depending on the competitiveness of the competition as well as the number of points scored.
These users thanked the author builderguy135 for the post:
sciolyperson1 (January 4th, 2021, 6:42 pm)
West Windsor-Plainsboro High School North '22
BirdSO Co-Director
My Userpage
knightmoves
Member
Member
Posts: 629
Joined: April 26th, 2018, 6:40 pm
Has thanked: 4 times
Been thanked: 108 times

Re: School Rankings

Post by knightmoves »

builderguy135 wrote: January 3rd, 2021, 11:14 pm but it also wouldn't account for teams that send junior varsity or non-main teams to competitions.
That's a good point, and without inside information, you don't know whether a particular school sent their better people to a particular competition. There are also schools that like to hide their performance on build events, saving their real build for the real competitions - but that's less important this year!
BobbyJoe
Member
Member
Posts: 35
Joined: May 25th, 2016, 1:04 pm
Division: C
State: PA
Has thanked: 0
Been thanked: 1 time

Re: School Rankings

Post by BobbyJoe »

This is awesome! Will it be updated again soon?
These users thanked the author BobbyJoe for the post:
sciolyperson1 (February 16th, 2021, 10:00 am)
Rustin/Wright/Solon/Reg/PA/Nat Div B: '15-17, Div C: '18-
Disease D-
'15: 6/-/-/-/-/-/
'16: -/10/-/-/-/-
Air T-
'15: 2/-/-/-/-/-
Experimental D-
'16: 5/-/-/-/-/-
Mission P-
'16: 1/12/-/1/-/-
'17: 1/5/3/1/2/12
Crime B-
'16: 3/8/-/-/-/-
'17: 1/7/7/3/8/24
Wind P-
'17: 5/3/2/1/1/13
User avatar
sciolyperson1
Exalted Member
Exalted Member
Posts: 1074
Joined: April 23rd, 2018, 7:13 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 529 times
Been thanked: 601 times
Contact:

Re: School Rankings

Post by sciolyperson1 »

BobbyJoe wrote: February 16th, 2021, 7:30 am This is awesome! Will it be updated again soon?
Been busy with invitational season these few weeks but hopefully it will! Looking like it'll be Sunday when I put in GGSO and the rest.
SoCal Planning Team & BirdSO Tournament Director
WW-P HSN '22, Community MS '18
Sciolyperson1's Userpage
Post Reply

Return to “General Competition”

Who is online

Users browsing this forum: Ahrefs [Bot] and 3 guests