School Rankings

For anything Science Olympiad-related that might not fall under a specific event or competition.
User avatar
sciolyperson1
Exalted Member
Exalted Member
Posts: 1006
Joined: April 23rd, 2018, 7:13 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 364 times
Been thanked: 509 times
Contact:

School Rankings

Post by sciolyperson1 » December 30th, 2020, 5:19 pm

Hi all,
As you may have heard, Klebb, AC (builderguy135) and I have been working on a spreadsheet that ranks all teams in the nation based on competition performance. We've decided to release the spreadsheet here!

How are competitions rated?
Competitions are rated based on a variety of factors such as date, team count, school count, event count, and other factors to determine a score (approximately varying between 0 and 100).

A team's score is then calculated for each competition by comparing their superscore to the top score. Then, a school's total score is calculated based on a combination of the competitions that they have attended.

Why are there only 100 schools?
It's kinda toxic ¯\_(ツ)_/¯

Why is copy/paste export disabled?
See below. We also understand that there's ways to bypass it: we can't stop you, but we hope "please don't" is enough.

Why is my school ranked lower than that other school?
No.

Is there a division B one?
No.


Disclaimer:
These rankings, while mathematically objective in nature, are by no means official. Some of the criterion and weights are subjective based on how we designed the algorithm. Do not take these rankings as fact, and don't get too caught up in them! This was more an interesting way to visualize data for us.

We also request that you do not use this data in any other manner, such as predictions.
Last edited by sciolyperson1 on December 30th, 2020, 5:20 pm, edited 1 time in total.
These users thanked the author sciolyperson1 for the post (total 8):
builderguy135 (December 30th, 2020, 5:19 pm) • yoshiketchup (December 30th, 2020, 5:20 pm) • Godspeed (December 30th, 2020, 5:27 pm) • kh.aotic (December 30th, 2020, 5:30 pm) • lumosityfan (December 30th, 2020, 5:43 pm) • pepperonipi (December 30th, 2020, 6:01 pm) • MadCow2357 (January 1st, 2021, 2:51 pm) • Giantpants (January 4th, 2021, 12:06 am)
WW-P HSN '22, Community '18, BirdSO Tournament Director
'21: Gravity - Boomi - WICI - PPP - Cybersec

BEARSO: Gravity - 1st '21
MIT: LMMM - 1st '21, DigiStruc - 2nd '21, Gravity - 1st '20
PUSO: PPP - 1st '20, WIDI -1st '20

Team:
Nats - 3rd '18, '19
MIT - 1st '21, 3rd '20

Rate my tests!

User avatar
pepperonipi
Moderator
Moderator
Posts: 199
Joined: January 21st, 2019, 11:38 am
Division: C
State: FL
Has thanked: 167 times
Been thanked: 320 times

Re: School Rankings

Post by pepperonipi » December 30th, 2020, 6:03 pm

Will you share what the algorithm is?

I think this is super cool, but some of the numbers make no sense by simple observation. I'm also curious what factors you think are important in the design of an algorithm to rank schools throughout the nation.
And will you succeed? Yes! You will, indeed! (98 and 3/4 percent guaranteed.)

Boca Raton Community High School
My Wiki Page | School Wiki Page | WikiProject SciOly and Scioly.org | Pi-Bot

2019: Code, Fermi, Thermo
2020: Detector, Orni, Code (Substitution: Penn)
2021: Detector, Orni, Circuit, WICI

User avatar
builderguy135
Exalted Member
Exalted Member
Posts: 723
Joined: September 8th, 2018, 12:24 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 135 times
Been thanked: 96 times
Contact:

Re: School Rankings

Post by builderguy135 » December 30th, 2020, 6:24 pm

pepperonipi wrote:
December 30th, 2020, 6:03 pm
Will you share what the algorithm is?

I think this is super cool, but some of the numbers make no sense by simple observation. I'm also curious what factors you think are important in the design of an algorithm to rank schools throughout the nation.
First, each competition is awarded a weight. The exact formula is extremely complicated, but it takes the following factors into consideration:
  • Date - Invitationals that are later in the season are worth more.
  • # of Teams - More teams = Harder competition.
  • # of Schools - More schools = Harder competition.
  • Non-HS - Non-HS invitationals generally attract more competitive teams.
  • T25 "Bonus" - A bonus for the presence of teams that were in the top 25 in 2019 Nationals.
  • In Person - In person competitions are given a small bonus.
  • Events - A small bonus is given to teams with more events.
  • In State - A penalty is applied if a competition restricts registrations to within a state, since this decreases competitiveness.
Then, the competition is superscored and each team is assigned a score. The weight of each competition is then given in its fullest to the team that won the superscore, and points are awarded to teams by dividing the number of points that the superscore winner obtained by the number of points the team scored, then multiplying by the weight of the competition.

Finally, a ranking score is given to each team by taking the maximum value of the following expressions:
  • 80% of the highest competition score of the team
  • 70% of the highest competition score of the team + 20% of the second highest
  • 60% of the highest competition score of the team + 30% of the second highest + 10% of the third highest
There are still many issues with the formula, and we're working on improving it - for instance, a team that scores 30 points should not be awarded the same number of points as a team which wins a competition by scoring 300 points in two competitions of equal value.

Just out of curiosity, which numbers do you think need to be adjusted? We're still trying to improve the formula, and we're open to any suggestions.
Last edited by builderguy135 on December 30th, 2020, 6:36 pm, edited 1 time in total.
These users thanked the author builderguy135 for the post:
pb5754 (December 31st, 2020, 10:23 am)
West Windsor - Plainsboro High School North '22
PPP/Sounds/Wright/Code/Cyber/DigiStruc
7x National Medalist, 2x MIT SoM Champion
Test Writer and Event Supervisor, BirdSO Co-Director
My Userpage

User avatar
SilverBreeze
Exalted Member
Exalted Member
Posts: 298
Joined: November 28th, 2019, 3:42 pm
Division: C
State: CA
Pronouns: She/Her/Hers
Has thanked: 143 times
Been thanked: 258 times

Re: School Rankings

Post by SilverBreeze » January 1st, 2021, 10:40 am

I think in-person should get a penalty, since COVID restrictions reduce competitiveness when many strong teams can't attend.
UGA's score seems a bit high.
These users thanked the author SilverBreeze for the post (total 2):
builderguy135 (January 1st, 2021, 11:38 am) • MorningCoffee (January 1st, 2021, 3:15 pm)
Troy SciOly 2019 - now
Suzanne SciOly 2016 - 2019
Events this season: Water Quality, Forensics, Ornithology, (some experience in DP)

The team may be gone, but the program lives on...

knightmoves
Member
Member
Posts: 318
Joined: April 26th, 2018, 6:40 pm
Has thanked: 2 times
Been thanked: 27 times

Re: School Rankings

Post by knightmoves » January 3rd, 2021, 4:56 pm

You're assuming a somewhat equivalent field at each competition when you do this. I suspect you might do better to view, for example, School A scoring 5% of the no-show score for a tournament, and School B scoring 15% of the no-show score as a vote that School A is 10 percentage points better than School B. So if A beats B narrowly 3 times, the algorithm will rank A above B, but not by far. If C blew B out of the water a couple of times, but has never seen A in competition, you'd rank C well above B, and so by inference above A.

You can probably adapt a score voting algorithm to do this.

User avatar
sciolyperson1
Exalted Member
Exalted Member
Posts: 1006
Joined: April 23rd, 2018, 7:13 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 364 times
Been thanked: 509 times
Contact:

Re: School Rankings

Post by sciolyperson1 » January 3rd, 2021, 6:30 pm

knightmoves wrote:
January 3rd, 2021, 4:56 pm
You're assuming a somewhat equivalent field at each competition when you do this. I suspect you might do better to view, for example, School A scoring 5% of the no-show score for a tournament, and School B scoring 15% of the no-show score as a vote that School A is 10 percentage points better than School B. So if A beats B narrowly 3 times, the algorithm will rank A above B, but not by far. If C blew B out of the water a couple of times, but has never seen A in competition, you'd rank C well above B, and so by inference above A.

You can probably adapt a score voting algorithm to do this.
That's a great idea, I'll think about it further.

As for equal fields at competition, we score each competition, then assign points to each school - so weights are balanced to each individual competition, and no competition is weighted equally.
WW-P HSN '22, Community '18, BirdSO Tournament Director
'21: Gravity - Boomi - WICI - PPP - Cybersec

BEARSO: Gravity - 1st '21
MIT: LMMM - 1st '21, DigiStruc - 2nd '21, Gravity - 1st '20
PUSO: PPP - 1st '20, WIDI -1st '20

Team:
Nats - 3rd '18, '19
MIT - 1st '21, 3rd '20

Rate my tests!

User avatar
builderguy135
Exalted Member
Exalted Member
Posts: 723
Joined: September 8th, 2018, 12:24 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 135 times
Been thanked: 96 times
Contact:

Re: School Rankings

Post by builderguy135 » January 3rd, 2021, 11:14 pm

Agreed with everything sciolyperson1 said above, but I also wanted to add that it's really difficult to implement a true rating system - ELO and GLICKO wouldn't work, and multiplayer rating systems such as TrueSkill wouldn't work either, as that would not only not account for scores (only placements), but it also wouldn't account for teams that send junior varsity or non-main teams to competitions. The best way is to count only the competitions that a team places the best at, and giving each rating points depending on the competitiveness of the competition as well as the number of points scored.
These users thanked the author builderguy135 for the post:
sciolyperson1 (January 4th, 2021, 6:42 pm)
West Windsor - Plainsboro High School North '22
PPP/Sounds/Wright/Code/Cyber/DigiStruc
7x National Medalist, 2x MIT SoM Champion
Test Writer and Event Supervisor, BirdSO Co-Director
My Userpage

knightmoves
Member
Member
Posts: 318
Joined: April 26th, 2018, 6:40 pm
Has thanked: 2 times
Been thanked: 27 times

Re: School Rankings

Post by knightmoves » January 4th, 2021, 7:54 am

builderguy135 wrote:
January 3rd, 2021, 11:14 pm
but it also wouldn't account for teams that send junior varsity or non-main teams to competitions.
That's a good point, and without inside information, you don't know whether a particular school sent their better people to a particular competition. There are also schools that like to hide their performance on build events, saving their real build for the real competitions - but that's less important this year!

BobbyJoe
Member
Member
Posts: 35
Joined: May 25th, 2016, 1:04 pm
Division: C
State: PA
Has thanked: 0
Been thanked: 1 time

Re: School Rankings

Post by BobbyJoe » February 16th, 2021, 7:30 am

This is awesome! Will it be updated again soon?
These users thanked the author BobbyJoe for the post:
sciolyperson1 (February 16th, 2021, 10:00 am)
Rustin/Wright/Solon/Reg/PA/Nat Div B: '15-17, Div C: '18-
Disease D-
'15: 6/-/-/-/-/-/
'16: -/10/-/-/-/-
Air T-
'15: 2/-/-/-/-/-
Experimental D-
'16: 5/-/-/-/-/-
Mission P-
'16: 1/12/-/1/-/-
'17: 1/5/3/1/2/12
Crime B-
'16: 3/8/-/-/-/-
'17: 1/7/7/3/8/24
Wind P-
'17: 5/3/2/1/1/13

User avatar
sciolyperson1
Exalted Member
Exalted Member
Posts: 1006
Joined: April 23rd, 2018, 7:13 pm
Division: C
State: NJ
Pronouns: He/Him/His
Has thanked: 364 times
Been thanked: 509 times
Contact:

Re: School Rankings

Post by sciolyperson1 » February 16th, 2021, 10:01 am

BobbyJoe wrote:
February 16th, 2021, 7:30 am
This is awesome! Will it be updated again soon?
Been busy with invitational season these few weeks but hopefully it will! Looking like it'll be Sunday when I put in GGSO and the rest.
WW-P HSN '22, Community '18, BirdSO Tournament Director
'21: Gravity - Boomi - WICI - PPP - Cybersec

BEARSO: Gravity - 1st '21
MIT: LMMM - 1st '21, DigiStruc - 2nd '21, Gravity - 1st '20
PUSO: PPP - 1st '20, WIDI -1st '20

Team:
Nats - 3rd '18, '19
MIT - 1st '21, 3rd '20

Rate my tests!

Post Reply

Return to “General Competition”

Who is online

Users browsing this forum: No registered users and 3 guests