Fermi Questions B/C

Locked
User avatar
bernard
Administrator
Administrator
Posts: 2498
Joined: January 5th, 2014, 3:12 pm
Division: Grad
State: WA
Pronouns: He/Him/His
Has thanked: 185 times
Been thanked: 789 times
Contact:

Fermi Questions B/C

Post by bernard »

"One of the ways that I believe people express their appreciation to the rest of humanity is to make something wonderful and put it out there." – Steve Jobs
jaymaron
Member
Member
Posts: 6
Joined: May 30th, 2022, 8:52 am
Division: Grad
State: WI
Has thanked: 1 time
Been thanked: 1 time
Contact:

Re: Fermi Questions B/C

Post by jaymaron »

Fermi problems: https://jaymaron.com/fermi.html
Fermi plots: https://jaymaron.com/exhibit.html
Fermi data on units: https://jaymaron.com/unit.html



The Fermi score function is asymmetric logarithmically. "5" should be replaced with "3", because 10^.5 = 3.16

The Fermi function should be continuous.

The Fermi function should be able to reward accurate answers, like the Metric Mastery function. The cyan function in the plot unifies Fermi and Metric Mastery. There are many cool questions that aren't possible in the Fermi event because of the goofy scoring function.

Caltech has a class on "order of magnitude physics", which is ammunition for Fermi. In the class, the standards for accuracy are high. Accuracy within a factor of 10 isn't good enough. The techniques taught in the class enable you to calculate things to better than a factor of 2, and these techniques should be rewarded.

From the Caltech syllabus for the order of magnitude class: "Emphasis will be on using basic physics to understand complicated systems. Examples will be selected from properties of materials, geophysics, weather, planetary science, astrophysics, cosmology, biomechanics, etc."

Unified scoring function: Let "1" be the correct answer and "X" be the submitted answer.
Score = 3 - log_10 (X-1)
If X<1, replace X with 1/X.
If Score > 6, reset Score to 6
If Score < 0, reset Score to 0

Image

https://jaymaron.com/cobalt/fermiscore.png
Last edited by jaymaron on November 6th, 2022, 4:30 am, edited 6 times in total.
knightmoves
Member
Member
Posts: 629
Joined: April 26th, 2018, 6:40 pm
Has thanked: 4 times
Been thanked: 108 times

Re: Fermi Questions B/C

Post by knightmoves »

jaymaron wrote: September 28th, 2022, 7:41 am Unified scoring function: Let "1" be the correct answer and "X" be the submitted answer.
Score = 3 - log_10 (X-1)
If X<1, replace X with 1/X.
If Score > 6, reset Score to 6
If Score < 0, reset Score to 0
A lot of Fermi Questions don't have a "correct answer", and for a lot of other questions, knowing enough to get "the correct answer" is of zero value.

Somebody knowing, for example, the area of a football field to better than 10% is worthless. There are people who play or watch football, and will know exactly how big it is, and there are people who can wave their hands and say "it's sorta that big" and get somewhere close. The former is not of more value than the latter.
Klebb
Member
Member
Posts: 4
Joined: May 4th, 2019, 3:53 pm
Division: Grad
State: CA
Pronouns: He/Him/His
Has thanked: 14 times
Been thanked: 20 times

Re: Fermi Questions B/C

Post by Klebb »

Hello Science Olympiad Community!

I'm back with another big document... this time about Fermi Questions.

Presenting:
A Brief Introduction to Fermi Questions

(my titling skills aren't exactly great)
I've been asked a few times how to get started on Fermi Questions, and over the past few months I've been working on writing up an answer to that question. I hope this suffices!

Read it here: https://bit.ly/3fxpANh

Good luck and have fun with Fermi Questions!
- Klebb
These users thanked the author Klebb for the post (total 3):
yoshiketchup (October 1st, 2022, 4:07 pm) • Umaroth (October 3rd, 2022, 8:22 am) • scispork (October 8th, 2022, 5:06 pm)
UIUC '25 | MSJHS '21 | Hopkins JHS '17 | BirdSO Board
Codebusters / Experimental Design (& Data) / Sounds of Music / WICI / Fermi Questions
jaymaron
Member
Member
Posts: 6
Joined: May 30th, 2022, 8:52 am
Division: Grad
State: WI
Has thanked: 1 time
Been thanked: 1 time
Contact:

Re: Fermi Questions B/C

Post by jaymaron »

Each problem has a customized ceiling and floor for points. The choice of the ceiling score can be chosen so that 10% is the best accuracy achievable. The ceiling score is then "4".

This is a set of Fermi problems where a ceiling and floor is specified for each.
https://jaymaron.com/fermi.html
Last edited by jaymaron on November 6th, 2022, 4:30 am, edited 1 time in total.
Flavorflav
Member
Member
Posts: 1388
Joined: February 5th, 2006, 7:06 am
Division: Grad
State: NY
Has thanked: 0
Been thanked: 3 times

Re: Fermi Questions B/C

Post by Flavorflav »

I'm writing this for an invitational. How many questions should be on it? I was thinking 50, but I am seeing some out there with only 30. Thoughts?
randomsci
Member
Member
Posts: 10
Joined: June 10th, 2018, 3:07 pm
Has thanked: 0
Been thanked: 1 time

Re: Fermi Questions B/C

Post by randomsci »

Hey everyone, I'm Andy, a graduating senior from Seven Lakes. Earlier in the year, I made this tool to study for fermi and it helped us get 2nd at MIT. I wanted to release it for all of yall after adding in all the public test sets. Everything is open source, including the ~1200 questions dataset, so feel free to use this tool as you like. The user interface is designed to be simple and mobile-friendly, and overall convenient since everything's in one place. I'll still be developing and adding more features so any suggestions are welcome. Hope you enjoy!
https://landy8697.github.io/open-scioly-fermi/
These users thanked the author randomsci for the post:
Krish2007 (May 26th, 2023, 6:11 pm)
User avatar
onshape
Member
Member
Posts: 107
Joined: January 28th, 2023, 11:42 am
Division: C
State: VA
Pronouns: Ask My Pronouns
Has thanked: 20 times
Been thanked: 24 times
Contact:

Re: Fermi Questions B/C

Post by onshape »

randomsci wrote: May 26th, 2023, 5:57 pm Hey everyone, I'm Andy, a graduating senior from Seven Lakes. Earlier in the year, I made this tool to study for fermi and it helped us get 2nd at MIT. I wanted to release it for all of yall after adding in all the public test sets. Everything is open source, including the ~1200 questions dataset, so feel free to use this tool as you like. The user interface is designed to be simple and mobile-friendly, and overall convenient since everything's in one place. I'll still be developing and adding more features so any suggestions are welcome. Hope you enjoy!
https://landy8697.github.io/open-scioly-fermi/
Thanks! Fermi sounds like such a fun event, but it's quite popular. It's fun to play around on here (even if I won't be competing in it in the future).
"I know two kinds of audiences only - one coughing, and one not coughing." -Artur Schnabel
"In the beginning was rhythm." -Hans von Bulow
"The art of music entombed a rich possession, but even far fairer hopes." -Franz Grillparzer
Locked

Return to “2023 Study Events”

Who is online

Users browsing this forum: No registered users and 1 guest