Experimental Design B/C

User avatar
Adi1008
Moderator
Moderator
Posts: 423
Joined: December 6th, 2013, 1:56 pm
Division: Grad
State: TX
Location: Austin, Texas
Contact:

Experimental Design B/C

Postby Adi1008 » August 4th, 2018, 11:37 pm

Experimental Design B/C: This event will determine a participant's ability to design, conduct and report the findings of an experiment conducted entirely on site.

Experimental Design Wiki

Experimental Design Test Exchange 2018

Past Threads: 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017, 2018
University of Texas at Austin '22
Seven Lakes High School '18
Beckendorff Junior High '14

User avatar
dxu46
Exalted Member
Exalted Member
Posts: 514
Joined: April 11th, 2017, 6:55 pm
Division: B
State: MO
Location: contemplating my life choices
Contact:

Re: Experimental Design B/C

Postby dxu46 » September 4th, 2018, 5:08 am

Big rules change...thoughts?
EDIT: also, we can't make up data anymore :/
Ladue Science Olympiad!
Projected 2019 events: Dynamic Planet, Experimental Design, Fossils, Game On, Road Scholar
Summary of 2018 season: :D :shock: :) :roll: :evil: 8-) :| :cry:

"Beer is proof that God loves us and wants us to be happy." - Benjamin Franklin
Friend me here!

Anomaly
Member
Member
Posts: 380
Joined: February 17th, 2017, 10:46 am
Division: C
State: PA
Location: Somewhere in the known or unknown universe
Contact:

Re: Experimental Design B/C

Postby Anomaly » September 4th, 2018, 12:35 pm

dxu46 wrote:Big rules change...thoughts?
EDIT: also, we can't make up data anymore :/

Smh you shouldn’t have been doing that in the first place
Orefield MS SO 2015-2018 (Student Coach 2019), Parkland HS SO 2019
Medal/Ribbon Count
Invitational: 24
Regional: 14
State: 5
Events:
Anatomy and Physiology, Disease Detectives, Codebusters, Write It Do It

#livingalifeofdepression

nicholasmaurer
Coach
Coach
Posts: 281
Joined: May 19th, 2017, 10:55 am
Division: Grad
State: OH
Location: Solon, OH
Contact:

Re: Experimental Design B/C

Postby nicholasmaurer » September 4th, 2018, 1:29 pm

dxu46 wrote:Big rules change...thoughts?
EDIT: also, we can't make up data anymore :/


I think it is a step in the right direction. Under the old system, teams were incentivized to begin writing the analysis sections etc. before all the data had been collected, which defeats the point. I also like the new checklist format better - it will reduce the number of math and totaling errors.

However, I am still skeptical of the event in general. One primary concern is there is often little to distinguish between the top teams. At the Solon HS invitational last year, the best fifteen teams were separated by less than 5 points. Top teams memorize a framework that covers all of the rubric requirements and simply modify this to fit a different simple experiment each tournament. If you read their XPD write-ups from different tournaments, they are remarkably similar and formulaic.

Therefore, I fail to see the intrinsic value of XPD with the current format; real scientific articles (and academic lab reports) vary much more widely to meet the needs of the experiment/topic/field. Because teams simply regurgitate similar write-ups each time, the current structure of this event does little to assess students' understanding of even the most basic concepts of experimental design: study types, biases, statistical analysis, statistical power/sample size, research ethics, etc.
Assistant Coach and Alumni ('14) - Solon High School Science Olympiad
Co-Director - Northeast Ohio Region

User avatar
TheChiScientist
Member
Member
Posts: 485
Joined: March 11th, 2018, 11:25 am
Division: C
State: IL
Location: Somewhere between Absolute Zero and 1E32 K.
Contact:

Re: Experimental Design B/C

Postby TheChiScientist » September 4th, 2018, 3:08 pm

^COMPLETELY AGREE
The fact is that competitions will always come down to 1 or 2 points. Not assuming for ties which are extremely annoying. As for the new rule change, I think it will shake up the operations of many teams as the final portion can be one of the most time-consuming.
A Science Olympian from 2015 -To Present
Medal Count:22 8-)
Current Events
Boomilever,Code Busters,Exp Design

Background In
Thermo, WIDI, Hovercraft, Bridges, Wright Stuff, Geocaching, Ecology, Fermi

School: Crystal Lake Central High School Wiki
Assassinator #119 and Co-Conspirator in #120 ;)

User avatar
Unome
Moderator
Moderator
Posts: 3670
Joined: January 26th, 2014, 12:48 pm
Division: Grad
State: GA
Location: somewhere in the sciolyverse
Contact:

Re: Experimental Design B/C

Postby Unome » September 4th, 2018, 4:52 pm

nicholasmaurer wrote:
dxu46 wrote:Big rules change...thoughts?
EDIT: also, we can't make up data anymore :/


I think it is a step in the right direction. Under the old system, teams were incentivized to begin writing the analysis sections etc. before all the data had been collected, which defeats the point. I also like the new checklist format better - it will reduce the number of math and totaling errors.

However, I am still skeptical of the event in general. One primary concern is there is often little to distinguish between the top teams. At the Solon HS invitational last year, the best fifteen teams were separated by less than 5 points. Top teams memorize a framework that covers all of the rubric requirements and simply modify this to fit a different simple experiment each tournament. If you read their XPD write-ups from different tournaments, they are remarkably similar and formulaic.

Therefore, I fail to see the intrinsic value of XPD with the current format; real scientific articles (and academic lab reports) vary much more widely to meet the needs of the experiment/topic/field. Because teams simply regurgitate similar write-ups each time, the current structure of this event does little to assess students' understanding of even the most basic concepts of experimental design: study types, biases, statistical analysis, statistical power/sample size, research ethics, etc.

I have heard that MIT in one of the more recent years was different. But in general, I agree. This sort of criticism of the event seems to have gotten progressively more common over the last few years.

(then again, do we really want whatever else Inquiry would give us instead?)
Userpage
Chattahoochee High School Class of 2018
Georgia Tech Class of 2022

Opinions expressed on this site are not official; the only place for official rules changes and FAQs is soinc.org.

nicholasmaurer
Coach
Coach
Posts: 281
Joined: May 19th, 2017, 10:55 am
Division: Grad
State: OH
Location: Solon, OH
Contact:

Re: Experimental Design B/C

Postby nicholasmaurer » September 4th, 2018, 5:17 pm

Unome wrote:I have heard that MIT in one of the more recent years was different. But in general, I agree. This sort of criticism of the event seems to have gotten progressively more common over the last few years.

(then again, do we really want whatever else Inquiry would give us instead?)


I wouldn't remove XPD (which would require Inquiry to find a replacement) - I would reformat it. Rather than have teams perform an experiment, I would suggest breaking it up into sections.

For example:

One portion could be a written test covering topics such as biases, study design, research ethics etc. Have another section where sample data is provided and teams need to perform the appropriate statistical analysis. Another section could present a question/topic and ask teams to design a suitable protocol for researching it.

Just a thought...
Assistant Coach and Alumni ('14) - Solon High School Science Olympiad
Co-Director - Northeast Ohio Region

User avatar
dxu46
Exalted Member
Exalted Member
Posts: 514
Joined: April 11th, 2017, 6:55 pm
Division: B
State: MO
Location: contemplating my life choices
Contact:

Re: Experimental Design B/C

Postby dxu46 » September 9th, 2018, 8:34 pm

nicholasmaurer wrote:I think it is a step in the right direction. Under the old system, teams were incentivized to begin writing the analysis sections etc. before all the data had been collected, which defeats the point. I also like the new checklist format better - it will reduce the number of math and totaling errors.

I agree that this is a good idea, and also according to soinc.org, the total amount of points is 110 instead of 106 like on the rules.
nicholasmaurer wrote:However, I am still skeptical of the event in general. One primary concern is there is often little to distinguish between the top teams. At the Solon HS invitational last year, the best fifteen teams were separated by less than 5 points. Top teams memorize a framework that covers all of the rubric requirements and simply modify this to fit a different simple experiment each tournament. If you read their XPD write-ups from different tournaments, they are remarkably similar and formulaic.

I completely agree with this point, although to me, it seems like the rules include the procedure for tiebreaks purposely vague so that competitors have to actually try to go above and beyond instead of doing a "fill-in-the-blank" style write-up and judges have to be able to tell which teams are obviously more skilled and have put more effort. I understand what you mean, and this could be remedied with more sections, although idk how teams are going to get more than what there already is done.
nicholasmaurer wrote:Therefore, I fail to see the intrinsic value of XPD with the current format; real scientific articles (and academic lab reports) vary much more widely to meet the needs of the experiment/topic/field. Because teams simply regurgitate similar write-ups each time, the current structure of this event does little to assess students' understanding of even the most basic concepts of experimental design: study types, biases, statistical analysis, statistical power/sample size, research ethics, etc.

IMO, this event is more about partnership, cooperation, and scientific procedure than actually experimenting. Like, don't we already know that if you drop a ball from a tall height, it will rebound? Also, teams are given only 50 minutes to write so much, they would need extreme teamwork abilities to finish the experiment and write-up. The new format for the event seems to emphasize this part, as you have to use your time wisely.

These are only my thoughts, and they shouldn't be taken too seriously.
Ladue Science Olympiad!
Projected 2019 events: Dynamic Planet, Experimental Design, Fossils, Game On, Road Scholar
Summary of 2018 season: :D :shock: :) :roll: :evil: 8-) :| :cry:

"Beer is proof that God loves us and wants us to be happy." - Benjamin Franklin
Friend me here!

Jacobi
Member
Member
Posts: 137
Joined: September 4th, 2018, 7:47 am
State: -
Contact:

Re: Experimental Design B/C

Postby Jacobi » September 15th, 2018, 11:05 am

I just realized that you can load the rubric into your programmable graphing calculator.

No more rubric memorization!

User avatar
dxu46
Exalted Member
Exalted Member
Posts: 514
Joined: April 11th, 2017, 6:55 pm
Division: B
State: MO
Location: contemplating my life choices
Contact:

Re: Experimental Design B/C

Postby dxu46 » September 15th, 2018, 11:22 am

Jacobi wrote:I just realized that you can load the rubric into your programmable graphing calculator.

No more rubric memorization!

Only division C though :(
Ladue Science Olympiad!
Projected 2019 events: Dynamic Planet, Experimental Design, Fossils, Game On, Road Scholar
Summary of 2018 season: :D :shock: :) :roll: :evil: 8-) :| :cry:

"Beer is proof that God loves us and wants us to be happy." - Benjamin Franklin
Friend me here!

User avatar
TheChiScientist
Member
Member
Posts: 485
Joined: March 11th, 2018, 11:25 am
Division: C
State: IL
Location: Somewhere between Absolute Zero and 1E32 K.
Contact:

Re: Experimental Design B/C

Postby TheChiScientist » September 15th, 2018, 1:49 pm

dxu46 wrote:
Jacobi wrote:I just realized that you can load the rubric into your programmable graphing calculator.

No more rubric memorization!

Only division C though :(

SHHHHHHH... We keep that to ourselves ;) (No need for them to add to the rules...)
A Science Olympian from 2015 -To Present
Medal Count:22 8-)
Current Events
Boomilever,Code Busters,Exp Design

Background In
Thermo, WIDI, Hovercraft, Bridges, Wright Stuff, Geocaching, Ecology, Fermi

School: Crystal Lake Central High School Wiki
Assassinator #119 and Co-Conspirator in #120 ;)

Jacobi
Member
Member
Posts: 137
Joined: September 4th, 2018, 7:47 am
State: -
Contact:

Re: Experimental Design B/C

Postby Jacobi » September 16th, 2018, 7:51 am

TheChiScientist wrote:
dxu46 wrote:
Jacobi wrote:I just realized that you can load the rubric into your programmable graphing calculator.

No more rubric memorization!

Only division C though :(

SHHHHHHH... We keep that to ourselves ;) (No need for them to add to the rules...)

OK, will do.


Wait... what did I say about writing the rubric in my calculator? ;)

Jacobi
Member
Member
Posts: 137
Joined: September 4th, 2018, 7:47 am
State: -
Contact:

Re: Experimental Design B/C

Postby Jacobi » September 16th, 2018, 7:55 am

Unome wrote:
(then again, do we really want whatever else Inquiry would give us instead?)


Maybe we'll get a real computer science event for once.

Jesusfather123
Member
Member
Posts: 23
Joined: October 26th, 2016, 12:07 pm
State: -
Contact:

Re: Experimental Design B/C

Postby Jesusfather123 » September 16th, 2018, 10:39 pm

Hi,
Can someone explain the new rule for ED this yr? Does it mean , the whole team have to perform the experiment and then move on the whole writing process?
Thanks!

User avatar
kate!
Member
Member
Posts: 226
Joined: October 11th, 2017, 12:07 pm
Division: B
State: NY
Location: R.C. Murphy JHS
Contact:

Re: Experimental Design B/C

Postby kate! » September 17th, 2018, 12:06 pm

Jesusfather123 wrote:Hi,
Can someone explain the new rule for ED this yr? Does it mean , the whole team have to perform the experiment and then move on the whole writing process?
Thanks!

In the first twenty minutes, the only thing you can do is do the experiment and write the basics (the first half of the rubric.) This gives your whole team more time to focus on the actual experiment rather than trying to write down errors and observations. In the next twenty minutes, you'll have finished the experiment, so it'll be much easier to now focus solely on analysis. This is also to prevent people from making up data and forces you to perform a thorough experiment. It depends on how you split up the rubric, but it should be mostly the same as last year, except for the fact that you now have designated times for doing the experiment and analyzing it.
I know stuff about rocks, minerals, experiments, and ecosystems, yay!
Now I kind of know stuff about amphibians, reptiles, fossils, and water... hopefully I'll get to keep learning.


Return to “Lab Events”

Who is online

Users browsing this forum: No registered users and 1 guest