VEX IQ Challenge Judging Process LeRoy Nelson LeRoy_Nelson@roboticseducation.org Tarek Shraibati tarek@roboticseducation.org
Differences in Judging Between VEX IQ Challenge and VRC VEX IQ Challenge needs more judges for STEM Research Project presentations For VEX IQ Challenge, Excellence Award candidates must be top ranked in both Design Award and STEM Research Project Award For VRC, Volunteer of the Year is in standard set VRC has more optional awards for large events: Community, Innovate, Inspire, Service, Teamwork VEX IQ Challenge Excellence Calculator is smarter
Documents http://www.roboticseducation.org/vex-robotics-competitionvrc/game-day-running-an-event/ http://www.roboticseducation.org/vex-iq-challenge/viq-event-documents/ STEM Research Project Awards Appendix Judge Guide Student Interview and Discussion Tips and Sample Questions Design Award Rubric STEM Research Project Rubric Technical and Other Judged Awards Rubric Award Descriptions for Judges Room Excellence Award Calculator Award Scripts are in Tournament Manager
Training Calls The Training Call Schedule will be posted on the Volunteers pages: http://www.roboticseducation.org/vex-robotics-competitionvrc/volunteer/ http://www.roboticseducation.org/vex-iq-challenge/volunteer-for-vex-iq-challenge/ Call this number to join: (855) 212-0212 the access code is 878 304 944. If you have specific topics or questions that you want addressed, please send an email to LeRoy_Nelson@roboticseducation.org
Teams Assigned to Sets of Judges Judge Advisor assigns teams for each set of judges to interview One set of judges per 8-12 teams Review Interview Tips and Sample Questions before interviewing teams Design judges review Engineering Notebooks using the Design Rubric before interviewing teams STEM Research Project judges view presentations and then interview teams Judges use rubric forms to evaluate teams
Design Award Engineering Notebooks Engineering Notebook Teaches engineering design process Teaches project management Teaches written communication skills Teaches students to organize their thoughts Required for Design, Design required for Excellence Collect notebooks at team check in for event Keep a log of the teams that submitted notebooks Notebooks must have team number on the cover
Design Award Judging Judges use the Engineering Notebook portion of the Design Award Rubric to evaluate notebooks Judges select the top 5 or more notebooks (or top 25% or more of notebooks judged, if greater) as top contenders Judges interview those teams using the team interview portion of the Design Award Rubric Judges rank the interviewed teams for the Design Award This process is used at VEX Worlds
STEM Research Project Award STEM Research Project presentation required Teaches scientific method and research skills Teaches verbal communication skills Teaches students to organize their thoughts Up to 4 minute presentation to judges by student team members only, including setup Up to 6 minute follow-up interview with judges Judges rank the top 5 or more contenders (or top 25% or more of teams reviewed, if greater) using the STEM Research Project Rubric
STEM Research Project Judging Choose relatively quiet spaces for presentations Classrooms or conference rooms work great, but quiet hallways or corners can be used Judges should avoid being the only adult in a room with students; if possible, judge in pairs
Technical Awards and Other Judged Awards For large events, some or all of the Technical Awards and/or the Other Judged Awards may be offered: Technical Awards: Amaze, Build, Create, and Think Other Judged Awards: Energy and Sportsmanship Use the VEX IQ Challenge Awards Rubric to score and rank the top 5 contenders (or the top 25% or more of teams interviewed, if greater)
Sam Smith John Jones 101 4 5 4 3 3 3 2 1 3 4 2 Awesome shooter. Breaks easily. 202 3 1 2 2 3 2 3 3 1 2 1 Judge s: Robot dropped. Rebuilt here 303 5 4 4 1 4 5 4 5 4 3 2 Solid, unbreakable.
Judges Report Back After Initial Interviews The Judge Advisor posts the Award Descriptions for each award to be considered Each set of judges posts its top candidates for each award under the Award Descriptions
Judges Identify Top Contenders Judges compare the top ranked teams for each award and determine if follow-up interviews are needed to rank them to choose award winners Judges consider everything they see and hear at the event plus reports from Referees and other event volunteers Note that teams 202, 606 and 808 show up for Design Award and STEM Research Project Award (marked with colored dots), so they are candidates for the Excellence Award
Excellence Award This is the highest award presented in the VEX Robotics programs. The recipient of this award is a team that exemplifies overall excellence in building a high quality robotics program. This team excels in many areas and is a shining example of dedication, devotion, hard work and teamwork Only teams that are top candidates for both Design Award and STEM Research Project Award are candidates for the Excellence Award
Two Excellence Awards at Large Blended Events Events that are allocated four (4) or more spots for advancement to the next level championship and that include the participation of at least ten (10) elementary and ten (10) middle school teams will offer two Excellence Awards One for a registered elementary school team One for a registered middle school team Each Excellence Award follows the same candidate identification and winner selection process
Small and Medium Events Can Use Candidate Team Rankings Sheet Enter ranking data for the Excellence Award candidates in the Excellence Award Candidate Team Rankings sheet to compare the candidates
Excellence Award Candidate Team Rankings Sheet
Large Events Can Use Excellence Calculator The Basic version looks like the Excellence Award Candidate Team Rankings sheet, but it computes the average ranking of each team for you It works well if all sets of judges for a given award interviewed approximately the same number of teams The Advanced version is used at VEX Worlds It handles multiple divisions and wide variations in the numbers of teams interviewed by sets of judges It requires the entry of the number of teams interviewed by each set of judges for each team ranked Twice as much data entry as the Basic version
Judge Deliberation: Usual Order of Award Selection Use judgment to select the Excellence Award winner from the candidates that you compared Then choose the Design Award and STEM Research Project Award winners from the remaining top candidates for each award Then choose the Technical Award winners from the remaining top candidates if those awards are offered Then choose the Other Judged Award winners if those awards are offered
Judge Deliberations Judges work to reach a consensus on each award The goal is one judged award per team Try to allocate all awards to teams that are in the top tier of candidates, i.e. most award worthy A team that is the number one candidate for only one award will usually receive that award and be removed as a candidate for other awards Finalize awards choices
Judge Advisor Responsibilities Award Winners and Scripts The Judge Advisor must ensure that award winners are correctly entered into Tournament Manager The Judge Advisor must ensure that award scripts are printed from Tournament Manager for presentation at the awards ceremony. This will also ensure that the award winners are ready for posting to the event listing on robotevents.com
Judge Advisor Responsibilities Distributing or Disposing of Rubrics If completed STEM Research Project and/or Design Award rubrics will be shared with teams, the Judge Advisor must ensure that all feedback included on the completed rubrics is positive and encouraging to teams If the rubrics will not be shared, the Judge Advisor must properly dispose of these and all other judging materials at the conclusion of the event
VEX IQ Challenge Excellence Awards at VEX Worlds At VEX Worlds, Excellence Awards are offered at the Middle School and Elementary School levels The Excellence Award is earned by an entire school or organization at VEX Worlds, not just a single team Organizations that won Excellence Award in the previous three (3) years will not be eligible for the Excellence Award at VEX Worlds Only top candidates for both Design Award and STEM Research Project Award are eligible for Excellence Award The advanced version of the Excellence Award Calculator is used at VEX Worlds
VEX IQ Challenge Design Award at VEX Worlds Teams will submit their Engineering Notebooks to Judges at check in The notebooks will be reviewed using the Design Award Rubric to determine the top contenders for the Design Award Judges will conduct follow-up interviews and determine the Design Award winners
STEM Research Project Award at VEX Worlds Only teams that have won an Excellence Award or STEM Research Project Award during the current season will have an opportunity to present their STEM Research Project to judges at VEX Worlds Qualified teams must sign up for STEM Research Project presentations at: http://www.robotevents.com/vexawards/ from February 1, 2017 until March 20, 2017