VEX Worlds Judges’ Handbook

VEX Worlds Judges’ Handbook © REC Foundation 2015 10/22/2015

Overview

Thank you for your willingness to help make the VEX Robotics Competition a success. This document will serve as a guide to assist you during your time as a VRC Judge. The purpose of this handbook is to acquaint you with the judging process used at VEX Worlds.

A judging team consists of two or three Judges. Each team of Judges will get to know roughly one team every 10-15 minutes through interview and observation. When Judges maintain a 10-15 interview and observation schedule, we find that the judging process runs more smoothly.

Awards at worlds fall into four categories: Presubmitted Awards, Interview Panel Awards, Balloted Awards, and Judged Awards.

Presubmitted Awards

These awards are presubmitted online and finalists are determined before VEX Worlds. A team of reviewers is recruited and led by the Head World Judge Advisor. These awards include:

Teacher of the Year Mentor of the Year Award

Partner of the Year Community Award

Innovate Award Inspire Award

Promote Award Teamwork Award

Interview Panel Awards Teams will sign up for a 15-minute scheduled interview with Judges in designated interview rooms for the Excellence Award. Judges for the Excellence Award will use rubrics to rate teams. These ratings will then be considered as part of the criteria for determining the Excellence Award winners.

Balloted Awards

Ballots that are submitted by teams or event staff choose these awards. Ballots are distributed, collected and tabulated by the Head Judge Advisor and Judge assistants to determine the winners. They include:

Energy Award (Event Staff balloting)

Sportsmanship Award (Team Ballots)

Service Award (Team ballots)

Judged Awards Teams are interviewed in the event area by teams of Judges. Judges assigned to these panels will walk through the pits to interview teams. They may also view teams on the field and around the venue. Judges are assigned to interview specific teams by their Division Judge Advisor. During deliberations these Judges will report their findings to their colleagues. The division Judge Advisor will lead a discussion to identify finalists for each of these awards. Judges will then go out and interview the finalists before final deliberations identify the award winners. The judged awards include:

Amaze Award Design Award

Build Award Think Award

Create Award Judges Award

VEX Worlds Judges’ Handbook 2 © REC Foundation 2015 11/2/2015

In this document, you will find:

Judge Advisor, Judge, and Judge Assistant position descriptions

A detailed description of each award

Criteria for judging the most commonly used awards

Key Terminology

A Note on Team Professionalism: The REC Foundation considers positive, respectful, and ethical conduct to be an important and essential component of the VEX Robotics Competition. Ethics is an important part of every engineer’s professional training and practice. Judges may consider team conduct in determining awards. Judges may consider students, mentors, and adults to be team members.

The Pit Area: The area that teams use as their home base during the day is called the Pit Area. Teams are usually provided with a table for their robot, laptop, batteries, and other VEX parts. The Pit is also the work area for the teams. This is is where Judges at VEX Worlds visit teams to conduct student interviews for most Judged awards.

It may be difficult to catch teams in their pit area due to tight competition schedules. Additionally, larger teams may only have some of their team in the pit area, with the rest of the members congregating in the stands. If at first you are unable to locate a team in their pit area, feel free to leave them a note to inform them that the Judges are hoping to speak with them and/or check their pit area later. A standard Judges’ note to teams is available from your Judge Advisor.

The Competition: Robot matches take place on the competition floor in a 12’ x 12’ competition field. Rounds last two minutes, including a 15-second autonomous period, and are scored by referees. Teams typically have several practice rounds, and then qualification rounds, followed by the elimination rounds. The competition floor is a great place to see the teams in action and to evaluate how well their robots perform. Judges who spend time viewing the competition have the opportunity to validate statements made by teams during student interviews. Be certain to ask your Judge Advisor if there is time allocated for this activity. In addition, you can get a great idea of a team’s sportsmanship, energy, and enthusiasm while observing teams on the competition field.

The Judge Advisor is the “Head Judge” for each division’s judging panel. For details on this role, please see the “Judge Advisor Responsibilities” section later in this document. The Judge Advisor is responsible for managing the judging teams, collecting and compiling the award rubrics and getting award scripts submitted.

The Judge Assistant acts as an assistant to the Judge Advisor. For details on this role, please see the “Judge Assistant Responsibilities” section later in this document. The Judge Assistant has the responsibility of assisting in compiling rubrics and scores. Most importantly, the Judge Assistant will be responsible for collecting and distributing award scripts to ensure a timely award presentation.

Head Judge Advisor

The Head Judge Advisor is responsible for recruiting and training Judges for VEX Worlds. The Head Judge Advisor decides how judging for the event will be conducted. Judges will seek out teams during the competition. Ultimately, the Head Judge Advisor must schedule, organize, and lead the overall judging process.

The Head Judge Advisor must also:

Confirm judging panels

Assign specific teams for each judging panel to interview/observe

Assign awards to be evaluated

Ensure that plenty of judging supplies are available

VEX Worlds Judges’ Handbook 3 © REC Foundation 2015 11/2/2015

Regarding awards, the Head Judge Advisor will also:

Act as a liaison between teams and Judges when questions arise

Keep the judging process on schedule

Identify any conflicts of interest on the judging panel, and ensure that Judges with a relationship with a

certain team do not take part in deliberations and award determinations for that team.

Work with the Judge Assistant(s) to ensure that all ballots are collected for awards being Judged by teams,

volunteers and/or the event staff.

Distribute scripts to divisions

Keeping track of all award recipients

Division Judge Advisor

Each division at VEX VEX Worlds will have a Judge Advisor. The division Judge Advisor runs the judging process for their division and works with the Head Judge Advisor to assure the judging process runs smoothly and on time. The Division Judge advisor’s responsibilities include:

Serves as the main point of contact for Judges at the VEX Worlds.

Moderate the judging panels’ deliberations on final award decisions:

o If the judging panel is unable to decide between two teams for a given award, it is up to the Division

Judge Advisor to break the tie.

o Organize Judges to conduct follow up team visits in order to determine award winners when multiple

Judge panels were used to Judge a single award or single awards category.

Prepare the award scripts for the Emcee, including full award description, and team name and number. This

task will be undertaken with assistance from the Head Judge Advisor.

Oversee equitable award distribution

Present final awards list and scripts to Head Judge Advisor for Awards Ceremony

Discuss Awards Ceremony presentation procedures with Judges and direct them to competition area for

presentation of Awards.

Judge Responsibilities

As a Judge, you should review the following information prior to the event:

The game description and/or game manual

o Knowing the tasks the teams will be trying to complete is essential to evaluating their robots on a

technical level.

For more information on this year’s game, including the game animations, please visit:

http://www.roboticseducation.org/vex-robotics-competitionvrc/current-game/

The tournament schedule

The VEX Worlds Judges’ Handbook.

Judging Criteria (Included in this Handbook)

During the event, Judges must:

Interview and or visit with teams in the appropriate area, and most likely this will be done in the Pit Area.

Please ask your Judge advisor for additional information.

Determine how individual teams performed, making notes to be used during the deliberations

Judges are responsible for completing the award rubrics and submitting them to the Judge Advisor.

During judging deliberations, Judges must:

Determine the top ranked teams for each award, and eventually the winners of these awards

Work with other Judges and the Division Judge Advisor to determine the Division Excellence Award winner

Share their notes on winning teams with the Division Judge Advisor for use in the Awards Ceremony script

VEX Worlds Judges’ Handbook 4 © REC Foundation 2015 11/2/2015

Judges should plan on attending and participating in the Opening and Awards Ceremonies. Remember to wear comfortable attire and shoes.

Judges Assistant Responsibilities

Assisting the Judge Advisor with all judging responsibilities

Collecting all ballots for awards being Judged by teams and/or volunteers and/or local event organizers

Organizing and recording Judging Rubrics at the Judge Advisor’s request

Helping the Judge Advisor to maintain the Excellence Award Spreadsheet

Working with the Judge Advisor to prepare the scripts for the award ceremony

Judge Training

The Head Judge Advisor will conduct a Judge training session the first morning of VEX Worlds. Typically, this training will involve reviewing this document, discussing the interview process, reviewing the current game and discussing judging rubrics. REC Foundation Judge training calls occur on a regular basis and are open to all event partners, Judge Advisors, Judges, and Judges Assistants. On each conference call, we will focus on lessons learned from previous events, preparing for upcoming events, share “best practices”, and answer any questions. These conference calls can serve as a resource to train and prepare Judges, please feel free to join us!

Here is a schedule of VEX Worlds Judge training calls:

For your convenience, our call-in number is toll free. To join call: (855) 212-0212, the access code is 878 304 944. If you have specific topics or questions that you want addressed, please send an email to tarek@roboticseducation.org ahead of the call.

Student Interviews & Discussions

See the Student Interview and Discussion Tips and Sample Questions Page at the end of this document.

Three general observations on adult participation:

Teachers/Mentors/Parents giving guidance and “helping” students fix or program robots is good.

Adults doing the majority of the work on a robot, or working on a robot alone without students is not good, as

there is obviously limited student learning and ownership taking place in such a situation.

How representatives from a team (students and/or adults) interact with others at an event may also be taken

into account by Judges. Unsportsmanlike or disrespectful behavior by students or adults associated with a

team can impact how the Judges consider them for awards.

Interpreters

Every effort will be made to have a number of bilingual Judges in each division. In addition to the bilingual Judges, interpreters are present at VEX Worlds to aid Judges during the interview process. The Head Judge Advisor will work with the Division Judge Advisors to coordinate interviews requiring interpreters. Judges who are multilingual are encouraged to make their Judge Advisor aware of their skills.

The Deliberation Process

Awards are to be spread as equitably as possible among the teams, with no team winning more than one Judged award if possible. A team should only win additional awards if they are for Robot Performance (tournament champion, tournament finalist and/or programming skills champion, and/or robot skills champion). Awards given to coaches and mentors do not apply to the team’s eligibility for an award.

Date Time

01-April-2016 8:00 PM Eastern

08-April-2016 8:00 PM Eastern

VEX Worlds Judges’ Handbook 5 © REC Foundation 2015 11/2/2015

The Judge Advisor should run the deliberation process as follows:

The Advisor will lead the judging group to determine award winners.

Based on the criteria listed in the “Award Criteria” section of this document, each team of Judges decides its

top candidates for an award. During deliberation for each award, each judging team presents its top

choice(s), and shares reasons they are recommending these teams.

o Good notes from interviews can be very important here. Through consensus, the group then

determines the top five or six teams in each award category.

o Judges are welcome to take pictures of robots to help them remember particulars of individual

robots.

o Of additional importance are the judging rubrics and scores from each Judge or Judge panel

After determining the top candidates for each award, the Division Judge Advisor and Head Judge Advisor

will use this information to discuss and decide upon the Excellence Award recipient. It may be necessary to

revisit teams to make a final determination.

The overall top candidates for each award are discussed as you work towards obtaining an award winner by

consensus.

o NOTE: It will often be the case that the same team will be the top candidate for multiple awards. If

this happens the judging panel needs to determine which award they believe the team deserves the

most and give them that award. From there, discuss again on the new candidate pool (minus the

team who has already been given another award) to determine the winner. This is why it is critical to

have multiple candidates for each award.

o Using the judging rubrics allows top candidates to be easily identified by compiling the

scores from each Judge’s rubric.

Judges should revisit the top teams, by either informally watching them on the field or visiting them in the Pit.

This last visit will help determine the final award winners.

Before final award assignments are made, the Judge Advisor checks with the Judges to ensure that Judges

are comfortable with results. Decisions need not be unanimous but a definite consensus must exist.

This process is designed to allow for normalization of judging scores. When numerical scores are used (as

in the case of the judging rubrics), some Judges naturally score higher; others lower. This often results in the

teams visited by high scoring Judges gaining an unfair advantage. Scores obtained during the initial

interviews help to identify teams that need a closer look. After additional fact finding the rank ordering occurs

for each award.

All discussions in the Judge’s room are confidential. Frank and open discussions that take place between Judges should never be discussed with teams as the students may misinterpret them.

Judging Schedule

The entire judging process will take place during the competition. When scheduling the judging of teams, it is recommended that each judging panel visits one team every 10-15 minutes. Anything more than this, and the Judges will not see a wide enough selection of teams to get a good basis of comparison and any more becomes too time consuming. The Judge Advisor will prepare a list of teams that each judging team is responsible for, along with match schedules for each of these teams. Please keep in mind that teams do not receive match list until the first morning of the event.

The following is a typical VEX Worlds Judge’s schedule.

Wednesday Thursday

8:00am – 12:00pm

Judge Advisors finish setting up Judging Rooms

8:00am Judge Training Breakfast

10:00am VRC Begin Excellence Interviews VRC and VIQC Judges meet with Division Judge Advisors

12:00pm – 1:00pm Lunch

10:30 – 12:30pm Team Interviews in Pits 12:30 – 1:30pm Lunch Break 1:30pm Opening Ceremony/Awards

1:00pm – 5:00pm

Judges review submitted Design Notebooks

1:45 – 6:30pm Resume Team Interviews 7:00pm Pit Area and Venue Close

VEX Worlds Judges’ Handbook 6 © REC Foundation 2015 11/2/2015

Friday Saturday 7:00am Breakfast 7:30am Breakfast 8:15am – 9:30am

Opening Ceremonies/ Parade/Awards

8:15am Opening Ceremonies/Division Awards 8:30am – 10:30am Qualifying matches continue

9:45am Resume VRC Excellence Interviews Resume VIQC STEM Research Project interviews

10:30am Award Scripts Due at Divisions 11:15 – 11:45am Alliance Selection Process for Each Division

(Judges Introduced)

9:45am Resume Team Interviews in Pits 11:45am – 12:30pm Lunch Break (Playoff teams ready at 1:00pm) 12:00pm –1:00pm

Lunch Break (VEX New Product Announcements)

12:30 – 2:30pm Division Playoffs and Awards

1:00pm – 5:00pm

Complete Team Interviews 3:00 – 3:45 Division Championships

5:30pm Award Scripts Due to Judge Advisor

4:00 – 6:00pm Finals and Closing Ceremony/Awards

Judging Materials The following is a list of suggested materials for the Judge Advisor and Judges to use on tournament day.

Award Criteria – Excellence Award

This is the highest award presented in the VEX Robotics Competition. The recipient of this award is a team that exemplifies overall excellence in creating a high quality VEX robotics program. This team excels in many areas and is a shining example of dedication, devotion, hard work and teamwork. As a strong contender in numerous award categories, this team deserves to be recognized for building a quality robotics program and a “team” committed to quality in everything that they do.

Teams are given points towards the Excellence Award in the following categories:

Tournament Qualification Round Ranking Programming Skills Challenge Ranking

Excellence Interview Robot Skills Challenge Ranking

Design notebook Judged performance in all other award categories

Online Challenges

Using this wide range of criteria, the Excellence Award will be presented to the team who excels in all areas of VEX Robotics. The following rubric will be used to help identify the Excellence Award finalists at VEX Worlds. It has been filled out as an example:

Team #

Online

Challenge *1

Design

Notebook *2

Judged

Awards *3

PS

Ranking *4

RS

Ranking *5

QR

Ranking *6

Excellence

Interview

Score

Total

Score

101 2 1 3 0 0 0 2 8

202 2 1 4 1 0 2 3 13

303 2 1 1 1 1 1 1 8

404 2 1 2 0 1 1 2 9

111 2 1 4 0 1 2 3 13

222 2 1 2 1 0 0 1 7

333 2 1 1 0 1 0 1 6

VEX Worlds Judges’ Handbooks Clipboards

Judging Rubrics Flip charts and easels with markers

Awards Appendix D Large table for Judge Advisor

Awards Ceremony Scripts Large table for judging materials

List of Judges Seating for final deliberations

List of awards to be given out Post-its

Map of tournament/Pit Map Tape

Master schedule Pens, pencils, erasers, highlighters

Event Program (if available) Judging Rubrics

VEX Worlds Judges’ Handbook 7 © REC Foundation 2015 11/2/2015

Notes on the Excellence Calculator:

*1 1 point for submitting an online challenge (2 points total possible) *2 1 point for submitting a High quality Engineering Design Notebook *3 1 point for every Judged Award the team is listed as a top candidate for consideration by the Judges *4 A PS Ranking Point is earned for finishing in the top 25 of the Programming Skills contest *5 A RS Ranking Point is earned by finishing in the top 25 of the Robot Skills contest *6 2 QR Ranking points will be awarded to teams finishing in the top 8 of the qualifying matches.

1 QR Ranking point will be awarded to teams finishing in the 9th through 16

th place in qualifying matches.

Criteria to Qualify for VEX Worlds Excellence Award Consideration:

A Team must have created a submission for at least two different online design challenges.

A team must sign up to submit an Engineering Design notebook for review by the Judges.

A team must have won an Excellence Award during the competition season.

Top contenders for Excellence will be found using the Excellence calculator. Once this calculation is completed, Judges will use their best judgment to choose the team they feel exemplifies the best overall robotics program. Judges will consider a team’s sportsmanship and professionalism when deliberating. A team is composed of students, mentors, and adults at the competition.

At the VEX Worlds the Excellence Award will be given out at the Middle School VRC, High School VRC and VEX U VRC levels. Previous winners of the overall Excellence Award will not be eligible for the Excellence Award at VEX Worlds.

Award Criteria

For full details on all awards, please see Appendix D – Awards from the official Game Manual.

Award Quick Reference Guide

Team Awards:

AMAZE Team with an amazing, well rounded and top performing robot BUILD Team with a well crafted robot COMMUNITY Team with extraordinary community involvement and awareness CREATE Robot with a creative engineering solution DESIGN Team with a professional design approach (ie Engineering Notebooks!) ENERGY Team with extraordinary enthusiasm EXCELLENCE Overall top honor in the VEX Robotics Competition FUTURE FUTURE Foundation Robotics Construction Challenge (submitted on

Robotevents.com) INNOVATE Team that has the most “Innovative” single design feature on their robot INSPIRE Team that has earned respect from their peers for innovative and creative

design solution JUDGES Team that deserves special recognition for their efforts leading up to, and

during, the event PROMOTE Team that creates strongest video promoting VRC (submitted on

Robotevents.com) SPORTSMANSHIP Team that most exemplifies competing in a friendly and respectful way SERVICE Team that most helps others enjoy their experience through advice and

assistance TEAMWORK Group with multiple teams competing and communicating effectively together THINK Team with an impressive and effective autonomous programming

Individual Awards:

MENTOR OF THE YEAR Mentor that had the greatest impact on their team PARTNER OF THE YEAR Partner identified as the strongest “Champion” in the VEX Robotics Competition TEACHER OF THE YEAR Teacher showing the most leadership and dedication VOLUNTEER OF THE YEAR Volunteer evaluated as the most passionate and dedicated person at the event

VEX Worlds Judges’ Handbook 8 © REC Foundation 2015 11/2/2015

The Amaze Award is presented to a team that has built an amazing, high-scoring and competitive robot that clearly demonstrates overall quality. Key Criteria:

Robot design is consistently high-scoring and competitive

Robot demonstrates a solid mechanical design and is robustly constructed to fulfill its designed task

Robot programming and autonomous mode are consistently effective and successful

o Integration of sensors for use in both autonomous and driver-controlled mode

Teamwork, interview quality, and team professionalism

The Build Award is given to a team that has built a well-crafted and constructed robot that also shows a clear dedication to safety and attention to detail. Key criteria:

Robot construction is of professional quality; robust, clean and elegant use of materials

o Solid construction (robot doesn’t “wobble”)

o Robust drive train and mechanisms

o Subsystems cleanly integrated, thought out and purposeful

Robot efficiently uses mechanical and electrical components

Robot is designed with a clear dedication to safety and attention to detail

Robot demonstrates reliability on the field and holds up under competition conditions

Teamwork, interview quality, and team professionalism

The Community Award is presented to a team that is recognized for making a difference in their community. This team demonstrates strong community building skills and has made many contributions to help support students and teams beyond their own school. This award is given to a team that makes a concerted effort to raise support in their community for technology education programs. At VEX Worlds, this award will be Judged based on a 500-word online submission and subsequent team interviews Key Criteria:

Evidence of meaningful community support

Has the team gone out of their way to give back to the community, whether it be robotics related or not

The Create Award is presented to a team that has a robot design that incorporates a creative engineering solution to the design challenges of this season’s game. Key criteria:

Robot is a well-crafted, unique design solution, demonstrating creative thinking

Team has demonstrated a highly creative engineering design process and methodology

Team has committed to ambitious and creative approaches to playing the game

Teamwork, interview quality, and team professionalism

The Design Award is presented to a team that demonstrates an organized and professional approach to the design process, project and time management and team organization. The winning team will be able to describe how they implemented an efficient and productive design process to accomplish the project goals. Key Criteria:

Engineering Notebook is a clear, complete document of the team’s design process

Team is able to explain their design and strategy throughout the season

Team demonstrates personnel, time and resource management throughout the season

Teamwork, interview quality, and team professionalism

Teams registered for this award at VEX Worlds will submit their Engineering Notebooks at check in. The notebooks will be reviewed using the first page of the Design Award Rubric. Teams with high quality Engineering Notebooks will be selected for follow up student interviews and discussions in the Team Pit Areas. Judges will complete the second page of the Design Award Rubric following each interview. Judges will use the completed Rubrics to help determine the Design Award winners.

Teams will no longer sign up for Design Award interviews at VEX Worlds, but must sign up by March 20th to have their notebooks reviewed. At VEX Worlds, only teams that have previously won an Excellence or Design Award at an official qualifying event will be eligible to submit an Engineering Notebook for review by the Judges.

VEX Worlds Judges’ Handbook 9 © REC Foundation 2015 11/2/2015

Engineering Notebooks:

One of the main missions of the VEX Robotics Competition is to help students acquire real world life skills that will benefit them in their academic and professional future. The Engineering Notebook is a way for teams to document how the VEX Robotics Competition experience has helped them to better understand the engineering design process while also practicing a variety of critical life skills including project management, time management, brainstorming and teamwork. The Engineering Notebook requirement of the Design Award has no specified format; each notebook should be created through a concerted effort by a team to document their design decisions. Notebooks should be bound and pages should not be removed. The official REC Foundation Robotics Engineering Notebook contains a number of hints for teams to use when preparing a notebook.

Engineering is an iterative process. Iteration requires a student to recognize and define a problem, brainstorm and work through various stages of the design process, test their designs, continue to improve their designs, and continue the process until a solution has been identified. During this process, students will come across obstacles, encounter instances of success and failure, and learn many lessons. It is this process that students should document in their Engineering Notebook.

Additionally, the Engineering Notebook is an opportunity to document everything a team does so that it can serve as a historical guide of lessons learned and best practices. Students may include a plethora of things in their Engineering Notebook including: team meeting notes, design concepts and sketches, pictures, notes from competitions, team members’ observations and thoughts, team organization practices, and any other documentation that a team finds useful.

Judging of Engineering Notebooks:

Maintaining an Engineering Notebook is highly recommended because the process can have many benefits for the team. For instance, the development of technical writing skills is a valuable tool to acquire. There are two awards given at both VEX Worlds and some local events which require teams to present their Engineering Notebook to the Judges - the Excellence and Design Awards. However, all teams are encouraged to create an Engineering Notebook and bring it to events to show and discuss with Judges. Teams should bring their engineering notebook to scheduled judging sessions. Judges are always interested in learning and seeing the various skills students acquire and demonstrate through their participation in the VEX Robotics Competition. It is encouraged that all members of a team contribute to this project throughout the season. The Design Award Rubric will be used to evaluate notebooks.

The Energy Award is based on team enthusiasm displayed at the event. The winning team will demonstrate boundless passion and energy throughout the competition – in the pit area, on the field, and in the audience, even when their robot is not playing. Key criteria:

Team maintains a high level of excitement and energy throughout the event

Team’s passion for competition and robotics enriches the event experience for others

Teamwork, interview quality, and team professionalism

The Future Award is presented to the winner of the FUTURE online challenge: Please go to http://forum.robotevents.com/design/ for more information on the FUTURE Foundation Robot Construction Challenge. Be sure to check out all of the other Online Design Challenges!

The Innovate Award is presented to a team that has demonstrated a strong combination of ingenuity and innovation in designing their VEX robot. This award will typically recognize a specific, unique piece of engineering that exemplifies thinking outside of the box and innovative engineering design. This robot feature should also be a part of the engineering design solution that solves the complex problems presented by the VRC game. At VEX Worlds, this award will be Judged based on a 500-word essay and upload a 30-60 second video of the team's innovative design. Only teams attending VEX Worlds will be eligible. The online application process starts on February 1, 2016. A judging panel will review potential recipients prior to VEX Worlds and choose the team that stands out as a worthy recipient. Key Criteria:

Robot design demonstrates an ingenious and innovative piece of engineering

Innovative feature is soundly crafted and is an effective solution to a design problem

Innovative solution is integrated as a part of an overall well-crafted robot

Students understand and explain why the innovative feature was necessary

o The award is not meant to recognize innovation for the sake of innovation, rather innovation for the

sake of excellence

Teamwork, interview quality, and team professionalism

VEX Worlds Judges’ Handbook 10 © REC Foundation 2015 11/2/2015

The Inspire Award is presented to a team that demonstrates outstanding leadership through action with other teams. This team will be nominated by their peers as a leader in innovative and creative design in the robotics community. The recipient team serves as an example to others and embraces the concept of cooperative learning. Cooperative learning will be based on inspiring other teams' designs or openly sharing their design ideas with others. At the VEX Worlds, this award will be Judged based on a 500-word nominating essay and upload a 30-60 second video of the nominated team's inspirational design. Only teams attending VEX Worlds will be eligible. Teams are encouraged to keep a list of teams that inspired them throughout the season and respond to online nomination process starting on February 1, 2016. A judging panel will review potential recipients prior to VEX Worlds and choose the team that stands out as a worthy recipient.

Team has been identified by their peers

Team has embraced the concept of cooperative learning

Team has shared their engineering and competition approach in public and at competitions

Team has inspired other teams with their design ideas

The Judges’ Award is presented to a team that the Judges determine is deserving of special recognition. Judges consider a number of possible criteria for this award, such as team displays of special attributes, exemplary effort and perseverance at the event, or team accomplishments or endeavors throughout the season that may not fit under existing awards, but are nonetheless deserving of special recognition.

The Mentor of the Year Award is given to a mentor or engineer that has helped their students achieve goals that were seemingly out of reach. This individual is a role model, a leader and an extraordinary mentor who helps show students new ways to expand their knowledge and solve problems in the worlds of STEM. The recipient of this award will be nominated by the students on their team with a written submission detailing how the mentor inspires, motivates and educates students in a positive, enthusiastic and challenging atmosphere. At VEX Worlds this award will be Judged based on a 500-word online submission and subsequent team interviews.

The Partner of the Year Award is presented to an organization that consistently supports students and schools as they pursue excellence in the VEX Robotics Competition. There are many partners and organizations that deserve recognition for their support of the REC Foundation and the VEX Robotics Competition. This partner supports student and school efforts to advance educational opportunities in Science, Technology, Engineering, and Math (STEM) subject areas; their generosity creates a positive impact for all those touched by the VEX Robotics Competition. The recipient of this award is recognized as a “champion” that fights for affordability and accessibility for all participants.

The Promote Award is presented to a VEX Robotics Competition school, club or team that has created and submitted an outstanding VEX Robotics promotional video. This video promotes the team in the community in order to recruit new students, mentors, and support. This video may be about the team, the program, the competition, the design and build process, the robot itself or any theme the team can dream up to help promote its VEX Robotics program to their community!

Videos will be submitted to the “Online Design Challenge” section at www.RobotEvents.com. The Online Design Challenge section will go live with multiple challenges by November 1, 2015, and teams can begin to submit their entries at that time. Key criteria:

Video is exciting, of high production and editorial quality, and expresses a complete vision

Video is original and innovative in approach, in editing and content

Video is clear and easy to follow, with a message that is easily followed

The Sportsmanship Award is presented to a team that has earned the respect and admiration of the volunteers and other teams at the event. This award is voted on by the teams participating at Vex worlds.. Key Criteria:

Team is courteous, helpful, and respectful to everyone at the event, on and off the field

Team treats others on the playing field in the spirit of friendly competition and cooperation

Team demonstrates respect and willingness to help to event staff and spectators

Team demonstrates excitement and enthusiasm throughout the event

VEX Worlds Judges’ Handbook 11 © REC Foundation 2015 11/2/2015

The Service Award is given to a team that is always willing and able to help other teams in need of assistance. There are many forms of “service” that can be given at an event: resources, knowledge and encouragement are some of the most important ways teams support each other throughout the competition. This award is voted on by the teams participating at Vex Worlds. Key Criteria:

Team is always willing to help others by sharing resources, knowledge, and encouragement

Team has helped not only alliance partners, but all teams, by sharing resources

Team has enriched local VRC events by volunteering personnel and/or resources

The Teacher of the Year Award is presented to a teacher who shows true leadership and dedication to his or her group of students. The winner of this award continually exceeds expectations to ensure a safe, enjoyable and educational experience for all students. The recipient of this award will be nominated by the students on their team with a written submission detailing how the teacher inspires, motivates and educates students in a positive, enthusiastic and challenging atmosphere. At VEX Worlds this award will be Judged based on a 500-word online submission and subsequent team interviews.

The Teamwork Award is presented to a group of teams from a single school, or organization, that demonstrates a season-long commitment to cooperation, unity and mutual respect. The Teamwork award is presented to a school, or an organization, that has built a sustainable multi-team robotics program. This award recognizes a school, or a group of teams from a single organization, which demonstrates the ability to field multiple independent robotics teams which also work and collaborate together to enrich the experience of all students involved. At VEX Worlds, this award will be Judged based on a 500-word online submission and subsequent team interviews. Key criteria:

Multiple teams working together in a single group or school

Teamwork demonstrated within their group and in their groups’ interactions with others

Evidence that working as a team has strengthened the learning process of the individuals

The Think Award is presented to a team that has successfully utilized autonomous programming modes during competition. Key criteria:

All programming is cleanly written, well documented, and easy to understand

Team has explained a clear programming strategy to solve the game challenge

Team demonstrates their programming management process, including version history

Team’s autonomous code is consistent and reliable

o Use of advanced programming techniques and/or sensors to control motion

o Multiple autonomous modes

o A simple mode which works consistently is preferred over a jaw dropping mode which only works

occasionally

Teamwork, interview quality, and team professionalism

The Volunteer of the Year will be easy to spot because of his/her enthusiasm, dedication and results oriented approach to bringing the experience and opportunities available through VEX Robotics to as many students as possible. VRC events don’t just materialize; it takes the collective effort of many people who are willing to give of their time and efforts for the sake of the participants. At the root of each event, you can usually find an individual spearheading the effort to “make things happen.” The recipient of this award demonstrates a commitment and devotion to their community, putting in many hours of hard work with persistence and passion to help make the event happen. The REC Foundation staff determines the Volunteer of the Year.

VEX Worlds Judges’ Handbook 12 © REC Foundation 2015 11/2/2015

Student Interview and Discussion Tips

Review Engineering Notebooks, complete appropriate section of Design Award Rubric before meeting teams.

Be prepared to re-word your questions if you find the team is struggling to understand or answer.

Try not to ask questions that allow the teams to answer with a yes or no. Encourage teams to elaborate on answers.

The students may be nervous. A tournament can be a stressful experience. Asking them questions about their robot can help

to put them at ease.

Judges need to talk to students, not adults. Occasionally enthusiastic adults will want to answer a Judge’s questions. In this

case, the Judge should politely remind the adult that Judges are there to talk with the students and that input from adults is not

considered.

When talking to young children, take a knee and smile. This will get you on the students’ level and make them comfortable.

Try to include as many student team members in your interview as possible.

Being a Judge gives you a unique opportunity to impact students. They will be looking to you for positive reinforcement. Just a

few words of encouragement can make their day. Try to leave each team with a positive feeling about their performance at the

event.

Taking a digital photo of each team with their robot oriented so that the license place is visible will help you identify teams and

robots during deliberations.

Use the provided “sorry we missed you” Judges’ note for teams that you have trouble locating in their pit.

Placing a colored adhesive dot on the team sign each time you meet with a team in the pit area will help you identify teams

that have been spoken to by Judges. Allow the team to choose the color to avoid the perception of a “secret color code”

Sample Questions

Getting the students talking is sometimes a harder task than it may seem. Here are some standard questions that are typically effective in helping to get students to express themselves:

Tell me about what your robot does and how?

What part of your robot are you most proud of? Why?

What were the challenges of this year’s game that you considered before designing your robot? How did you design your robot

to meet those challenges?

Has your approach to the game been effective? Why do you think your approach to the game has been effective?

What does your robot do in autonomous mode? Who programed it?

What makes your robot effective at playing this year’s game?

Did you use any sensors? What are they used for? How do they operate in your autonomous mode? How do they operate in

your driver-controlled mode?

Based on your robot’s performance so far, what would you like to improve?

Were there any other robots that inspired your robot design?

How many subsystems does your robot have? Who was responsible for integrating them?

Design Award Rubric Team Number __________________ Judges __________________

VRC Design Award Rubric 13 © REC Foundation 2015 11/2/2015

For Design Award details, review the Awards Appendix on http://www.roboticseducation.org/vex-robotics-competitionvrc/game-day-running-an-event/

Directions: Mark the descriptor that best describes the team’s performance for each criterion. Write the best features of the team’s Engineering Notebook and Student Interview and Discussion on the back of this page.

Engineering Notebook: The notebook...See Student Interview and Discussion Criteria on Next Page

Criteria Expert (3 points) Proficient (2 points) Emerging (1 point) Points

Design Process: Challenge

Describes the challenge at the beginning of the notebook with words and pictures and states the teams’ goals toward accomplishing that challenge.

Identifies the challenge at the beginning of the notebook.

Neglects to clearly identify the challenge.

Design Process: Brainstorming

Generates an extensive list of possible approaches to the challenge with labeled diagrams.

Provides an extensive list of possible approaches to the challenge.

Contains very short list or does not list results of brainstorming sessions.

Design Process: Select Approach

Explains why the selected approach was chosen and why the other alternatives were not chosen.

Explains why the selected approach was chosen.

Does not document why the team selected the approach they did.

Design Process: Build and Program

Records building and programming process in such detail that someone outside team could recreate robot by following the steps in the notebook.

Documents the key steps in the process of building and programming.

Seems to skip some important steps in process of building, programming robot.

Test and Redesign

Describes in great detail the process of troubleshooting, testing, and redesigning through all iterations (cycles) of the process.

Captures the key results of the troubleshooting, testing, and redesign cycle.

Leaves out important information about the troubleshooting, testing and redesign cycle.

Usefulness Is such a detailed account of the team’s design process that the reader could recreate the project’s history. It is a useful engineering tool. It contains evidence that the team made decisions about the design process based on previous entries. The team can explain why the notebook is organized the way it is.

Is a complete record of the process, documenting the key events of each work session. It is organized in a way that any team member can locate needed information.

Is missing, or lacks the detail needed for the reader to understand the team’s history, and/or is not organized in a way that an outsider can make sense of it.

Resources Shows team’s efficient use of time with an overall project timeline. Team uses checkpoints to help them know how well they are staying on schedule and readjusts schedule as needed. Notebook illustrates good use of human resources by assigning members roles based on strengths.

Documents team’s efficient use of time with planning, goal-setting each session. Shows wise use of human resources by assigning members specific tasks.

Does not provide evidence of the team’s wise use of the team’s time or talents.

Teamwork Provides evidence that all team members were consistently involved in the process, that individual team members were self-directed enough to finish what needed to be done, and that all team members consistently shared ideas and respectfully considered each other’s input.

Shows that all team members’ were involved in the process, that team members could be counted on because they did what they were supposed to, and that the whole team shared ideas and supported the ideas of others.

Suggests that perhaps some team members did most or all the work, that one or more individuals had to be nagged or reminded to do their work, and/or that some team members did not contribute ideas or that their ideas were not considered.

VRC Design Award Rubric 14 © REC Foundation 2015 11/2/2015

Design Award Rubric Team # ________________ DD

Student Interview and Discussion: During the interview... See Engineering Notebook Criteria on Previous Page

Criteria Expert (3 points) Proficient (2 points) Emerging (1 point) Points

Design Process Students describe the goals of the design process and how the team

accomplished the challenge.

Students provide possible goals of the design

process but do not clearly identify how team

accomplished the challenge.

Students neglect to identify any goals of

the design process, cannot describe

how team accomplishes challenge.

Design:

Methods &

Strategies

Students describe multiple design methods and strategies considered;

explaining both how and why the current design strategy was selected

Students only describe their current design

methods and strategy; explaining only one of

either how or why the current design strategy

was selected

Students do not describe any design

methods or strategies considered; do

not explain why or how current design

strategy was selected

Team Work:

Contributions

Students explain how each team member contributed to the design and

strategy.

Students explain how some team members

contributed to the design and strategy.

Students only explain how 1-2 members

contributed to the design and strategy.

Interview:

Individual

Contributions

All students independently answer the judges' questions. Students support each other as needed to

answer the judges’ questions.

Students rely on one or two members to

answer all the questions.

Interview:

Professionalism

Students present answers in a respectful and courteous manner to Judges

and other team members, making sure each team member has a chance to

contribute and waiting to speak until the other person has finished.

Students present answers in a respectful,

courteous manner to either team members or

Judges.

Students do not present themselves in a

respectful and courteous manner.

Total the number of points earned from Student Interview and Discussion:

Total the number of points earned from Notebook:

Total the number of points combined:

Comments:

Directions: Mark the descriptor that best describes the team’s performance for each criterion. Write the best features of the team’s notebook and interview

on the back of this page. For Excellence Award details, review the Awards Appendix.

Excellence Award Rubric

Team Number __________________

VRC Excellence Award Rubric 15 © REC Foundation 2015 11/2/2015

Criteria Expert (3 points) Proficient (2 points) Emerging (1 point) Points

Notebook: The notebook...

Design Process:

Development Describes a clear progression and development of the concept. Identifies some development of the

concept. Neglects to clearly identify the

development of the concept.

Design Process:

Documentation Demonstrates clear and detailed progression with an extensive catalog of

sketches/pictures of the concept with full written documentation. Provides a catalog of sketches/pictures of

the concept with some written

documentation.

Contains few or no sketches/pictures

of the concept with little to no

documentation.

Design Process:

Test and Redesign

Demonstrates the need for redesign (if applicable) of the subsystems and

details after cycle of prototyping, testing and analysis. Explains the redesign in some detail;

providing testing and analysis. Does not provide any explanation of

the redesign, testing or supporting

analysis.

Robot Design:

Strategy Documents how the robot is designed to manipulate all game pieces, in all

zones, in all goals with effective use of strategy. Documents how the robot can somewhat

manipulate game pieces, in all zones, in all

goals.

Documents how the robot can

manipulate a fair portion of the game

pieces, in all zones.

Robot Design:

Build

Documents the use of appropriate mechanisms equipped to withstand the

rigors of the competition. Documents the essential mechanisms that

are equipped to withstand the rigors of

competition, but loss of minor pieces do not

affect the ability to accomplish the task.

Documents the use of mechanics

however, the mechanics are not the

appropriate mechanisms for the task

and show some wear and tear after

qualifying matches.

Technical

Knowledge

Includes important mechanical terms throughout the notebook. The authors

demonstrate their understanding of the terms and related concepts by

embedding them in the descriptions of their design, build and strategy

process.*

Includes important mechanical terms.* Does not incorporate important terms*

or uses the words inaccurately.

*Important mechanical terms include torque, speed, gear ratios, potentiometers, limit switches, line followers, and ultrasonic. This list is used to provide a few examples of key

vocabulary. It is not an exhaustive list and is not mean to be a checklist.

VRC Excellence Award Rubric 16 © REC Foundation 2015 11/2/2015

Interview: During the interview...

Design Process Team members describe the progression of the development of

the concept.

Team members provide parts of the

development of the concept.

Team members neglect to identify the

development of the concept.

Design:

Test & Redesign

Team members clearly explain the redesign of the subsystems

and details after a cycle of prototyping, testing and analysis.

Team members explain the redesign process in

some detail, including a description of testing

and analysis.

Team members cannot explain any of the

redesign, testing or analysis .

Robot Design: Build Team members describe how and why they selected the

appropriate mechanisms equipped to withstand the rigors of the

competition.

Team members explain only one of either how or

why the appropriate mechanisms were selected.

Team members cannot explain the

mechanisms they selected for the design.

Technical Knowledge Team members continuously incorporate important mechanical

terms* into their conversations with the judges. They accurately

use the words to describe larger concepts. It feels like the

words are an integral part of their vocabulary.

Team members accurately use some of the

important mechanical terms*, but the use feels

forced rather than a natural part of their

vocabulary.

Team members are unable to accurately use

key mechanical terms to describe their

design process and strategy.

Team Work:

Contributions

Team members explain how each team member contributed to

the design and strategy.

Team members explain how some team

members contributed to the design and strategy.

Team members can only explain how 1-2

members contributed to the design and

strategy.

Interview: Individual

Contributions

The individual team members could independently answer the

judges' questions.

Support each other as needed to answer the

judges’ questions.

Relied on one or two members to answer all

the questions.

Interview:

Professionalism

Team members present their answers in a respectful and

courteous manner to the judges and other team members,

making sure each team member has a chance to contribute

and waiting to speak until the other person has finished.

Team members present their answers in a

respectful and courteous manner to either the

team members or the judges.

Team members do not present themselves

in a respectful and courteous manner.

Interview:

Terminology &

Communication

Team members showed mastery of terminology and concepts

and expert communication skills.

Team members showed proficient technical

terminology, good communication skills.

Team members showed weak terminology,

poor communication skills.

Total the number of points earned:

Additional Note::