1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science...

42
1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March 14

Transcript of 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science...

Page 1: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

1Robofest

Robofest 2007 Explanation of Judging Rules

CJ Chung, Associate Prof. of Computer ScienceLawrence Technological University

Revised on March 14

Page 2: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

2Robofest

Agenda

1. Introduction to Robofest Judging

2. Exhibition Judging Guidelines3. Game Judging Guidelines

Page 3: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

3Robofest

Robofest Judging Philosophy• Simple

• Fair

• Maximize Students’ learning

Page 4: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

4Robofest

Judge Types and Roles

Game JudgesChief Game Judge

Exhibition JudgesChief Exhibition Judge

25%Qualify toWorlds

Page 5: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

5Robofest

Exhibition Judging

Page 6: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

6Robofest

2007 Exhibition Competition• Exhibition team member must

introduce her/his role (5 sec x number of team members)

• Introduction of Robots (10 sec)• They will have 4 minutes for the robot

presentation and demonstration • After the demo, they will also answer

a question; they have 45 seconds including discussion time to answer.

Page 7: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

7Robofest

Exhibition JudgingExhibition Judges & Chief Exhibition Judge

teamID Avg. comments_____ ____ _____________ ____ _____________ ____ ________

Judge’s Awards &Qualification

PRteamID Total comments_____ ____ _____________ ____ ________…

k

k: number of judges

Chief Exhibition Judge using Excel

PRteamID Total comments_____ ____ _____________ ____ ________…

Page 8: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

8Robofest

Roles of Exhibition Judges• Before the Opening Ceremony - visit each

team table to be familiar with the exhibitions

• During the official presentation Watch the demos carefully and score them Score presentation and answer a question

• Anytime before the game 2nd round Visit team tables to interview with teams Inspect program code and robot(s) Meeting with Chief Exhibition Judge

Page 9: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

9Robofest

Responsibilities of Chief Exhibition Judge• Anytime before the Game 2nd round

Meeting with Exhibition Judges Collect forms and sheets Check the forms Calculate average score for each team using Excel

• Before the award ceremony: decide award winners as well as qualified teams to advance

• After the event, submit all the forms, sheets, hard copies to scorekeeper

Page 10: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

10Robofest

Exhibition Competition Comprehensive Score is based on:• Public Demonstration Performance (reliability) -

30%• Originality (creativity) - 20%• Team Public Presentation and Answer of

Question - 20%• Source Code Inspection - 10%• Complexity and Number of Functions - 5%• Usefulness / Practicality - 5%• Entrepreneur ideas and mindset – 5%• New Technologies Used and Other Factors - 5%

Page 11: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

11Robofest

Game:

Miner Rescue Challenge

Page 12: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

12Robofest

Robofest 2007 Game Judging• Simpler!

No robot inspection No code inspection No program hardcopy submission

• But, introducing Unknown Problem (UP) • No final matches

• Overall score is based on Oral Presentation (OP) – 10% Unknown Problem (UP) - 20% Performance Score (PS) – 70%

Page 13: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

13Robofest

Miner Rescue Challenge

The brightness of the competition area is unknown

Page 14: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

14Robofest

2007 Game Rules - General• The successful rescue of a miner occurs

when the ball touches or passes over the center black line on the base station with the robot (no throwing allowed)

• 2 minutes per game are given

• 2 chances (rounds) are given for each team

• Only 2 players are allowed in the official playing field

• 2 robots are required and both must participate in rescuing miners (if not, no 5 points!)

Page 15: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

15Robofest

First Round Game Procedures• UP will be unveiled right after opening ceremony

• Your team has solved the UP, and is ready for the game, come to the staging area with 2 bots

• Each team member must introduce her/his name, and role (5 sec. x # members)

• Introduce their Robots (10 seconds)

• MC will ask a question (selected at random); answer it within 45 sec including discussion time

• MC will assign a competition track

• Test of the unknown problem by Judges

• Robots will be inspected by Judges

Page 16: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

16Robofest

How to start the robot• Staring orientation can be any direction

• Robots can start at the same time and in any order, multiple times.

• All ground contact points must start on the base station,10x24 board. This means that the robots can hang over the

board as long as all the wheels are touching the board, for example.

Page 17: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

17Robofest

Setup # 1 ball - “Recommendations” for Qualifying Competitions

• can be placed in the middle of the straight line as shown in the figure

Page 18: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

18Robofest

Setup # 2 ball - “Recommendations” for Qualifying Competitions

Host organizer can choose an option:

• Option 1: place at random in an imaginary circle with 10” diameter in the center of the mine field (see above a)

• Option 2: almost in the center (fixed, see above b)

a

b

Page 19: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

19Robofest

Setup # 3 ball - “Recommendations” for Qualifying Competitions

Can be placed (this rule is for fairness)

• Round 1: left (or right) side corner

• Round 2: right (or left) side corner

1

2

The gap isbetween ¼ - ½inches.(0.6 - 1.25cm)

Page 20: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

20Robofest

Setup # 4 ball - “Recommendations” for Qualifying Competitions

Placed somewhere inside the tunnel not on the

black line. (Chief Judge will decide) Junior division - not touching the wall Senior division – touching one wall (see above example)

Page 21: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

21Robofest

Scores: Junior & Senior Division

, and all 4 miners were saved using both robots!

Page 22: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

22Robofest

What is the ramp?

Page 23: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

23Robofest

The Bot is returning home without the ball… When can I pick it up?• Answer: When any part of the robot

touches the black line on the base station

• In order not to lose the 5 points

Page 24: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

24Robofest

In Case of Any Failure (when a robot goes crazy…)• If a robot is touched outside the base

station, the robot must be restarted.• If a ball was moved by the (crazy) robot,

judges must reset the ball closed to original location, after two robots are back to the base station.

• If any piece of the robot is left on the field or taken apart during the play, it must be retrieved by the player and the “5” points cannot be earned.

Page 25: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

25Robofest

Robot Specifications:• No size limitation as long as it stays alone

on the base board. • You may use any part & material• Only one robot controller (computer) for

each robot.

Page 26: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

26Robofest

Tunnel Setup – “recommendation” for Qualifying Competitions • Tunnel will be located on

the left-side straight line,

• Exact location will be almost same as the figure 1 in the official rule

• the opening/orientation of the tunnel will be same as the figure 4 in the official rule document

Page 27: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

27Robofest

Tunnel Setup – “recommendation” for Qualifying Competitions - Cntd • Note that the tunnel is taped on the board

completely. It should not move during play.

• A judge may need to hold down the mine structure if a robot is too powerful.

Page 28: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

28Robofest

Unknown Problem (UP) Details• Each team will be given a sheet with the

description for the UP.• One of the game robots should be used to

solve the problem. • You will not need to make any mechanical

changes to robot, assuming you are using a light sensor facing down and a touch on your robot.

• the UP will require a LCD to display at least 3 digits.

• The score and the rank of this UP will be used for tie-breaker.

Page 29: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

29Robofest

Flash Extra Points for Unknown Problem (UP):The purpose is to encourage teams to tryearly!

• The team that solves the problem first time will get 3 extra UP points

• The team that solves the problem 2nd time will get 2 extra UP points

• The team that solves the problem 3rd time will get 1 extra UP points

Page 30: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

30Robofest

What if your team cannot solve UP?• Try to get partial points

• Just line up! - Do not forget to bring the following forms: Scoring Sheet with official team label (can be

found in the team envelope) Unknown Problem Sheet given

Page 31: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

31Robofest

Miner Rescue – Junior vs. Senior Division• Everything will be the same, except the

following: Senior Division UP will be harder The No. 4 ball for Senior Division will be

placed at more difficult location. The ball is touching a wall.

Page 32: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

32Robofest

Judging and Prizes:• Everyone is the winner: All students will receive

medals and framed certificates.• 25% of the total number of teams at each

qualifying site will win large trophies. Overall Performance Awards Programming Awards Presentation Awards (Special) Judges Awards: Innovative

solutions, best platform (if needed), etc.• The tie breaker is the result and rank of the

unknown problem• A team will win only one award trophy

Page 33: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

33Robofest

How Game Judging is Scored:

n: number of teamsm: number of official tracks

Score Keeper

(Spreadsheet)

Round 1 Round 2

m

Game Judges

PRteamID Score_____ __________ __________ _____

OPteamID Score_____ __________ __________ _____

…UPteamID

Score

UPteamID

Score

n n

PSteamID

Score

PSteamID

Score

… PSteamID

Score

PSteamID

Score

n

ChiefJudge

Page 34: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

34Robofest

Typical scenario to play a game• Emcee will check timer, judges, teams are

ready

• Give the start signal

• Then Judges place balls. All the playing fields must have balls at almost

same locations. Suggested locations were mentioned in the

previous slide

Page 35: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

35Robofest

Game Oral Presentation (OP) Judging Criteria (10% of the overall score)

• Team introduction (10%)

• Robot introduction (10%)

• Answer a question (70%)

• Presentation delivery (10%) Eye contact Loud enough Clear Spoke extemporaneously Time used effectively Etc.

Page 36: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

36Robofest

Roles of Game Judges• Before the Opening Ceremony

Check the tracks before opening ceremony Be familiar with all the game rules and rule

updates

• During the game Score team presentations. Maintain official tracks (Especially the base

station and ramp boards must be checked) Check rule violations Reset Balls Score games – submit the sheet to Chief Judge

Page 37: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

37Robofest

Responsibilities of Chief Game Judge• Decide the exact location of the No. 4 ball and

inform that to Judges.• Collect Game Scoring Sheets• Check Game Scoring Sheets• Deliver to Score Keeper• Check the Excel file entered by Score Keeper• Decide anything not specified in the rule• Make final decision, if any judging dispute

occurs• Work with Scorekeeper to decide Award

Winners and Qualifying teams

Page 38: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

38Robofest

Rule Updates

• www.robofest.net homepage Updates Clarifications FAQs

Page 39: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

39Robofest

Robofest Little Robots, Big Missions

Questions?

Page 40: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

40Robofest

Robofest Little Robots, Big Missions

Thank You

Page 41: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

41Robofest

Robofest 2007 WarmUp

“Motivating young Minds to Master the

Machine.”

March 10, 2007 (revised on March 14)

Lawrence Technological University

Page 42: 1 Robofest Robofest 2007 Explanation of Judging Rules CJ Chung, Associate Prof. of Computer Science Lawrence Technological University Revised on March.

42Robofest

Warm-Up Schedule8:00 a.m. Setup begins

9:00 a.m. Arrival and Check-in of Judges, Volunteers, Coaches and Teams

9:10 a.m. All Teams should be checked in

9:15 a.m. Judge Training (Judging forms will be distributed and explained)

Exhibition Judging – Lori Birman and AJ Ureel Game Judging – CJ Chung and Joe Long

9:30 a.m. Opening Welcome – Bill Drummond, National Anthem, Introduction of Site Host Organizers and Judges – Lori

Birman, and Explanation of Judging Rules – CJ Chung

10:00 a.m. Unveiling of Unknown Problem

10:15 a.m. Demonstration of Exhibitions

Game Judge Training 2 – Joe Long

10:30 a.m. First Round

11:30 p.m. Second Round

12:10 p.m. Closing & Thank You