Robotics Program Evaluation - Home - Clear Creek...Robotics Evaluation 2008-09 to 2012-13 Page | 4...

Robotics

Program Evaluation

2008-09 to 2012-13

Office of Assessment and Evaluation

Clear Creek Independent School District

Office of Assessment and Evaluation

Robotics Program Evaluation

Presented to Board of Trustees on April 14, 2014

Dana Morgan:

Signature Date

Luis Medina:

Signature Date

Dr. Robert Bayard:

Signature Date

Dr. Steven Ebell:

Signature Date

Dr. Greg Smith:

Signature Date

2013-2014 Board of Trustees Program Evaluation Team Ann Hammond, President Win Weber, Vice President Page Rander, Secretary Laura DuPont, Ph.D., Member Charles Pond, Member Ken Baliker, Member Dee Scott, Member Greg Smith, Ph.D., Superintendent

Steven Ebell, Ed.D., Deputy Superintendent, Curriculum & Instruction Dana Morgan, Director, Career and Technical Education Luis Medina, Facilitator, Robotics Robert Bayard, Ed.D., Director, Assessment and Evaluation Laura Gaffey, Data Analyst, Assessment and Evaluation Pat McKenna, Data Analyst, Assessment and Evaluation

Robotics Evaluation 2008-09 to 2012-13

Page | 1

Background Information on Robotics

The purpose of program evaluations in the Clear Creek Independent School District (CCISD) is multi-faceted and shall result in findings, recommendations, and/or conclusions that:

Ensure program alignment with District goals and vision;

Assess strengths and weaknesses of the program;

Measure the success of the program in meeting its expressed goals; and/or

Result in improvements in, revisions to, or discontinuation of the program.

As part of CCISD’s program evaluation process, the Office of Assessment and Evaluation has completed a program evaluation for the Robotics program encompassing the five-year period from the 2008-09 school year through the 2012-13 school year.

According to the CCISD Robotics brochure, “the mission of CCISD Robotics is to expose students to the field of engineering, provide hands-on engineering opportunities, and increase awareness of engineering education.” Students in grades 2-12 have opportunities to take part in the CCISD Robotics program through their campus- or district-wide teams, which may participate in a variety of competitions. Students in grades 3-8 can also participate in Robotics by attending a summer camp known as “Robo Camp” in CCISD.

The Robotics program in CCISD began in 1996 through a partnership with the National Aeronautics and Space Administration at Johnson Space Center (NASA-JSC). Students from the existing three CCISD high schools (Clear Creek High School, Clear Lake High School, and Clear Brook High School) joined the program and were supported by CCISD staff and NASA-JSC engineers. As the flagship of the CCISD Robotics program, students who participated in the high school robotics program officially became known as the CCISD “Robonauts” in 2000.

The CCISD Robotics program is based on four national and international competitions: For Inspiration and Recognition of Science and Technology (FIRST), which sponsors two competitions – FIRST Lego League (FLL) and FIRST Robotics Competition (FRC); Boosting Engineering Science and Technology (BEST); and VEX.

CCISD Grade Levels and Teams

Robotics Competition

For Inspiration and Recognition of Science and Technology (FIRST)

Boosting Engineering Science

and Technology (BEST)

VEX FIRST Lego League

(FLL) FIRST Robotics

Competition (FRC)

Grade Levels Grades 2-5 Grades 9-12 Grades 6-12 Grades 6-12

Elementary Teams

24 Teams from 23 Elementary Schools

Intermediate Teams

2 Teams from 2

Intermediate Schools

4 Teams from 4 Intermediate Schools

High School Teams

1 HS Team ("Robonauts")

from 6 High Schools

1 HS Team from 6 High Schools

13 Teams from 5 High Schools (including

students from PLTW*)

*PLTW – Project Lead The Way


Page | 2


For Inspiration and Recognition of Science and Technology (FIRST)

The mission of FIRST “is to inspire young people to be science and technology leaders, by engaging them in exciting mentor-based programs that build science, engineering and technology skills, that inspire innovation, and that foster well-rounded life capabilities including self-confidence, communication, and leadership” (http://www.usfirst.org/aboutus/vision).

FIRST, a nonprofit national organization, was founded in 1989 in Manchester, New Hampshire. The 2013-2014 school year is projected to have over 350,000 students competing on 32,650 teams with over 28,000 robots. FIRST also has over 64,000 mentors and adult supporters, plus over 66,000 volunteers who assist in organizing and running events and competitions.

FIRST Robotics Competition (FRC)

The FIRST Robotics Competition (FRC) is a robotics program for high school students ages 14-18. In CCISD, students participating in FRC are known throughout the community as the “Robonauts.” FRC “combines the excitement of sport with the rigors of science and technology” and provides students with opportunities “as close to real-world engineering as [students] can get.” In addition to building and competing with a robot of their own design, Robonauts and other FRC students work alongside professional engineers and learn about and use sophisticated software and hardware. They also experience design, programming, teamwork, strategic thinking, and coopertition (cooperation while in competition), and through competitions in local and national tournaments, have opportunities to qualify for millions of dollars in scholarships (http://www.usfirst.org/roboticsprograms/frc).

FRC releases a new game in January of each year, and provides teams with a description of how to win the game. Teams then have six weeks to design and build their robot using a common kit of parts provided by FIRST which typically weigh up to 150 pounds. During this intense time period, students must also manage their time efficiently between their academic work, family responsibilities, and the Robonaut team commitment.

First Lego League (FLL)

The FIRST Lego League (FLL) is a robotics program for children ages 9 to 16 years old. CCISD participates in FLL at the elementary level, with 24 teams represented from 23 elementary schools. FLL is designed “to get children excited about science and technology – and teach them valuable employment and life skills” (http://www.firstlegoleague.org/mission/support).

Each fall, FLL releases a challenge, based on a real-world scientific topic such as nano-technology, climate, or transportation. “Each Challenge has three parts: the Robot Game, the Project, and the FLL Core Values. Teams of up to ten children, with one adult coach, participate in the Challenge by programming an autonomous robot to score points on a themed playing field (Robot Game), developing a solution to a problem they have identified (Project), all guided by the FLL Core Values. Teams may then choose to attend an official tournament, hosted by an Operational Partner” (http://www.firstlegoleague.org/challenge/thechallenge).

Boost Engineering and Science Technology (BEST)

BEST is a robotics competition for intermediate and high school students. Its mission “is to engage and excite students about engineering, science, and technology as well as inspire them to pursue careers in these fields” (http://best.eng.auburn.edu/b_about_best.php). BEST boasts participation of over 850 secondary schools and over 18,000 students in its competitions. Each local competition is called a “Hub Level” in which there are two divisions: Robotics – The Game (individual teams which submit a Project


Page | 3


Engineering Notebook) and the BEST Award (an additional competition that allows for school-wide student participation). Top teams from both divisions in approximately 10 hubs advance to a regional championship competition, and regional winners from both divisions advance to the national championship.

In the Robotics Game, teams compete in up to 18 matches from the seeding round, to the wild card match, semi-final round, and championship round. In each match, four teams compete in a 24’ x 24’ playing field for up to three minutes in their quest to be awarded points for successful completion of tasks.

The BEST Award, the most coveted award at a BEST competition, is presented to the top three teams that best embody the concept of boosting Engineering, Science, and Technology based on criteria that includes: teamwork, diversity of participation, sportsmanship, creativity, application of the engineering design process, ethics, positive attitude/enthusiasm, and school/community involvement. An additional 14 awards are available to teams, including, but not limited to: oral presentation, project engineering notebook, most photogenic machine, best computer-aided drafting (CAD) design, and best t-shirt design.

VEX

VEX is a robotics program for intermediate and high school students ages 11-18. VEX offers students a platform to learn about academic skills and post-secondary opportunities spanning science, technology, engineerin,g and math (STEM) fields (http://www.vexrobotics.com/vex).

Each year, the VEX Robotics Competition presents an engineering challenge to students in the form of a game. “Students, with guidance from their teachers and mentors, use the VEX Robotics Design System to build innovative robots designed to score the most points possible in qualification matches, elimination matches, and Skills Challenges” (http://www.robotevents.com/robot-competitions/vex-robotics-competition).

VEX has a partnership with Project Lead the Way (PLTW), a national program that offers a sequence of courses in which students learn and apply the engineering design process. Students in PLTW within CCISD high schools who are enrolled in Principles of Engineering participate in VEX competitions.


Page | 4


Robotics Demographic Information

N* Hispanic Asian Black White Two+

2008-2009

Robo Camp ***

Robotics 66 4.5% 15.2% 3.0% 77.3%

District 370459 20.4% 10.4% 9.3% 59.5%

2009-2010

Robo Camp ***

Robotics 74 9.5% 23.0% 5.4% 56.8% 5.4%

District 37472 21.3% 10.4% 9.2% 58.8%

2010-2011

Robo Camp 138 15.2% 18.8% 0.7% 55.8% 8.0%

Robotics 99 8.1% 29.3% 1.0% 58.6% 4.0%

District 38250 25.1% 9.8% 10% 53.8% 2.0%

2011-2012

Robo Camp 191 10.5% 20.9% 0.5% 63.4% 4.7%

Robotics 145 16.6% 27.6% 2.1% 49.7% 4.1%

District 39209 26.0% 9.8% 8.3% 52.3% 3.2%

2012-2013

Robo Camp 218 17.4% 11.9% 1.4% 65.1% 4.1%

Robotics 188 13.3% 26.6% 2.7% 51.1% 5.3%

District** 39889 26.9% 9.8% 8.3% 51.3% 3.3% Data Source: AEIS, CCISD Explore * Based on Snapshot ** Data Source: PEIMS file *** No data available Robo Camp is a weeklong Robotics camp held in the summer for students in grades 2-8. Robotics is the after school program offered at all levels at various schools in the district during the school year.

More students participated in Robotics during 2008-2009 and 2012-2013; however, the names of students and counts were not available for the evaluation.

There is a higher percentage of Asian and White students participating in both the Robo Camp as well as the after school Robotics program, with the exception of the White student participation during the 2009-2010 year as compared to the District percentages. The Hispanic and Black participation percentage has increased from the 2008-2009 year through 2012-2013 year; however, the percentages still fall below the district level.


Page | 5


Robotics Demographic Information

N* Female Male Eco. Dis. LEP SPED GT At-Risk

2008-2009

Robo Camp ***

Robotics 66 30.3% 69.7% 12.1% 0.0% 3.0% 39.4% 3.0%

District 370459 48.7% 51.3% 22.0% 7.3% 9.7% 7.1% 28.5%

2009-2010

Robo Camp ***

Robotics 74 25.7% 74.3% 17.6% 1.4% 1.4% 31.1% 4.1%

District 37472 48.4% 51.6% 22.7% 7.5% 9.2% 7.5% 30.3%

2010-2011

Robo Camp 138 16.7% 83.3% 3.6% 4.3% 3.6% 30.4% 10.1%

Robotics 99 23.2% 76.8% 12.1% 1.0% 4.0% 59.6% 10.1%

District 38250 48.6% 51.4% 25.3% 7.8% 8.9% 7.8% 25.8%

2011-2012

Robo Camp 191 19.4% 80.6% 1.6% 3.7% 7.3% 30.9% 9.9%

Robotics 145 34.5% 65.5% 11.0% 0.7% 6.2% 46.2% 9.0%

District 39209 48.7% 51.3% 28.1% 8.1% 9.2% 7.9% 29.1%

2012-2013

Robo Camp 218 16.1% 83.9% 5.0% 2.3% 7.8% 26.6% 6.9%

Robotics 188 26.1% 73.9% 18.1% 0.0% 1.6% 45.2% 7.4%

District** 39889 48.8% 51.2% 28.0% 8.5% 9.6% 8.4% 28.4% Data Source: AEIS, CCISD Explore * Based on Snapshot ** Data Source: PEIMS file *** No data available Robo Camp is a weeklong Robotics camp held in the summer for students in grades 2 – 8. Robotics is the after school program offered at all levels at various schools in the district during the school year.

There is a higher percentage of males than females who participate in the Robotics program. There is a higher number of GT students who participate in the Robotics program as compared to the district average.


Page | 6


Grade Level Information

Grade Level 01 02 03 04 05 06 07 08 09 10 11 12

2008-2009

Robo Camp*

Robotics 2 14 6 12 13 19

2009-2010

Robo Camp*

Robotics 13 10 2 9 4 21 15

2010-2011

Robo Camp 36 48 33 21

Robotics 1 1 15 16 9 13 10 6 8 6 14

2011-2012

Robo Camp 42 43 48 34 12 12

Robotics 1 11 14 10 9 10 22 19 32 17

2012-2013

Robo Camp 32 76 48 37 21 4

Robotics 28 25 11 7 9 25 27 30 26

Totals Robo Camp 110 167 129 93 33 15

Robotics 1 1 1 69 78 32 30 29 68 70 102 91

Robotics student list provided by Robotics Facilitator Data based on grade level on Snapshot day *No data available

Based on the student list provided, there has been an increase in the number of students who have participated in nearly every grade level from the 2008-2009 school year through the 2012-2013 school year. Overall, there has been a large number of students participating in Robo Camp in grades 2-4. Of the students involved in Robotics throughout the school year, the majority of students are in grades 11 and 12.


Page | 7

Program Evaluation Questions

The following questions were determined by this program evaluation team to evaluate Robotics:

1. What opportunities are available for students to join and participate in a Robotics program?

2. What are the successes of the Robotics program?

3. What are the academic achievements of students who have participated in Robotics?

4. What is the level of student/parent satisfaction with the Robotics program?

5. What is the average annual cost per student?


Page | 8


Between 2008-09 and 2012-13, the number of teams in which students participated in Robotics grew from 21 to 39 teams. As of the 2013-14 school year, students from all schools across the district have an opportunity to join one of 45 Robotics teams. Whether or not students choose to participate in Robotics during the school year, all students can choose to attend a CCISD Robotics summer camp, or “Robo Camp.”

Year Program Number of

Teams

Number of

Students Total Students

2008-09

FLL 18 180

262 BEST 2 50

FRC 1 32

2009-10

FLL 25 250

351 VEX 3 20

BEST 2 50

FRC 1 31

2010-11

FLL 23 230

340 VEX 3 40

BEST 2 50

FRC 1 20

2011-12

FLL 21 210

404 VEX 5 90

BEST 2 45

FRC 1 59

2012-13

FLL 25 250

508 VEX 11 120

BEST 2 65

FRC 1 73

2013-14

FLL 24 230

520 VEX 17 150

BEST 3 80

FRC 1 60

Total 2385

FIRST Robotics Competition (FRC)

FRC is the premier robotics competition-group in CCISD, and high school students who join are called Robonauts. High school students are provided many opportunities to become CCISD Robonauts through an open enrollment system that enables any student who is interested, regardless of experience, to join the team. In fact, a majority of students who join the Robonauts have never interacted or had experience pertaining to programming or mechanics prior to joining the Robotics group; yet they still develop an inspiration for engineering and technology because of their participation.

These high school students also have the opportunity to work one-on-one with NASA engineers in order to brainstorm solutions to problems, draw up designs, build robots, and learn how robotics and


Page | 9


engineering are applied in the real-world. At the conclusion of each season, senior students are often offered intern positions to work in the Robotics branch of the Johnson Space Center (NASA-JSC). This allows recently graduated students the opportunity to put their technical skills to use in a real work environment. Interns in the past have worked on projects such as the Space Exploration Vehicle, which is a lunar rover prototype, and Robonaut 2, the world’s most advanced humanoid robot which is now operational aboard the international space station. These high profile internships are an indicator of the high level of professionalism imparted on Robonaut students. With the assistance of former mentors, many Robonaut alumni have returned to JSC to work summer internships. There are now multiple Robonaut alumni-turned-mentors who have returned to work full-time jobs at JSC.

In addition to being mentored by NASA-JSC engineers, Robonauts in-turn serve as mentors to students on Robotics teams at the elementary (FLL) and intermediate (BEST and VEX) levels during the fall semester. These experiences provide students with opportunities to develop leadership, time management, and problem-solving skills. It also provides many of the elementary and intermediate students their first opportunity to learn about and participate in Robotics and to be mentored by a high school student.

Robonauts began mentoring and helping with the inaugural FLL in 1999. During that year, CCISD hosted a district-wide tournament, in which the Robonauts built the playing fields, served as judges, and volunteered as referees. Within ten years, the Robonauts and CCISD were hosting the largest FLL tournament in the nation with over 100 teams participating. During the tournaments, Robonauts set-up, coach, mentor, judge, emcee, referee, queue, score-keep, run pit administration processes, provide technical support, and tear down the event. During the FLL season, team members who mentor FLL teams volunteer in excess of six hours weekly at their assigned elementary school teams. As of the 2013-14 school year, Robonauts mentor at 21 elementary schools.

FLL

The First Lego League is comprised of students in grades 4 and 5 increased from 18 teams to 24 teams from 23 campuses.

There is a district wide competition held one Saturday in early to mid-December. The regional competition is held in the spring.

BEST

BEST is comprised of students in grades 6-8 from the two WAVE campuses, forming two teams. . An additional high school team includes students from six CCISD high schools.

BEST competitions for both intermediate and high school teams is held the last week of October with the state level competition held in early November.

VEX

There are four VEX teams from four of the intermediate campuses along with 13 teams from the five comprehensive high schools. The high school teams include students from the Project Lead The Way (PLTW) classes.

During the 2012-2013 school year, PLTW held VEX competitions for their course at their campus and will host VEX competitions for the 2013-14 school year. For the current 2013-2014 school year, two intermediate campuses added Robotics courses to their course selection as electives.


Page | 10


Robo Camp

Robo Camp is open to students entering grades 3-8 which provides the students the opportunity to learn the principles of engineering and how they apply to Robotics. The camp is staffed by a coordinator, five teachers, and ten high school Robotics students who work as assistants to run the four day long camp. At the end of the week, students have an opportunity to compete with the robots they have built, and it is video streamed for parents to view online. Robo Camp is one of the largest fundraisers for all of Robotics and is totally self-funded.

The cost is $175 per student. CCISD students and children of CCISD employees have the opportunity to participate in Robo Camp. Students with financial challenges receive partial or full scholarships.


Page | 11

2. What are the successes of the Robotic program?

Competitions for elementary and intermediate teams are held in the fall of each school year. High school competitions begin in the fall with the CCISD FRC competition held in the spring.

Elementary FLL

Each Fall semester, the district elementary teams compete in the local CCISD FLL Qualifier where a percentage advances on to the Lone Star South Texas District Regional Competition. The percentage is based on the total participation in the state. On average, eight CCISD elementary teams advance.

Intermediate BEST

Westbrook Intermediate has won the local Hub BEST Award for the past six years and advanced to the state competition each year. This award is given to the overall BEST team at the local Hub competition.

High School BEST

The high school BEST team has won the BEST Award at the local Hub for the past two years and advanced to state in 2012-13 as well as the current 2013-14 school year.

VEX Robotics teams

The Clear Brook High School VEX team won their Regional Championship in 2010. The Clear Falls High School Vex team won their Regional Championship and advanced to Nationals in 2012. In the current 2013-2014 school year, the Clear Falls team and the Clear Springs team have won their Regional Championships and advanced to the State South Regional Competition in February 2014.

FRC Competitions and Awards

Year Competition FRC Award Earned

2008 2008 Bayou Regional Regional Finalists

2008 2008 FIRST Championship

2008 2008 Lone Star Regional

Delphi "Driving Tomorrow's Technology" Award

Engineering Inspiration Award

Regional Finalists

2009 2009 FIRST Championship Division Finalist - Archimedes

Johnson & Johnson Gracious Professionalism

2009 2009 Lone Star Regional Autodesk Visualization Award

Johnson & Johnson Gracious Professionalism

2009 2009 Washington DC Regional

Motorola Quality Award

Regional Finalists


2010 2010 Florida Regional Gracious Professionalism Award sponsored by Johnson & Johnson


Engineering Excellence Award sponsored by Delphi

Regional Chairman's Award

Regional Winners

2011 2011 Alamo Regional


Page | 12

2. What are the successes of the Robotic program?

FRC Competitions and Awards

Year Competition FRC Award Earned

2011 2011 FIRST Championship Gracious Professionalism Award sponsored by Johnson & Johnson


Coopertition Award

Engineering Inspiration Award

Regional Winners

2011 2011 Midwest Regional

Coopertition Award

Industrial Design Award sponsored by General Motors

Regional Winners

2012 2012 Alamo Regional Engineering Excellence Award sponsored by Delphi

2012 2012 FIRST Championship Championship Division Winners - Newton

2012 2012 Lone Star Regional Engineering Excellence Award sponsored by Delphi

Regional Winners

2012 2012 Northeast Utilities FIRST Connecticut Regional

2013 2013 Bayou Regional Engineering Excellence Award sponsored by Delphi

Regional Winners


2013 2013 Lone Star Regional Engineering Inspiration Award

Regional Winners

2013 2013 Silicon Valley Regional Regional Winners

Data Provided by Robotics Facilitator

The table above is a partial listing of the competitions the FRC Robotics teams, CCISD Robonauts, have participated in since the 2008-2009 school year. The Robotics team has accumulated many honors and awards during these competitions.

Since the 2008-2009 school year, the Robotics team has participated in the Regional as well as the FIRST Championship competitions every year through the 2012-2013 school year. They were Regional Finalists in 2008 and 2009 and Regional Winners in 2010, 2011, 2012, and 2013. In 2012, the Robonauts were the Newton Division Championship Winners.

Booster Club

The Booster Club has been a huge contributing factor to the success of the Robonauts. It began in 2008-2009 to assist with funding for the Robonauts. They raise funds for the team and provide additional resources and supplies. They have provided multiple scholarships throughout the years for students with a financial need to cover the cost of program fees. They also provide food and snacks for students and mentors during the FRC season. They raise additional funds by running the concession stand during the FLL competitions.


Page | 13


Intermediate students have the opportunity to enroll in three courses which connect to Science, Technology, Engineering, and Mathematics (STEM) courses in high school, college, and a career path, including: Robotics, Gateway to Engineering, and Design Technology. Robotics is a one semester course where students build and program a robot to be used during a district competition. Gateway to Engineering applies scientific principles and concepts of simple machines and energy to solve real-world problems. Design Technology provides students with a better understanding of the mechanics of physics concepts and simple machines through actual construction and testing of models.

High school students have the opportunity to enroll in a variety of Science, Technology, Engineering, and Mathematics courses. In the area of Technology and Engineering, students can enroll and receive state credit upon successful completion in courses such as: Introduction to Engineering Design, Principles of Engineering, Digital Electronics, Architecture and Engineering, Aerospace Engineering, Engineering Design and Problem Solving, Engineering Design and Development, Forensic Science, Biotechnology, Advanced Biotechnology, and Practicum in Biotechnology (2 credits). AP Computer Science I and II are part of the Information Technology sequence of courses.

In the area of advanced Mathematics courses, students can enroll and receive state credit upon successful completion in courses such as: AP Calculus AB and BC, AP Statistics, and Independent Study.

In the area of advanced Science courses, students can enroll and receive state credit upon successful completion in courses such as: AP Biology, AP Chemistry, AP Physics, AP Physics B, AP Physics C, Earth and Space Science, Advanced Biotechnology, and Independent Study: Scientific Research and Design.

2008-2009 Cohort

Course CCHS CLHS CBHS CSHS CHECHS CFHS Total

Introduction to Engineering Design1 4 5 1 9

Principles to Engineering2 2 2 4

Engineering Design Development3 6 1 1 8

Digital Electronics 3 5 3 1 9

Aerospace Engineering3 4 1 5

Forensic Science 3 1 1

Independent Study Problem Solving 3 1 1

AP Calculus AB 3 8 7 2 2 19

AP Calculus BC 4 5 5

AP Statistics 3 2 7 1 10

AP Computer Science AB 3 2 1 2 5

Independent Study Computer Science 3 1 3 4

AP Biology 3 1 1 2

1 Course for students in grades 9-12 2 Course for students in grades 10-12 3 Course for students in grades 11-12 4 Course for students in grade 12


Page | 14


2009-2010 Cohort


Introduction to Engineering Design 1 2 3 1 2 4 12

Principles to Engineering2 3 1 1 4 9

Engineering Design Development3 1 1 5 6 13

Aerospace Engineering3 1 1 1 3

Architecture & Engineering3 4 4

Civil Engineering 3 2 1 1 4

Forensic Science 3 2 2

Digital Electronics 3 1 1 2

AP Calculus AB 3 6 1 2 4 13

AP Calculus BC 4 3 2 5

AP Statistics 3 4 1 5

SJC Math 2413 Calculus 1 5 5

Independent Study Computer Science3 3 1 1 5

AP Biology 3 1 1 2

AP Chemistry 3 2 1 3

Astronomy 3 1 1

AP Physics B 3 1 4 2 7

AP Physics C 3 4 1 3 8

SJC Physics 1402 1 1 2


Page | 15


2010-2011 Cohort

Course SIS VLIS WIS BAYIS Total

Gateway to Engineering 2 2

Design Technology 2 2

Robotics 1 1

Course CCHS CLHS CBHS CSHS CHECHS CFHS WIS Total

Introduction to Engineering Design1 8 5 5 1 5 24

Principles to Engineering2 2 3 2 1 7 15

Engineering Design Development3 3 2 6 9 20

Aerospace Engineering3 3 2 1 6

Architecture & Engineering3 2 4 6


Biotechnology 1 1

Micro Computer Application Specialist I 2 2

AP Calculus AB 3 1 7 3 3 1 15


AP Statistics 3 2 1 3

Independent Study Mathematics 3 1 1

Independent Study Computer Science3 1 1 2

AP Biology 3 1 1 2

AP Chemistry 3 2 1 1 4

AP Physics B 3 2 3 1 2 8

AP Physics C 3 2 1 3

ISM AA 3 9 12

SJC Math 1314 College Algebra 1 1




SJC Biology 1406 General Biology 1 2 2


SJC Biology 2421 Microbiology 1 1

SJC Chemistry 1412 General Chemistry 2

2 2

SJC Physics 2425 University Physics 1

1 1


Page | 16


2011-2012 Cohort

Course SIS VLIS BAYIS TOTAL



Robotics 1 1

Course CCHS CLHS CBHS CSHS CHECHS CFHS TOTAL

Introduction to Engineering Design1 3 9 5 4 21

Principles to Engineering2 8 6 7 21

Engineering Design Development3 1 2 2 10 20 35

Engineering Design & Problem Solving3 1 1

Digital Electronics 3 1 1 2 3 7 14

Forensic Science 3 2 2 4


Architecture & Engineering3 1 5 8 14

Architecture Design3 1 1

Biotechnology Engineering 4 4

Biotechnology 1 1

Advanced Biotechnology 2 2



AP Statistics 3 3 2 3 1 9


Independent Study Computer Science 3 3 3 6

AP Biology 3 3 3 2 2 10

AP Chemistry 3 3 1 3 2 9

AP Physics B 3 1 3 2 1 5 12

AP Physics C 3 3 4 3 1 11

Independent Study Science Research Design 1 1

SJC Biology 2420 MB 1 1




SJC Chemistry 1411 General Chemistry 1 2 2

SJC Chemistry 1412 General Chemistry 2 6 6



Page | 17


2011-2012 Cohort Continued

Course CCHS CLHS CBHS CSHS CHECHS CFHS TOTAL

SJC Math 1342 Statistics 1 1




SJC Physics 1402 4 4

SJC Physics 1402 College Physics 2 2 2

SJC Physics 2425 University Physics 1 2 2



Page | 18


2012-2013 Cohort

Course SIS VLIS BAYIS Total



Robotics 1 1


Introduction to Engineering Design1 3 7 1 3 14

Principles to Engineering 2 8 4 1 13

Engineering Design Development3 2 10 20 32


Architecture & Engineering3 1 8 9




AP Statistics 3 2 2 2 1 7

Independent Study Computer Science 3

1 3 4


AP Biology 3 3 2 2 2 9

AP Chemistry 3 1 1 3 2 7

AP Physics B 3 3 1 1 5 10

AP Physics C 3 1 4 3 1 9




SJC Chemistry 1411 General Chemistry 1

1 1


SJC MATH 2412 Precalculus 4 4




SJC Physics 1402 1 1

SJC Physics 1402 College Physics 2 1 1




Page | 19


GPA

Student Grade Point Averages (GPA) remain in the student information system based on the current year or the last year a student was enrolled in CCISD, usually their senior year. The following table represents the GPA for each cohort based on the last year the student was enrolled in CCISD.

Year Total in Cohort N Scale Mean GPA

2008-2009 50 13 4.5 4.15

17 6.0 4.89

2009-2010 49 15 4.5 4.05

34 6.0 4.44

2010-2011 34 34 6.0 4.42

2011-2012 90 90 6.0 4.24

2012-2013 108 108 6.0 4.46

Typically, students who participated in the Robotics program in grades 9-12 had high Grade Point Averages. On a 4.5 scale, the GPAs ranged from 4.05 to 4.15. On a 6.0 scale, they ranged from 4.24 to 4.89.

Post-Secondary

There were 50 students who participated in the Robotics program in 2008-09 in grades 9-12. Of the 50, 46 have entered into a college, university, or technical school as listed by The National Clearinghouse. Ten of the 46 college bound students have received a degree as of June 2013. There were 40 students in grades 10-12 who participated in the Robotics program in 2009-10, and 35 have entered into a college, university, or technical school. There were 20 students in grades 11-12 who participated in the Robotics program in 2010-11, and 19 have entered into a college, university, or technical school. Of the 17 students in grade 12 who participated in the Robotics program in 2011-12, all 17 have entered into a college, university, or technical school after graduation.


Page | 20

4. What is the level of student/parent satisfaction with the Robotic program?

Robotics Student Survey (N=38)

9 10 11 12 Already

Graduated

1. Current grade level 10.5% 15.8% 13.2% 26.3% 34.2%

CCHS CLHS CBHS CSHS CHECHS CFHS

2. Campus

10.5% 7.9% 21.1% 26.3% 13.2% 13.2%

Already Graduated

7.9%

No Yes

3. I am currently in Robotics.

39.5% 60.5%

FLL BEST VEX FRC Robo Camp

4.

I am currently in or have been in the following Robotics levels: (check all that apply)

34.2% 39.5% 50.0% 94.7% 13.2%

0-30 31-40 41-50 51-60 More Than

60

5.

I have participated in ____ hours this year with respect to the Robotics program.

42.1% 2.6% 2.6% 0.0% 52.6%

Strongly Disagree

(1) Disagree

(2) Neutral

(3) Agree

(4)

Strongly Agree

(5)

Mean Score

6. The Robotics program meets my individual learning needs.

0.0% 0.0% 2.6% 23.7% 73.7% 4.71

7.

I can approach the Robotics program coaches about any academic concern(s) I may have.

2.6% 0.0% 15.8% 34.2% 47.4% 4.26

8. I feel actively engaged in learning.

0.0% 0.0% 5.3% 13.2% 81.6% 4.76

9.

I feel that the best coaches are participating in the Robotics program.

0.0% 0.0% 10.5% 21.1% 68.4% 4.58

10.

The Robotics coaches are aware of my strengths and weaknesses.

0.0% 0.0% 18.4% 55.3% 26.3% 4.08


Page | 21



Strongly Disagree

(1) Disagree

(2) Neutral

(3) Agree

(4)

Strongly Agree

(5)

Mean Score

11. The Robotics program coaches' expectations are clear.

0.0% 0.0% 10.5% 26.3% 63.2% 4.53

12.

I have access to the resources and materials I need in order to be successful with my learning.

0.0% 0.0% 7.9% 28.9% 63.2% 4.55

13.

My experience in the Robotics program has contributed to my growth in developing future college and/or career goals.

0.0% 0.0% 5.3% 21.1% 73.7% 4.68

14. The schedule meets my needs.

0.0% 7.9% 28.9% 39.5% 23.7% 3.79

15. I am satisfied with my experience in the Robotics program.

0.0% 0.0% 2.6% 28.9% 68.4% 4.66

16. I would recommend the Robotics program to other students.

0.0% 0.0% 0.0% 13.2% 86.8% 4.87

17.

My grades have improved since being in the Robotics program.

0.0% 13.2% 44.7% 26.3% 15.8% 3.45

18.

My attendance has improved since being in the Robotics program.

0.0% 2.6% 55.3% 21.1% 21.1% 3.61

19.

Because I have participated in Robotics, I want to take Science, Technology, Engineering, and Math courses in intermediate, high school, and/or college.

0.0% 0.0% 10.5% 21.1% 68.4% 4.58


Page | 22



Use the following statement for the following questions: The Robotics program has helped me improve...

Strongly Disagree

(1) Disagree

(2) Neutral

(3) Agree

(4)

Strongly Agree

(5)

Mean Score

20. Study Skills 0.0% 13.2% 28.9% 44.7% 13.2% 3.58

21. Time management skills

0.0% 0.0% 5.3% 39.5% 55.3% 4.50

22. Collaboration 0.0% 0.0% 31.6% 68.4% 4.68

23. Research skills 0.0% 7.9% 26.3% 44.7% 21.1% 3.79

24. Initiative/Self-direction

0.0% 2.6% 7.9% 34.2% 55.3% 4.42

25. Organizational skills 0.0% 0.0% 28.9% 39.5% 31.6% 4.03

26. Problem solving skills 0.0% 0.0% 2.6% 18.4% 78.9% 4.76

27. Responsibility 0.0% 0.0% 7.9% 34.2% 57.9% 4.50

28. Leadership skills 0.0% 0.0% 10.5% 44.7% 44.7% 4.34

Average Mean Score 4.34

The survey uses the Likert scale of 1 to 5, with 1 being “Strongly Disagree” and 5 being “Strongly Agree.” Overall, students are very pleased with the Robotics program. The six most common themes in the student comment section consisted of the following (in order of the number of occurrences).

Students had been involved in a robotics program at an early age, enjoyed the experience, and wanted to continue that experience.

Students were influenced by another person (teacher, friend, parent, and/or sibling) to join.

Students enjoyed the experience of working with NASA engineers and the coaches.

Students enjoyed the aspect of making new friends and being part of a team.

Students felt there was a huge time commitment and the scheduling needed improvement.

Students responded overwhelmingly that Robotics helped them develop better time management skills.


Page | 23


Robotics Parent Survey (N=64)

3 4 5 6

1. Current grade level

6.3% 17.2% 21.9% 15.6%

7 8 9 10

3.1% 3.1% 6.3% 4.7%

11 12 Already Graduated

6.3% 10.9% 4.7%

White LCE McWhirter ABE Ward Brkwd

2. Campus

6.3% 1.6% 1.6% 6.3% 4.7% 9.4%

Hyde FPE Robinson Gilmore SIS LCIS

1.6% 6.3% 1.6% 9.4% 4.7% 1.6%

CIS VLIS WIS CCHS CLHS CBHS

1.6% 3.1% 6.3% 4.7% 1.6% 1.6%

CSHS CHECHS CFHS Already

Graduated

10.9% 3.1% 6.3% 4.7%

No Yes

3. My student is currently in Robotics.

46.9% 53.1%

FLL BEST VEX FRC Robo Camp

4.

My student is currently in or has been in the following Robotics levels: (check all that apply)

43.8% 14.1% 28.1% 29.7% 50.0%

0-30 31-40 41-50 51-60 More Than

60

5.

My student has participated in ____ hours this year with respect to the Robotics program.

43.8% 9.4% 4.7% 0.0% 42.2%

Strongly Disagree

(1) Disagree

(2) Neutral

(3) Agree

(4)

Strongly Agree

(5)

Mean Score

6.

The Robotics program meets my student’s individual learning needs.

1.6% 7.8% 12.5% 26.6% 51.6% 4.19

7.

My student can approach the Robotics program coaches about any academic concern(s) I may have.

4.7% 7.8% 12.5% 26.6% 48.4% 4.06


Page | 24



Strongly Disagree

(1) Disagree

(2) Neutral

(3) Agree

(4)

Strongly Agree

(5)

Mean Score

8. I feel my student is actively engaged in learning.

0.0% 1.6% 7.8% 32.8% 57.8% 4.47

9.

I feel that the best coaches are participating in the Robotics program.

1.6% 4.7% 23.4% 18.8% 51.6% 4.14

10.

The Robotics coaches are aware of my student’s strengths and weaknesses.

4.7% 6.3% 32.8% 20.3% 35.9% 3.77

11. The Robotics program coaches' expectations are clear.

1.6% 4.7% 14.1% 37.5% 42.2% 4.14

12.

My student has access to the resources and materials they need in order to be successful with their learning.

0.0% 3.1% 14.1% 40.6% 42.2% 4.22

13.

My student’s experience in the Robotics program has contributed to my student’s growth in developing future college and/or career goals.

1.6% 6.3% 10.9% 23.4% 57.8% 4.30

14. The schedule meets my student’s needs.

1.6% 7.8% 18.8% 31.3% 40.6% 4.02

15.

I am satisfied with my student’s experience in the Robotics program.

3.1% 6.3% 7.8% 31.3% 51.6% 4.22

16. I would recommend the Robotics program to other parents.

1.6% 4.7% 7.8% 20.3% 65.6% 4.44

17.

My student’s grades have improved since being in the Robotics program.

3.1% 12.5% 53.1% 18.8% 12.5% 3.25


Page | 25



Strongly Disagree

(1) Disagree

(2) Neutral

(3) Agree

(4)

Strongly Agree

(5)

Mean Score

18.

My student’s attendance has improved since being in the Robotics program.

3.1% 7.8% 75.0% 6.3% 7.8% 3.08

19.

Because my student has participated in Robotics, he/she wants to take Science, Technology, Engineering, and Math courses in intermediate, high school, and/or college.

0.0% 4.7% 23.4% 28.1% 43.8% 4.11

Use the following statement for the following questions: The Robotics program has helped my student improve...

Strongly Disagree

(1) Disagree

(2) Neutral

(3) Agree

(4)

Strongly Agree

(5)

Mean Score

20. Study Skills 1.6% 12.5% 43.8% 21.9% 20.3% 3.47

21. Time management skills 1.6% 9.4% 25.0% 35.9% 28.1% 3.80

22. Collaboration 1.6% 3.1% 10.9% 37.5% 46.9% 4.25

23. Research skills 1.6% 6.3% 21.9% 35.9% 34.4% 3.95

24. Initiative/Self-direction 0.0% 7.8% 9.4% 40.6% 42.2% 4.17

25. Organizational skills 3.1% 7.8% 21.9% 37.5% 29.7% 3.83

26. Problem solving skills 0.0% 4.7% 12.5% 31.3% 51.6% 4.30

27. Responsibility 1.6% 7.8% 17.2% 31.3% 42.2% 4.05

28. Leadership skills 1.6% 7.8% 17.2% 34.4% 39.1% 4.02

Average Mean Score 4.01

The survey uses the Likert scale of 1 to 5, with 1 being “Strongly Disagree” and 5 being “Strongly Agree.” Overall, parents are very pleased with the experience their student had with the Robotics program. The five most common themes in the parent comment section consisted of the following (in order of the number of occurrences).

Parents liked that their students had fun, and it was a great experience building robots.

Parents liked that their students worked with engineers from NASA and/or had good mentors for the program.

Most parents felt there should be an increase in the opportunities for students to participate in the program.

The parents of Robonauts felt like it was a big time commitment.

Parents felt their students had improved with time management, organizational skills, and overall self-confidence.


Page | 26


Robotics Receipts and Expenditures

Year N* District Funds

Expenditures

Average Per

Student

Grant Funds Expenditures

Activity Account

Expenditures

Activity Account Receipts

Total Expenses

Total Average

Per Student

2008-2009

262 ($101,487) ($387) ($45,590) ($5,202) $12,477 $139,802 ($534)

2009-2010

351 ($112,430) ($320) ($30,895) ($23,604) $42,533 $124,396 ($354)

2010-2011

340 ($106,854) ($314) ($37,457) ($23,349) $35,603 $132,057 ($388)

2011-2012

404 ($100,052) ($248) ($65,445) ($48,632) $28,232 $185,897 ($460)

2012-2013

508 ($111,549) ($220) ($67,083) ($87,706) $71,807 $194,531 ($383)

Totals 1865 ($532,371) ($285) ($246,470) ($188,493) $190,652 $776,683 ($416) Financial data provided by CCISD Finance Department *Number of students provided by Robotics facilitator

Robotics Activity Account Receipts and Expenditures

Beginning Balance Activity Account

Receipts Activity Account

Expenditures Ending Balance

2008-2009 $0 $12,477 ($5,202) $7,275

2009-2010 $7,275 $42,533 ($23,604) $26,203

2010-2011 $26,203 $35,603 ($22,993) $38,457

2011-2012 $38,457 $28,232 ($48,989) $18,057

2012-2013 $18,057 $71,807 ($87,706) $2,158

Total $190,652 ($188,493) $2,158 Financial data provided by CCISD Finance Department

The average annual cost to Clear Creek ISD for the Robotics program is approximately $285 per student. With the additional assistance of grants, donations, and other activity account funds, the total expenses over a five year period for the Robotics program is $776,683 with an average annual cost per student of $416.

Grants exclusively from NASA have totaled $246,470 over the last five years. In 2010-2011, NASA provided a grant for the supplies and staff to run Robo Camp.

Receipts for the Robotics Activity account are from donations and Robo Camp fees. There has been a positive balance each year from 2008-2009 through 2012-2013 with a beginning balance for the 2013-2014 school year of $2,158.

Each campus is provided an annual stipend for their coach(es). If a campus has multiple coaches, they divide the stipend. Elementary campus coaches are paid $150, intermediate campus coaches are paid $350, and high school campus coaches are paid a stipend of $1500 per year.


Page | 27

Summary of Findings

Below is a summary of findings for each of the program evaluation questions:

1. What opportunities are available for students to join a Robotics program? Students have many opportunities to participate in Robotics. Robo Camp is for students in grades 2-8; First Lego League for elementary students in grades 4 and 5; BEST and VEX is for intermediate and high school students, grades 6-12; FRC is for high school students in grades 9-12.

2. What are the successes of the Robotic program? Since the 2008-2009 school year, the Robotics team has participated in the Regional as well as the FIRST Championship competitions every year through the 2012-2013 school year. They were Regional Finalists in 2008 and 2009. They were Regional Winners in 2010, 2011, 2012, and 2013. In 2012, they were the Champion Division Winners.

3. What are the academic achievements of students who have participated in Robotics? Students have taken advanced academic courses in intermediate and high school. Students have maintained high GPAs. Many students have continued with post-secondary education opportunities.


In general, parents and students are pleased with the Robotics program. The average Likert scores for questions 6-28 ranged from 3.08-4.47 for the parent survey with the overall Likert score of 4.01; the average Likert scores for questions 6-28 ranged from 3.45-4.87 for the student survey with the overall Likert score of 4.34.


The average annual cost to Clear Creek ISD for the Robotics program is approximately $285 per student. With the additional assistance of grants, donations, and other funds, the total expenses over a five year period for the Robotics program is $776,683 with an average annual cost per student of $416.


Page | 28

Superintendent’s Recommendations

1. We will have an electronic system in place to track participants in the Robotics program by August 2014.

2. We will develop and implement a plan to achieve gender balance in the Robotics program by August 2015.

3. We will develop a comprehensive curriculum for the district-wide Robotics program, located at Clear Brook HS, by August 2015.

Robotics Program Evaluation - Home - Clear Creek...Robotics Evaluation 2008-09 to 2012-13 Page | 4...

Documents

Transcript of Robotics Program Evaluation - Home - Clear Creek...Robotics Evaluation 2008-09 to 2012-13 Page | 4...