4 1 2016 - IJEMSTijemst.com/pdfgoster.php?file=depo/pdfs/pdf_4_2016_1.pdf · The IJEMST are indexed...

74
International Journal of Education in Mathematics, Science and Technology Volume 4, Number 1, 2016 ISSN: 2147-611X 4 1 2016 2147-611X

Transcript of 4 1 2016 - IJEMSTijemst.com/pdfgoster.php?file=depo/pdfs/pdf_4_2016_1.pdf · The IJEMST are indexed...

  • International Journal of Education in Mathematics, Science and Technology

    Volume 4, Number 1, 2016 ISSN: 2147-611X

    4

    1

    2016

    2147-611X

  • International Journal of Education in Mathematics, Science and Technology

    Volume 4, Number 1, 2016 ISSN: 2147-611X

    EDITORIAL BOARD

    Editors Mack SHELLEY - Iowa State University, U.S.A. Ismail SAHIN - Necmettin Erbakan University, Turkey

    Section Editors Arthur POWELL - Rutgers University, U.S.A.

    Utkun AYDIN - MEF University, Turkey

    Chun-Yen CHANG - National Taiwan Normal University, Taiwan

    I. Ozgur ZEMBAT - Mevlana University, Turkey

    Jacqueline T. MCDONNOUGH - Virginia Commonwealth University, U.S.A.

    Meric OZGELDI - Mersin University, Turkey

    Lina TANKELEVICIENE - Siauliai University, Lithuania

    Niyazi ERDOGAN - Balikesir University, Turkey

    Sandra ABEGGLEN - London Metropolitan University, U.K.

    Guest Editors Sencer CORLU - Bilkent University, Turkey Niyazi ERDOGAN - Balikesir University, Turkey

    Editorial Board Ann D. THOMPSON - Iowa State University, U.S.A

    Bill COBERN - Western Michigan University, U.S.A.

    Douglas B. CLARK - Vanderbilt University, U.S.A.

    Gokhan OZDEMIR - Nigde University, Turkey

    Hakan AKCAY - Yildiz Technical University, Turkey

    Huseh-Hua CHUANG - National Sun Yat-sen University, Taiwan

    Igor M. VERNER - Technion - Israel Institute of Technology, Israel

    Ilhan VARANK - Yildiz Technical University, Turkey

    James M. LAFFEY - University of Missouri, U.S.A.

    Kamisah OSMAN - National University of Malaysia, Malaysia

    Lynne SCHRUM - George Mason University, U.S.A.

    Mary B. NAKHLEH - Purdue University, U.S.A.

    Musa DIKMENLI - Necmettin Erbakan University, Turkey

    Muteb ALQAHTANI - Rutgers University, U.S.A.

    Ok-Kyeong KIM - Western Michigan University, U.S.A.

    Pasha ANTONENKO - Oklahoma State University, U.S.A.

    Paul ERNEST - University of Exeter, UK

    Pornrat WATTANAKASIWICH - Chiang Mai University, Thailand

    Robert E. YAGER - University of Iowa, U.S.A.

    Sanjay SHARMA - Roorkee E&M Technology Institute, India

    Sinan ERTEN - Hacettepe University, Turkey

    Tsung-Hau JEN - National Taiwan Normal University, Taiwan

    William F. MCCOMAS - University of Arkansas, U.S.A.

    Yilmaz SAGLAM - Gaziantep University, Turkey

    Technical Support Selahattin ALAN - Seluk University, Turkey Ismail CELIK Necmettin Erbakan University, Turkey

    International Journal of Education in Mathematics, Science and Technology (IJEMST) The International Journal of Education in Mathematics, Science and Technology (IJEMST) is a peer-reviewed scholarly online journal. The IJEMST is

    published quarterly in January, April, July and October. The IJEMST welcomes any papers on math education, science education and educational technology

    using techniques from and applications in any technical knowledge domain: original theoretical works, literature reviews, research reports, social issues,

    psychological issues, curricula, learning environments, research in an educational context, book reviews, and review articles. The articles should be original,

    unpublished, and not in consideration for publication elsewhere at the time of submission to the IJEMST. Access to the Journal articles is free to individuals,

    libraries and institutions through IJEMSTs website.

    Abstracting/ Indexing The IJEMST are indexed by the following abstracting and indexing services: Ulrich Index, ASOS Index, Journal Seek, JournalRate, Directory of Research

    Journals Indexing (DRJI), Infobase Index, ResearchBib, Index Copernicus, TUBITAK ULAKBIM Dergipark, ERIH, Scientific Indexing Service (SIS), and

    Education Resources Information Center (ERIC).

    Submissions All submissions should be in electronic (.Doc or .Docx) format. Submissions in PDF and other non-editable formats are not acceptable. Manuscripts can be

    submitted through the journal website. All manuscripts should use the latest APA style. The manuscript template for formatting is available on the journal

    website.

    Contact Info International Journal of Education in Mathematics, Science and Technology (IJEMST)

    Email: [email protected]

    Web: http://www.ijemst.com

  • International Journal of Education in Mathematics, Science and Technology

    Volume 4, Number 1, 2016 ISSN: 2147-611X

    TABLE OF CONTENTS

    Through Biodiversity and Multiplicative Principles Turkish Students Transform the Culture of

    STEM Education

    Robert M. Capraro, Mary Margaret Capraro, Luciana R. Barroso, James R. Morgan

    1

    Moving STEM Beyond Schools: Students Perceptions about an Out-of-School STEM

    Education Program

    Evrim Baran, Sedef Canbazoglu Bilici, Canan Mesutoglu, Ceren Ocak

    9

    Evaluation of Learning Gains through Integrated STEM Projects

    Mehmet Ali Corlu, Emin Aydin

    20

    Lessons Learned: Authenticity, Interdisciplinarity, and Mentoring for STEM Learning

    Environments

    Mehmet C. Ayar , Bugrahan Yalvac

    30

    Mathematical Modeling: A Bridge to STEM Education

    Mahmut Kertil , Cem Gurel

    44

    STEM Images Revealing STEM Conceptions of Pre-Service Chemistry and Mathematics

    Teachers

    Sevil Akaygun, Fatma Aslan-Tutak

    56

  • International Journal of Education in Mathematics, Science and Technology

    Volume 4, Number 1, 2016 DOI:10.18404/ijemst.26478

    Through Biodiversity and Multiplicative Principles Turkish Students

    Transform the Culture of STEM Education

    Robert M. Capraro, Mary Margaret Capraro, Luciana R. Barroso, James R. Morgan

    Article Info Abstract Article History

    Received:

    27 July 2015

    In this article the principle investigators of the various projects that comprise

    Aggie STEM at Texas A&M University discuss the impact and cross pollination

    of having graduate students from Turkey working and conducting their research

    as part of the multi-college Aggie STEM project. Turkish students have been

    engaged in instrumental roles since the inception of Aggie STEM and its growth

    as a tightly intertwined multi-national and ubiquitous STEM entity. The

    influence of Turkish students has spanned the entire gamut, from app

    development, which preceded the trend at the beginning of the new millennium,

    to innovative curricula and pedagogies that became enculturated into everyday

    life. Perhaps the greatest contribution offered by the scholars is that, as students,

    they engaged broadly in research, published prolifically and continue in these

    activities as they assumed the mantle of leadership as tenure track professors,

    administrators, policy makers, and program officers in the U.S. and throughout

    the world.

    Accepted:

    11 October 2015

    Keywords

    STEM education

    STEM education culture

    Biodiversity

    Multiplicative principles

    Introduction

    Myriad challenges lurk for the four disciplines of mathematics, science, technology, and engineering. Some

    may argue that only one is really a discipline and the others combine and reorganize information from one to

    form the other disciplines, where varying other skills become more or less emphasized depending on which

    other subject one is interested in. For example, science can be viewed as the messier and more natural

    exemplification of the precise mathematical world. Science would then be described as making observations of

    messy real world events in the attempt to quantify, generalize, and eventually assign a mathematical model that

    accurately describes observations. The reality is that each field builds on, relies on, and inter-reacts with the

    others more or less given some set of conditions, expectations, and potential outcomes.

    There are many challenges facing Science, Technology, Engineering, and Mathematics (STEM) education and

    its successful implementation, none of which is greater than the ill-informed and self-proclaimed STEM

    educator or STEM education specialist. When the National Science Foundation transformed the arrangement of

    the starting letters for mathematics, engineering, technology, and science into the ubiquitous STEM, it created a

    void. What we know from science is that nature abhors a void. While the void concept works, consider

    evolution and the work of Darwin species voids are filled, unfortunately not always as elegantly as the now

    extinct specie that vacated it. Perhaps the more prominent void filler was Homo Sapiens. Many species have

    gone extinct since our arrival on the scene with about seven new extinctions every 24 hours (Vidal, 2011).

    We rushed into the ecological landscape and quickly put our thumbprint on all other species and ecosystems on

    the planet and since then humans have become quite comfortable rushing into voids even when that help is often

    misguided and premature. That void created by the new term STEM became the destination into which many

    sprinted. Some transferred from business, some from law, and some from various education disciplines. The

    influx of non-subject matter specialists was potentially damaging to the STEM education mission. There were

    no credentials required to proclaim ones expertise in STEM other than to add four simple letters arranged into a

    now meaningful and pronounceable acronym, STEM, to ones business card.

  • 2

    Capraro, Capraro, Barroso & Morgan

    Multiplying Success

    The idea of filling voids with STEM generalists is as repugnant as the potential loss of the Humpback whale, the

    platypus, or the mudskipper. The response to filling voids with STEM generalists is to train diverse people in

    ways that allow them to be aware of, responsible to, and tolerant of curricular diversity where groups of

    individuals work collaboratively to address STEM needs. Each person pursuing a STEM degree beyond the

    baccalaureate does so with the hope of deepening and enriching his or her knowledge of that subject. If that

    person persists in higher education, eventually she or he becomes an expert in that particular STEM discipline

    and earns a terminal degree (i.e, Phd or EdD). It is that terminal degree that signifies that expertise.

    How do the ideas of disciplines and voids account for changes in the educational landscape that are influenced

    by STEM? The answer can be as convoluted as the problem. First, does the problem really exist? Is there

    really a thing called STEM education? If there is such a thing as STEM, how can it be described so that

    everyone who sees it knows that it is STEM? How is STEM different from what has always been done?

    Finally, what are the anticipated outcomes of STEM done well? While the answer is trite train diverse

    people in ways that allow them to be aware of, responsible to, and tolerant of curricular diversity where groups

    of individuals work collaboratively to address STEM needs it is not simplistic in implementation. It requires

    new and expanding collaboration, diversity, and dedication to change, or we are constrained to doing what has

    always been done and reaping the same outcomes we have seen historically.

    Collaboration

    Using the ideas from broad contexts explored through multiple lenses can provide insights to problems that

    would otherwise go unexplored or seemingly unanswered. What we learn from the multiplicative identity

    property is that the number of problems multiplied by one person exploring the problem results in the exact

    same number of problems. But the nature of STEM work is that we need to be able to explore more problems

    effectively, so we need to think about another property of multiplication that can afford greater success. The

    commutative property is one that can be made analogous to developing partnerships to solve problems, that is,

    multiple people working on multiple problems resulting in the same exact same number of solutions regardless

    of where we start, either with the number of problems or the number of people. The importance here is that

    while we have a fixed approach, the product or the solutions are greater than the identity condition given the

    same sample set. For example, from the identity property we had eight problems, and at the end we still had

    eight problems (8 1) because one person cannot really address them adequately. At best, we might actually

    find eight solutions. However, from the commutative property we started with eight problems and now have

    two people, so the potential solutions increase to 16.

    The Origin of Aggie STEM

    The collaborations began when Semsettin Beser, a very bright and talented young man from Ankara, arrived to

    contribute to the STEM transformation. His interests moved the entire mathematics education program into the

    idea of technology mediated instruction and assessment. He developed a very adaptable and secure testing and

    analysis system as part of his work towards his Masters of Science degree. The foundational impact of this

    work was that it lived well beyond his time at A&M. Six doctoral students and three masters students used that

    system after he graduated. But most importantly, the data gathered through that system gave rise to the first

    awarded grant that led to the inception of Aggie STEM. The multiplicative property gave way to the

    Associative property with another student a top student Tufan Adiguzel. He assured that we understood the

    power of handheld computing technology and its impact on mathematics learning. While he performed his

    work in Educational Psychology, his work was groundbreaking, showing that personal handheld devices were

    acceptable both to students and teachers for just in time data collection (Adiguzel, Capraro, & Willson, 2011).

    However, the versatility of his work was not fully understood until it was broadly applied across all STEM

    disciplines. The work of Aggie STEM branched out to include clicker technology, iPads, and Moodle as an

    online course delivery model. Aggie STEM now reaches more than 300 teachers per year across the United

    States thanks to his contributions and the acceptability of on-line learning.

    Another contributor, unique in many ways, in this era was Hamza Anderoglu. His major was counseling with a

    broad interest in psycho-social influences on learning. Through his interests, we explored the impact of Project-

    based learning on students attitudes and interests to learn STEM subjects. His influence in this area was not

    fully realized until nearly four years after his graduation, when Aggie STEM earned its first grant award to

  • 3

    Int J Educ Math Sci Technol

    explore and understand how students feelings about STEM PBL influenced their achievement and desire to

    pursue post secondary STEM education. His perspective on and concern for the individual provided a catalyst

    that moved the research team to explore new inquiry methods and the courage to explore the more affective side

    of STEM teaching and learning (e.g., Corlu, Capraro, & Capraro, 2014).

    Aggie STEM Reaches Critical Mass

    As Aggie STEM grew, its work attracted a student, Sencer Corlu, whose interests would prove transformational

    in a very translational way. The foresight of the Ottoman Empire to build a system that accelerated the sciences

    and mathematics through an interconnected and multidisciplinary approach showed that our STEM problem was

    deeply rooted in the human condition. The Ottoman Empire had designed schools of choice with different foci

    to achieve different purposes and to meet the needs of its ever-expanding society. The mechanical designs that

    originated from the Matrakc era in the Ottoman Empire were a precursor to engineering as a discipline and an

    early-integrated subject into science and mathematics. Sencer made the very important connection to these

    early foundations of STEM education that were laid circa 1299 (e.g., Corlu, Burlbaw, Capraro, Corlu, & Han,

    2010). His work, based on early translated works, also demonstrated how schools of choice gave rise to in-

    depth study and had the potential to achieve greater gains than those possible in comparable schools of that era.

    His groundwork established a foundation on which subsequent students have built what has become a

    productive line of inquiry, that is, examining how modern day charter schools, STEM schools, and other

    incarnations of schools of choice influence the educational landscape and pockets of phenomenal success.

    The nexus of science with the other subjects in STEM has been lacking, but the next transformational

    contribution came from an unlikely source. The science perspective was and remains orthogonal to some

    mathematical ideas. The conflict in these perspectives stems from using different sources of primary

    information about similar constructs, dependence on research methods that are distinct by discipline, and core

    differences in paradigm that permeate the subject to manifest as a unique culture. Niyazi Erdogan joined Aggie

    STEM on a trial basis to see how his research interests would intersect those of the group and to determine the

    potential for deep catalyzing change. The challenge would be not just accommodating his perspectives but

    integrating them into the core essence of what Aggie STEM would someday grow to be. His research built on

    the historical contributions of those who came before but grew into a multifaceted approach laden with policy

    implications related to the creation of schools of choice focused around the STEM concept (Erdogan, Corlu, &

    Capraro, 2013). The contribution opened the door to the finding that designated STEM schools, while

    implementing a specific program or guidelines, were not uniformly better than any other public school. This

    was not to say that STEM schools did not have bright spots, but they were univocal and tended to be most

    beneficial for traditionally underserved populations. Therefore, these schools of choice were not necessarily

    worth the added monetary investment it required to become a designated STEM school and with regard to

    science achievement were not hitting their mark.

    As Aggie STEM added foci and integrated content greater diversity new paradigms arose. As part of those

    paradigms new and innovative quantitative designs. This earlier work has grown in scope and perspective with

    iterations from Ayse Tugba Oner and Ali Bicer. Each expanded on the prior contributions of their predecessors

    to build a more comprehensive view of charter schools, STEM schools, and STEM charter schools relative to

    comparable groups (Bicer, Navruz, Capraro, & Capraro, 2014; Bicer, Navruz, Capraro, Capraro, Oner, &

    Boedeker, 2015; Navruz, Erdogan, Bicer, Capraro, & Capraro, 2014). The sociological aspects of their work

    provide contexts by which there is a deeper understanding of the characteristics of successful schools and for

    which student subgroups those schools best serve. Another unique aspect of their work is the marked change in

    the research paradigm toward more rigorous research designs that make use of large datasets and careful

    selection of comparison groups through propensity score matching (e.g., Capraro, Capraro, Morgan, Scheurich,

    Jones, Huggins, Corlu, & Younes, (2015, In Press; Oner, Navruz, Bicer, Peterson, Capraro, & Capraro, 2014).

    The legacy of the forward thinking research designs has brought new expertise to Aggie STEM and provides

    benchmarks for subsequent students to follow.

    Contributions to Aggie STEM are complex. Several others have contributed to Aggie STEMs gradual

    transformation. From work that examines mathematics in light of science achievement (e.g., Cetin, Corlu,

    Capraro, & Capraro 2015), to Bilgin Navruzs practical application of higher order factor analysis (Navruz,

    Capraro, Capraro, & Bicer, 2015 in press). Alpaslan Sahins work shed light on high school course taking and

    SAT scores effect on college major selection (Sahin, Erdogan, Morgan, Capraro, & Capraro, 2012) and chapter

    on inquiry in the STEM PBL book (Sahin, 2013).

  • 4

    Capraro, Capraro, Barroso & Morgan

    The idea of legacy lives on at Aggie STEM. Sencer Corlu provided a legacy that subsequent PhD students will

    benefit from. He was the first PhD student director and modernized the curriculum and deliver. That was refined

    and expanded by Rayya Younes and the Aggie STEM camp for secondary students became a popular event.

    Niyazi Erdogan expanded the legacy of STEM Camp to attract students from around the world to learn STEM

    content in authentic project based lessons. Under Niyazis leadership, the camp grew from a few students in

    2003 to over 100 spread across two camps; Ayse Tugba Oner expanded it to three camps and more than 170

    students exploring life as a future undergraduate while learning STEM content from university professors and

    graduate students. Their legacy in leadership, hard work and dedication provide employment to 15 other

    graduate and undergraduate students who work with the middle and high school students each year. This offers

    a lasting testament, that a group of focused individuals can come together to influence the lives of secondary

    students while providing organizational structure so future Aggie STEM graduate and undergraduate students,

    and faculty can apply their research in practical-applied settings.

    Visiting Scholars Add Cultural Capital

    Visiting scholars from some of the best Turkish universities have contributed to the development of Aggie

    STEM. Scholars like Drs. Ozcan Erkan, Nesrin Ozsoy, and doctoral students like Zeynep Gecu, and Sabhia

    Yeni represent perspectives from Sakarya University, Adnan Menderes University, and Middle East Technical

    University. Their contribution brought perspectives that added to the revised edition of Project-based learning:

    An integrated science, technology, engineering, and mathematics (STEM) approach, (Akgun, 2013)

    understanding of how elementary teachers are prepared in Turkey, and knowledge of using iPads to teach

    coding to preschool children. It is the ability of scholars who possess deep understandings of their content from

    various backgrounds and come together to build a program with longevity. The continued flow of ideas and

    opportunities provide a symbiotic environment for growth and idea expansion.

    Biodiversity

    Biodiversity, in a not so pure a science interpretation, is the greatest contribution of graduate students and

    visiting scholars. It is difficult to look at things from outside the box when one cannot physically get outside

    their own box without help. What is meant is that, with few exceptions, without those who challenge our ideas,

    we cannot even find the perimeter of our boxes. So in developing a chapter on Turkish education, two doctoral

    students provided insights into what is likely the most thorough and detailed treatise on the Turkish middle level

    education system (zel, Yetkiner, Capraro, & Kp, 2009), with all its achievements and challenges, published

    in English. It is in this document that we framed many underlying ideas that have guided Aggie STEM and its

    development into a comprehensive research entity.

    The biodiversity contributes to deep conversations among students from Africa, China, India, Italy, Japan,

    Lebanon, Mexico, Poland, South Korea, and United States. The magnification of regional diversity and

    resulting conversations can demonstrate how similar we are as a people. Problems faced in one region of the

    world are actually common across the world, and the solutions are applicable and plausible in multiple regions.

    We, as a one-world community, learn from and through the lens from which the solution was applied regardless

    of the region of the world from which it emanates.

    The biodiversity is a double-edged sword in that the U.S. obtains the best deal while Turkeys potential gains

    can turn into the same invisible entitlements that weigh so heavily on U.S. society. The U.S. receives an

    infusion of new ideas, hard work, and indelible marks on those who are touched by visitors. Turkish students,

    now colleagues and scholars in their own right and visiting scholars who return to their home countries, take

    western experiences that have the potential to enrich their society and build new and very powerful knowledge

    structures. The benefit to the home country is that it receives new knowledge, leaders with broad experiences

    and new ideas coupled with the U.S. sense of research excellence, and better access to and experience with

    research organizations and journals. However, with knowledge comes power, and power can be distributed

    unevenly and wielded along a continuum that can end with negative implications. The problem with exporting

    so many former PhD students, now STEM professional educators, back to Turkey is that they have the potential

    to develop into a tightly knit group that fosters a sense of over-reliance on who they have become and not on

    what they have to offer. The benefit of a U.S. STEM doctorate can be overshadowed by the same potential

    pitfalls that plague the U.S.

  • 5

    Int J Educ Math Sci Technol

    Equity, Entitlement, and Legacy

    The ideas of equity, entitlement, and legacy are paramount issues for STEM education researchers. Once one

    earns a PhD in mathematics education or any STEM related field, one is bestowed with the greatest of benefits

    and endowed with a mystique that can be greater than the sum of all the parts that helped forge that terminal

    education. Earning a degree in any STEM field receives the same level of prominence. However, this awesome

    power should not ever devolve into a program of systemic entitlement and legacy. It is the responsibility of the

    smallest person who might be blessed with great power and influence to use that power to confront entitlement

    and legacy, providing a consequence of equity that transcends socio-political structures, cultural and religious

    lines, and languages.

    Entitlement is one of those things that we cannot often recognize when we possess it. It does not come on a

    card you can put in your wallet or purse and is not a piece of jewelry you can wear, or an article of clothing that

    can be computer selected for you. However, we can be doggedly protective of it and not even know we have it.

    We can wield it with laser like precision or like a nuclear weapon and create broad and irreparable devastation.

    Entitlement structures come in many forms - they can be the color of our skin, the language we speak, our

    gender, our religion or sect within our religion, the university we graduated from, or our field of education.

    Perhaps the most damaging entitlement is entitlement based on invisible structures. Knowledge was intended to

    be the great equalizer that would transcend all superficial entitlement structures. However, we are still slaves to

    base instincts to differentiate, to seek out the miniscule uniqueness that exists within subgroups and then attach

    artificial distinctions on those that create a legacy that leads to privilege for one group and that leads to neglect,

    at best, and failure, at worst, for the other. The distinctions are either good or bad - to which one we subscribe

    depends on how we interpret the distinctions effect on our standing within a community. As more of the world

    seeks equity through education, discourse around traditional differences is lost. It is substituted for more

    insidious and vile forms of transparent entitlement and legacy. These can be so ingrained that those who may

    feel that they challenge the construction of these structures fail to recognize them or, even worse, provide the

    raw materials for their construction.

    Being a STEM educator or STEM professional comes with lucrative capital. This truly intoxicating

    concoction of recognition for what one knows and intimidation for what others do not is potentially a very

    dangerous condition. Therefore, one must surround oneself with others who are immune to this concoction to

    ensure measures are in place to keep those privileges in check. While Aggie STEM and countless other

    organizations within top U.S. universities have benefitted from exemplary Turkish students attending our

    universities, the merit of what they have been taught both intentionally and inadvertently has yet to be written.

    The quality of their mettle is indisputable; the forging of them into professionals who will assume the mantel of

    leadership as department heads, deans, provosts, and directors at Tbitak, Turkeys main science-funding

    agency analogous to the National Science Foundation in the U.S., and in prominent positions in the Ministry of

    Education is what has yet to be determined.

    Turkey struggles with important global issues, and its governmental organizations are not immune to the socio-

    political whims of the day. For example, Tbitak rejected a workshop grant on the grounds that evolution is a

    controversial subject. The workshop was to expose Turkish biology students to population genetics, game

    theory, and evolutionary modeling. It was reported in Science that the workshop would continue with private

    donors contributing the money (Bohannon, 2013, July 5). Will events like this be diminished as more U.S.

    trained PhDs assume leadership roles? How will research conducted in Turkey be reported and inform the

    world community? How will general research topics evolve as the PhDs influence and power increases? Rest

    assured the world is watching and judging the quality of the professionals forged at top U.S. institutions.

    Conclusion

    In STEM education the consumer must be careful, as in any environment ones behavior should be caveat

    emptor. However, differentiating among and between charlatans, snake oils salesmen, and empirically derived

    programs that yield positive results can be difficult at best. There are criteria by which to judge the merit of any

    intervention and paramount to that set is the depth of the research base that underlies it. Today, everyone claims

    his or her program is research proven. The first indication of frailties of any program is the claim of proof

    without qualifiers. No program is without qualifiers that the purveyors can clearly speak about for whom the

    program works and how long it takes to get results. One should know for whom any program works. The

    answer to this question should not be everyone. In the word everyone is hidden I do not know. For every

    program the consumer must know how limited language proficiency, gifted, at-risk, minority groups, and

  • 6

    Capraro, Capraro, Barroso & Morgan

    international students, as well as students in special education, perform when using it. No program is without

    costs, both monetary and personal. Some programs are exorbitantly priced while others are more modest.

    Personal costs are especially pricey. Personal costs are the costs of reaching pedagogical proficiency for

    teachers, learning for students, and understanding for parents. Commonly, a careful customer would ask how

    long does it take for teachers to learn to use a specific program, and the response that should raise concern is,

    teachers can take this program and run with it immediately. The truth in this statement is that the teachers are

    likely to run from the program. It is important for the customer to understand how long it takes for teachers to

    be trained to use a specific program, how the fidelity of implementation is being monitored, and how long will it

    take for it to raise student outcomes that matter. Research indicates that teachers need at least 90 hours of

    professional development to successfully implement any new program, no matter how teacher proof anyone

    claims the program to be. It takes time for students to respond and parents to understand that their child will

    have new or expanded expectations. Follow-up and careful guidance are needed to ensure that teachers are

    implementing the program as designed and not in combination with many other components cherry picked from

    across discarded programs.

    The reality is that the research base for most STEM programs is paper-thin at best, with mediocre sampling

    techniques. Often, reports of research are written based on convenience sampling, the lowest bar of research

    rigor (e.g., Shadish, Cook, & Campbell, 2002). The obtained results lack robustness, and effect size estimates

    are tenuous. It is more important to ask to see the research article that was published about the program and

    avoid making decisions based on glossy brochures, textbooks, manuals, or other sources that are not peer

    reviewed. The former Turkish students, now STEM content and pedagogical experts, are well-positioned to

    explore these issues, investigate claims, and to deepen our knowledge of what works, for whom, and under what

    circumstances.

    The students from Turkey enriched the educational experiences in the U.S. by their presence, and they continue

    to contribute to the program through a multifaceted and complex but sometimes highly nuanced way. What

    they contribute is the sharing of educational ideas and deep reflection on what happens in the U.S. K-12

    program. While our system is undergoing dramatic and sometimes detrimental change, Turkey is experiencing

    almost parallel situations. These student ambassadors reflect on their experiences, use knowledge of how their

    national education program is enacted, and draw parallels to trends and changes in the U.S. In the book Die

    Empty: Unleash Your Best Work Every Day, Todd Henry espouses a philosophy that the most valuable land in

    the world is the cemetery because it is where all the unrealized hopes, dreams, and good intentions are buried. It

    contains all the greatest dreams that were never enacted, the apologies never given, and the regrets never

    redressed. It is the repository of friendships lost and the greatest discoveries forgone that Turkish Scholars must

    avoid.

    At some time, all scholars come to the conclusion that they have come to a place in life where they understand

    their time on this planet is all too short and that what little effort they have left and whatever time they have - -

    MUST be spent in ways that allow them to DIE EMPTY. If you do not fully understand what is meant here,

    consider reading the book. The professoriate should gravitate toward more liberal ideas and more liberal

    interpretations. This group should play a role in abolishing practices, whether readily apparent or inadvertently

    hidden, that provide for entitlements and legacy. Not that the road is easy or that there is not a great deal of

    stress and distress. It can be very lonely. The core of this belief system is that STEM education in the U. S.

    produces highly qualified teachers and researchers who are ready to assume the mantel of leadership in schools

    and universities. Perhaps some still need mentorship, but professors should love their students and colleagues

    and believe they embody the best there is to offer. We are a community of informed people with skills and

    talents that cannot be matched by any single country regardless of nationally comparative or internationally

    administered tests that might indicate differently. We cannot succumb to political rhetoric that says our teachers

    are the problem or that universities are inadequate. Politics and politicians need controversy and sometimes we

    (educators and others) inadvertently provide the platform. We must remember that our particular STEM field

    has given us so very much. The entitlement of being a STEM educator is truly an intoxicating and potentially

    dangerous one, so it is important to put checks in place to measure ones own privileges to ensure one is staying

    in check and that one is serving the greater community, whether that community is across the street or around

    the world.

    References

    Adiguzel, T., Capraro, R. M., & Willson, V. L. (2011). An examination of teacher acceptance of handheld

    computers. International Journal of Special Education, 26(3), 12-27.

  • 7

    Int J Educ Math Sci Technol

    Akgun, O. E. (2013). Technology in STEM project-based learning. In R. M. Capraro, M. M. Capraro, & J.

    Morgan (Eds.) Project-based learning: An integrated science, technology, engineering, and mathematics

    (STEM) approach (2nd Ed., pp. 65-75). Rotterdam, The Netherlands: Sense.

    Bicer, A., Navruz, B., Capraro, R. M., & Capraro, M. M. (2014). STEM schools vs. non-STEM schools:

    Comparing students mathematics state based test performance. International Journal of Global

    Education, 3(3), 8-18.

    Bicer, A., Navruz, B., Capraro, R. M., Capraro, M. M., Oner, T.A., & Boedeker, P. (2015). STEM schools vs.

    non-STEM schools: Comparing students' mathematics growth rate on high-stakes test performance.

    International Journal of New Trends in Education and Their Implications, 6(1), 138-150.

    Bohannon, J. (2013, July 5). Turkish scientists see new evidence of government's anti-evolution bias. Science.

    Retrieved from http://news.sciencemag.org/2013/07/turkish-scientists-see-new-evidence-governments-

    anti-evolution-bias

    Capraro, R. M., Capraro, M. M., Morgan, J., Scheurich, J., Jones, M., Huggins, K., Corlu, S. M. & Younes, R.

    (2015, In Press). The impact of sustained professional development in STEM project based learning on

    district outcome measures. The Journal of Educational Research.

    Cetin, S. C., Corlu M. S., Capraro M. M., & Capraro R. M. (2015). A longitudinal study of the relationship

    between mathematics and science: The case of Texas. International Journal of Contemporary Educational

    Research, 2(1), 13-21.

    Corlu, M. S., Capraro, R. M., & Capraro, M. M. (2014). Introducing STEM education: Implications for

    educating our teachers in an age of innovation. Egitim ve Bilim-Education and Science, 39(171), 74-85.

    Corlu, M. S., Burlbaw, L. M., Capraro, R. M., Corlu, M. A., & Han, S. (2010). The Ottoman Palace School

    Enderun and the man with multiple talents, Matrak Nasuh. Journal of the Korea Society of

    Mathematical Education Series D: Research in Mathematical Education. 14(1), 19-31.

    Erdogan, N., Corlu, M.S., & Capraro, R.M. (2013). Defining innovation literacy: Do robotics programs help

    students develop innovation literacy skills? IOJES, 5(1), 1-9.

    Navruz, B., Erdogan, N., Bicer, A., Capraro, R. M., & Capraro, M. M. (2014). Would a STEM school by any

    other name smell as sweet? International Journal of Contemporary Educational Research, 1(2), 67-75.

    Navruz, B., Capraro, R. M., Capraro, M. M., & Bicer, A. (2015 in press). A review of higher-order factor

    analysis interpretation strategies. Journal of Measurement and Evaluation in Education and Psychology.

    Oner, A. T., Navruz, B., Bicer, A., Peterson, C. A., Capraro, R. M., & Capraro, M. M. (2014). T-STEM

    academies academic performance examination by education service centers: A longitudinal study.

    Turkish Journal of Education, 3(4), 40-51.

    zel, S., Yetkiner, Z. E., Capraro R. M., & Kp, A. R. (2009). Young adolescent education in Turkey. In S.

    B. Mertens, V. Anfara, & K. Roney (Eds.), An international look at educating young adolescents (pp. 1-

    23). Charlotte, NC: Information Age.

    Sahin, A. (2013). STEM project-based learning: Specialized form of inquiry-based learning. In R. M. Capraro,

    M. M. Capraro, & J. Morgan (Eds.) Project-based learning: An integrated science, technology,

    engineering, and mathematics (STEM) approach (2nd Ed., pp. 55-64). Rotterdam, The Netherlands:

    Sense.

    Sahin, A., Erdogan, N., Morgan, J., Capraro, M. M., & Capraro, R. M. (2012). The effects of high school course

    taking and SAT scores on college major selection. Sakarya University Journal of Education, 2(3), 96-

    109.

    Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for

    generalized causal inference. Boston, MA: Houghton-Mifflin.

    Vidal, J. (2011). UN Environment Programme: 200 Species Extinct Every Day, Unlike Anything Since

    Dinosaurs Disappeared 65 Million Years Ago. Huffington Post, 5/25/11. Retrieved from

    http://www.huffingtonpost.com/2010/08/17/un-environment-programme-_n_684562.html on June, 8,

    2015.

    Yetkiner, Z. E., Anderoglu, H. Y., & Capraro, R. M. (2008). Research summary: Project-based learning in

    mathematics. Retrieved from

    http://www.nmsa.org/Research/ResearchSummaries/ProjectBasedLearninginMath/tabid/1570/Default.as

    px

    Author Information Robert M. Capraro Department of Teaching, Learning and Culture

    Aggie STEM and Texas A&M University

    4232 TAMU, College Station, TX, USA 77843

    Contact e-mail: [email protected]

    Mary Margaret Capraro Department of Teaching, Learning and Culture

    Aggie STEM and Texas A&M University

    4232 TAMU, College Station, TX, USA 77843

  • 8

    Capraro, Capraro, Barroso & Morgan

    Luciana R. Barroso

    Zachry Department of Civil Engineering

    Aggie STEM and Texas A&M University

    4232 TAMU, College Station, TX, USA 77843

    James R. Morgan

    Department of Engineering

    Aggie STEM and Charles Sturt University

    Albury NSW 2640, Australia

  • International Journal of Education in Mathematics, Science and Technology

    Volume 4, Number 1, 2016 DOI:10.18404/ijemst.71338

    Moving STEM Beyond Schools: Students Perceptions about an Out-of-

    School STEM Education Program

    Evrim Baran, Sedef Canbazoglu Bilici, Canan Mesutoglu, Ceren Ocak

    Article Info Abstract Article History

    Received:

    2 August 2015

    Recent reports call for reformed education policies in Turkey in accordance with

    the need to develop students knowledge and skills about STEM education and

    improving STEM workforce in the country. This research implemented an

    integrated out-of-school STEM education program for 6th grade students who

    come from disadvantaged areas in a large urban city in Turkey. The study

    investigated students perceptions about the STEM activities implemented in the

    program. Forty 6th grade students (15 female) studying in public schools

    participated in the study. The data source used in this study was the activity

    evaluation forms completed by the students at the end of each activity. The

    evaluation forms were qualitatively analyzed to identify students perceptions on

    the content and skills gained, the challenges and limitations faced and

    suggestions for improvement. The results present recommendations on the

    implementation of integrated out-of-school STEM education programs.

    Accepted:

    11 October 2015

    Keywords

    STEM education

    STEM activities

    Out-of-school learning

    Education in Turkey

    Introduction

    Countries look for strategies to develop young generations knowledge and skills for designing and developing

    innovation, technology, and scientific literacy in order to confirm their place in the global economy. Science,

    Technology, Engineering, and Mathematics (STEM) has become a government policy in countries such as

    United States (National Academy of Sciences [NAS], 2006; National Academy of Engineering [NAE], 2009;

    National Research Council [NRC], 2012). Australia, China, Korea, and Taiwan have been working to develop

    K-12 STEM curriculum designed as integrative cross-disciplinary approaches within each of the STEM

    subjects (Fan & Ritz, 2014, p. 8). Increasing attention is given to STEM disciplines and STEM teaching across

    Europe (Corlu, Capraro & Capraro, 2014). Recent reports call for reformed education policies in Turkey to

    develop students knowledge and skills about STEM and improving STEM workforce in the country. The

    Turkish Ministry of Education strategic plan (Ministry of National Education of Turkey [MoNE], 2009), 2015

    STEM Education Turkey Report (Akgndz et al., 2015) and the Turkish Industry and Business Associations

    recent report on STEM (TUSIAD, 2014) highlighted the urgent need for preparing Turkish students with STEM

    competencies.

    Research on STEM education has focused on designing STEM training programs and STEM after school clubs

    to increase students interest and attitudes, and developing surveys to accurately measure their attitudes towards

    STEM. Studies investigating the impact of STEM trainings and STEM after school clubs revealed improvement

    in students attitudes towards STEM fields and STEM careers (Mohr-Schroeder et al., 2014; Shahali et al.,

    2015; Tseng, Chang, Lou, & Chen, 2013). Identifying the goals and the content are noted as two critical steps in

    the design of STEM education programs. Building the programs on students early interest and experiences, and

    engaging them in the practices of STEM education are noted as crucial factors in developing and sustaining their

    motivation and engagement with STEM education (National Research Council, 2011).

    STEM Projects and Education Programs in Turkey

    The implementation of STEM education activities varies to the school type in Turkey. Only a very small

    percentage of students having education in specialized schools have access to STEM education at international

    standards (Corlu, Capraro, & Capraro, 2014). Other opportunities include education projects supported by the

    Scientific and Technological Research Council of Turkey (TUBITAK) that aim to empower STEM education

  • 10 Baran, Canbazoglu Bilici, Mesutoglu & Ocak

    with activities for students and teachers. For example, in a project funded by TUBITAK, 5th grade students (n =

    20) used design-based methodology for STEM education, designed solar robots and kaleidoscopes, and created

    graphs with motion detectors. These activities helped develop positive attitudes towards science (Yamak, Bulut,

    & Dndar, 2014). In the engineer project students were encouraged to think like engineers by using simple and

    inexpensive materials (avas, Bulut, Holbrook, & Rannikmae, 2013).

    STEM projects also focused on training preservice and in-service teachers. Sungur Gl and Marulcu (2014)

    focused on the engineering discipline, worked with preservice and in-service science teachers on engineering

    design processes and activities using robots and Legos. Researchers found that preservice and in-service

    teachers, who were not familiar with the engineering design processes, had improvement in their perceptions of

    engineering processes. They gained a broader perspective in terms of the significance of engineering, features of

    engineering and engineers, and the use of Legos. Bozkurt (2014) also revealed that preservice science teachers

    decision-making skills and science process skills improved with engineering design based laboratory activities.

    Corlu (2013) developed an analytic rubric to evaluate STEM teaching practices in terms of STEM community,

    STEM integration, and STEM assessment through course syllabi. By assessing the course syllabi, this analytical

    rubric aimed to present teaching practices in science, technology, engineering and mathematics. Results showed

    significant difference between externally accredited STEM programs and non-accredited STEM programs

    (Corlu, 2013). The interest on developing STEM training programs in Turkey is revealed by the increasing

    number of projects implemented in school and out-of-school contexts. Yet, there is still limited research on how

    students perceive the activities implemented in these programs and their impact on their learning.

    The Conceptualization of STEM education in the Turkish Context

    STEM education is defined as an approach for developing knowledge, skills, and beliefs about STEM subjects

    with an interdisciplinary approach (Corlu, Capraro, & Capraro, 2014). The intersection of the disciplines is

    important for emphasizing the interconnected nature of STEM areas. Bybee (2010) reported that STEM

    education is mostly interpreted as science and mathematics and that technology and engineering disciplines are

    not emphasized. However, engineering generally takes a central role in the projects implemented in Turkey. The

    projects mainly aim at improving engineering knowledge and skills by using science concepts. For example,

    studies conducted in the Turkish context revealed that activities that stressed engineering design processes

    helped teachers and students improve engineering and science processes and skills (Bozkurt, 2014; avas,

    Bulut, Holbrook, & Rannikmae, 2013; Ercan & Bozkurt, 2013; Yamak, Bulut, & Dndar, 2014).

    As for the conceptualization of STEM, the literature revealed two categories appeared as the components of an

    exemplary STEM integration curriculum model: (a) content integration, merging of different STEM content

    areas in an activity, and (b) context integration, use of different STEM contexts to make the content more

    meaningful (Moore, Stohlmann, Wang, Tank, & Roehrig, 2014). The review of the STEM studies conducted in

    Turkey revealed that the studies mainly emphasized the context integration model (avas, Bulut, Holbrook, &

    Rannikmae, 2013; Sungur Gl & Marulcu, 2014). There is a need to practice content integration model that

    brings STEM education disciplines together in a unit or within an activity. This study followed the integrated

    STEM education approach which was an effort by educators to have students participate in engineering design

    as a means to develop technologies that require meaningful learning and an application of mathematics and/or

    science (Moore et al., 2014, p.38). In Turkey, raising science and mathematics literate students are the main

    concerns of the national curricula. Integrated STEM education programs are needed to train students as STEM

    literate individuals who can solve real life problems. According to PISA results, 68.7% of the students in Turkey

    belonging to low socio-economic and cultural group have limited access to quality educational resources and

    programs (OECD, 2013). There is a need to provide STEM education opportunities to disadvantaged students

    who have limited access to such programs in their formal education programs. To address this need, this

    research implemented an integrated out-of-school STEM education program for 6th grade students who come

    from disadvantaged areas in a large urban city in Turkey. This study aimed to investigate students perceptions

    about the STEM activities implemented in the program.

    Method

    The Study

    The study was conducted in the context of a STEM education program implemented at a large public university

    in Turkey. The project, funded by the Scientific and Technological Research Council of Turkeys Science and

  • 11

    Int J Educ Math Sci Technol

    Society Innovative Educational Applications grant, aimed to improve 6th grade students perceptions towards

    STEM fields and careers. The purpose was also to provide learning activities to students from the disadvantaged

    areas of Ankara who had limited opportunities to attend such activities and education in their schools and

    communities.

    The STEM education program lasted 40 hours during three weekends in March 2015. Thirteen faculty members

    from different universities in Turkey who had expertise in science, math and technology disciplines

    implemented 13 modules. Nine graduate students helped faculty members during the STEM education program

    modules that lasted between 90-180 minutes. Each day between two to four modules were implemented with

    two groups of students (20 students each) in parallel sessions. During this 5-day intensive STEM training,

    students attended to the modules from 9:00am till 5:00pm every day. 15 minutes after each STEM module was

    reserved to the activity evaluation.

    The modules followed hands-on and collaborative engagement within variety of STEM activities, including: (1)

    Egg-drop, (2) Scaled model of the solar system, (3) Application Inventor, (4) Designing a vacuum cleaner, (5)

    Designing enduring buildings, (6) Pot-Kin Car design, (7) Time to investigate-calculate-build and test, (8)

    Design of a wind turbine, (9) We are building our own structures, (10) Interrogate and learn: Force and motion

    with probes, (11) Cryptology and Egyptian number systems, (12) Design of a Kaleidoscope, (13) STEM

    Commercial Video.

    Participants

    Forty 6th grade students (25 male, 15 female) studying in public schools participated to the study. Students

    ages ranged between 10 and 12. Project invitations were sent to the schools and science centers in Ankara. Out

    of 70 students who applied to the program online, 40 of them were selected following the criteria of being (1) in

    different schools, (2) having interest in STEM, (3) and not attending to a STEM training before. According to

    the 5th grade science and mathematics scores, majority of the students were high-achievers. In the online

    application form, when asked about their motivation for participation to such programa, all students stated that

    they enjoyed conducting experiments and investigations, making discoveries, designing things, and following

    developments in science and engineering.

    Data Sources

    The activity evaluation forms completed by the students at the end of each activity were used as the data

    sources. 15 minutes were reserved for these written evaluation periods after each module. Researchers

    developed the activity evaluation form to collect information on students perceptions of the activities in terms

    of content and skills gained, the challenges and limitations faced, and their suggestions for improvement. The

    questions were: What did you learn in this activity? What skills you developed in this activity? What challenged

    you in this activity? How would you use the things you learned in this activity in the future? What do you

    suggest to improve this activity? Students provided written responses to these questions. A total of 520

    evaluation forms were collected.

    STEM Education Program Activities

    1. Egg-drop. The activity was based on a design challenge. Students designed a package that would keep the

    egg inside from breaking when it was dropped from the 4th floor. The package and the egg simulated space

    vehicles that would land on Mars safely. Students worked in collaborative groups. Simple and easy-to-find

    materials were used in the activity such as eggs, tapes, newspapers, balloons and cardboards. Students tried to

    design a package using all or some of the materials. Students first brainstormed, drew their designs on the

    papers and discussed potential solutions. Groups were then allowed to finalize their design choosing the best

    working example. A representative member was chosen from each group to drop the package from the 4th floor.

    Meanwhile, other members of the groups observed and checked whether the package kept the egg safe inside.

    When all trials were completed, all students went back to the class. During a big class discussion, the best

    design was selected after evaluating the status of the eggs. Limitations of each design were discussed with

    possible further suggestions. Finally, students watched a short NASA video presenting the landing of a real

    spacecraft safely on Mars.

  • 12 Baran, Canbazoglu Bilici, Mesutoglu & Ocak

    2. Scaled model of the solar system. The activity included the design of a small-scale model of our Solar System

    using basic mathematics knowledge (e.g., proportion, numbers of many figures) and the data about the Solar

    System. Materials used were cardboards, papers, pencils, calculators, compasses, and rulers. The activity began

    with students brainstorming on the Solar System and examining their prior knowledge about proportion and the

    Solar System. Then, students watched a short video depicting the Solar System followed by a small discussion

    about location and sizes of the planets and stars. Students were presented with data on the planets and some

    other objects in the Solar System, their distance to the Sun, and their diameters. Students were then expected to

    guess their locations. In groups, students worked on the scale factor that they would base their Solar System

    model on. At this stage, a small ball was given to the groups to represent the Sun. Groups drew their models on

    large cardboards. Finally all groups went to the garden to place their cardboards in a way that would represent

    the Solar System. A final in-class discussion was conducted on the sizes and locations of objects in the Solar

    System.

    3. Application Inventor. This activity aimed to help students gain knowledge about basic programming. The

    AppInventor software developed by the MIT was used for beginners to program applications through fixed

    coding schemes without writing actual codes. The AppInventor program allowed developers to write codes for

    mobile android devices and design various applications by importing data from the sensors of the devices.

    Through the application inventor activity, coding schemes and loops were taught to the students and they were

    expected to develop various applications by using drag and drop method. After being informed about the details

    of programming language, students tried to write codes with proper parameters provided by the instructors.

    Additionally, students were asked to bring their android devices beforehand to be able to test their codes at the

    end of the activity. The instructors also provided students with the proper testing tool if they lacked one.

    Students were enrolled to the AppInventor with their email accounts so that they could access their codes after

    the activity to continue programming.

    4. Designing a vacuum cleaner. The real world problem presented to the students in this activity was designing

    a vacuum cleaner to clean dust in their room. Students first discussed the use of electrical energy economically

    and contributing to the national economy. Students were then introduced the steps of the design cycle consisting

    of five steps; ask, imagine, plan, create and improve. In groups, students then drew and discussed their designs

    and collected data with their materials. Using reasoning and creative thinking, students tested their models.

    Whether dusts were collected inside the vacuum cleaner and its speed were some of the results of these tests.

    Students debated on their different suggestions based on how the alternative models could work. The

    appropriateness of their designs were further analyzed, discussed, and evaluated. A design challenge took place

    where the best design of the class was selected in terms of the amount of dust it collected. Within this design

    challenge, all groups produced solutions to improve their models based on their models performance and the

    explanations they generated.

    5. Designing enduring buildings. The activity included the design of the most enduring building that could carry

    the biggest weight in class. Working in groups of four or five, students used spaghetti and modeling clay. The

    engineering design cycle introduced in the vacuum cleaner activity was followed again. The students came up

    with many different models in the planning phase, but they completed the cycle with one final model only. All

    groups discussed the limitations and the strengths of the previous models they planned. At the planning stage,

    the instructors visited the groups and gave examples of different building models from real life. Once each

    group completed their buildings, they were tested. Mobile phones were put at the top of each building. Some

    buildings could only carry one mobile phone. The models that could carry three mobile phones won the

    challenge. With the participation of all students, discussions on the successful designs followed.

    6. Pot-Kin Car design. In this activity, students were expected to design a model car that saved highest energy

    output in consideration of the principle of energy (potential to kinetic energy) transformation. The activity

    aimed to optimize the level of energy over the signed route by decreasing the rate of heat loss. Students were

    challenged to design their cars within their restricted budget from the engineering market. At the end of the

    activity, cars were tested in terms of meeting two conditions: (1) The car should be able to move on a flat

    surface, and (2) after starting to move, it should go at least six meters forward. In groups, students drew their

    designs and constructed their cars with the materials they bought from the market. Cars meeting required

    criteria were compared in terms of the speed they reached along the signed route. The fastest car was selected as

    the winner. As a final step, a group discussion was conducted to improve students designs.

    7. Time to investigate-calculate-build and test. Students in this activity designed and built bridges. Simple

    materials such as toothpicks, sticks, paper, tape, and Styrofoam were used. The instructor formed groups and

    students worked collaboratively. Students first began to draw sketches of their bridge designs. They discussed

  • 13

    Int J Educ Math Sci Technol

    and took notes on possible results, necessary materials, strengths, and limitations. When students completed

    their designs, they tested them with a variety of materials. At the end of the activity, after all groups finalized

    their bridges, a design challenge was completed to choose the best bridge. Different weights were hanged to the

    bridges and they were tested. The most enduring bridge was selected as the winner. A group discussion took

    place on what could be done to make the designs better.

    8. Design of a wind turbine. In this activity, students were expected to design a wind turbine by taking the

    advantage of wind energy. Materials used were straws, sticky tapes, cardboards, strings, paper cups, cork

    stoppers, wooden sticks, pins, and play dough. A week before the activity, participants were informed about the

    wind turbine activity to conduct a research about generic design of wind turbines for the next week. In the first

    stage, students brainstormed among wind turbine designs under the guidance of information acquired by the

    previous research. Later, students were assigned to groups of four or five to sketch their initial wind turbine

    design. In the meantime, students justified their wind turbine design to the instructor. Wide range of material

    supply enabled students design particular wind turbines; therefore it was ensured that each group worked

    relatively far enough from each other. After the completion of wind turbine construction, groups tested the

    turbines against a ventilator.

    9. We are building our own structures. In this activity, students in groups built a resistant structure from

    recyclable household materials in ninety-minute period of time. All kind of items expected to strengthen the

    structure such as plastic cup and toothpick could be used on the condition of efficient budget management.

    During the design phase, groups were allowed to use tablet PCs to make calculations of strength throughout the

    activity. At the end of the activity, each structure was evaluated in terms of weight bearing capacity. The activity

    followed the 5E instructional model (engage, explore, explain, elaborate/extend and evaluate). In the engage

    phase, students were expected to approach a real-life problem from the perspective of an engineer. The

    instructor shared a picture of a wrecked bridge to encourage students generate solutions from an engineers

    point of view. Then, in exploration stage, same materials were distributed to each group to design a structure by

    referring to maximum features of the given materials such as being the tallest and the strongest. Each group had

    a certain budget to buy the items already priced by the instructor. It was significant to devise the structure with

    maximum efficiency and minimum budget. Before the construction phase, groups were responsible for

    sketching the structure to be able to calculate balance and momentum of the artifact. In the elaboration stage,

    students exhibited their artifacts in front of the classroom to discover the strength of the structure in terms of

    weight bearing capacity. Finally, both group and individual performances were evaluated in reference to

    criterions of creativity, strength, and length.

    10. Interrogate and learn: Force and motion with probes. To experiment with force and motion probes, the

    software Logger Pro 3, Vernier Force and Motion system, and movement detectors were used in the activity.

    The software was downloaded and prepared before the activity time. Students explored the topics Force and

    Motion by experimenting with probes. Throughout the activity the students drew and interpreted graphs on

    speed, position, and friction.

    11. Cryptology and Egyptian number systems. The activity aimed at introducing ancient numbering systems

    attributing to Egyptian numbering system and definition of cryptology with its applications in decimal system.

    Students were expected to learn about the symbols of ancient Egyptian numbering system and manage to

    convert a number written in decimal system to one written in ancient Egyptian numbering system. Papers,

    images of hieroglyphic alphabet, and the table of ancient Egyptian numbering system were the materials used

    for the activity. Students devised their own numbering systems and a class discussion was hold about the

    conclusions of each student.

    12. Design of a kaleidoscope. This activity required students design a kaleidoscope to associate kaleidoscope

    construction with its mathematical implications. Plastic mirror, cardboard roll, sticky tape, glue, colorful plastic

    beads, white cardboard, craft knife, transparent punched pocket, and translucent opaque binder were the

    materials distributed for kaleidoscope design and construction. In the beginning of the activity, each student

    shared the results of kaleidoscope research with their classmates. Then, students were assigned to groups of

    four. Each group discussed the essential steps of a kaleidoscope design and wrote the stages down on a piece of

    paper. In the meantime, instructors started inquiry based learning process by posing questions in reference to the

    points of consideration during the design stage. Then, groups constructed the kaleidoscopes with the materials

    distributed by the instructors. At the end of the activity, groups had a chance to examine other groups designs

    under the guidance of instructor questions referring mathematical indicators of kaleidoscope construction.

  • 14 Baran, Canbazoglu Bilici, Mesutoglu & Ocak

    13. STEM Commercial Video. In this activity, students designed STEM commercial videos using all of the

    engineering skills and design skills improved with the project. Students were first presented with a scenario and

    engineering design cycle to prepare STEM commercial videos. In the scenario, the commercial video they

    designed was going to be played on TV channels to attract sixth grade students to next years STEM project.

    Students first planned their videos filling in the storyboard template with script, visuals, narration, and audio.

    They also generated ideas for slogans that would be used in their commercials. Students were expected to design

    their commercial videos following the four criteria: 1) the storyboard should be completed and should get

    confirmation from the instructors, 2) the commercial video should be limited to 2-3 minutes, 3) the commercial

    video should attract audience attention with visual and audio elements, and 4) the commercial video should give

    information about STEM and promote it. Students developed their videos on the Pawtoon video-editing

    program. Once students finished their videos, all videos were shown on the screen and students voted to select

    the best video that would win a price.

    Figure 1. Students working on STEM activities

    Data Analysis

    Students responses to the activity evaluation forms were analyzed qualitatively to examine students

    perceptions about the STEM activities with a focus on the content and skills gained, the challenges and

    limitations faced and suggestions for improvement. The results of the data analysis emerged under four

    categories: (a) subjects learned, (b) skills developed, (c) future use, and (d) suggestions. These categories were

    used to generate coding system of the study. In the coding phase, student response rates were calculated in

    terms of frequency rate in percentages and categorized under these four categories. After documenting and

    classifying entire codes, similar codes were unified and evaluation theme table was created. Two researchers

    examined and coded the data sources together to create the codebook and to document the frequencies of the

    codes. Other two researchers then confirmed the codes and coding through debriefing meetings.

  • 15

    Int J Educ Math Sci Technol

    Results and Discussion

    The analysis of the activity evaluation forms revealed four categories: (a) subjects learned, (b) skills developed,

    (c) future use, (d) suggestions for improvement. Table 1 presents the response rates within each category and

    codes.

    Table 1. Evaluation themes

    Themes # %

    1. Subjects (subjects / topics students learnt in the activity) 204 29

    Solid structure construction 49 24

    Kaleidoscope & cryptology 33 16

    Velocity-time graph& distance-time graph 22 11

    Types of energy 21 10

    Renewable & non-renewable energy 20 10

    Qualitative & quantitative observation 16 8

    Wind turbine 16 8

    Tool utilization 14 7

    Center of gravity 13 6

    2. Skills (skills that students developed in the activity) 246 35

    Handcraft skills 88 36

    Cognitive Skills (argumentation, reasoning, thinking, observing, planning,

    mental skills, imagining)

    61 25

    Engineering skills 27 11

    Design skills 26 11

    Computer skills 26 11

    Math and science skills 18 7

    3. Future uses (how students will make use of the activity) 140 20

    Future career and profession 117 83

    School work 23 16

    4. Suggestions (students suggestions for the activity) 108 15

    Materials (better and more comprehensive materials. Also more number of

    materials)

    74 69

    Attention and fun 13 12

    Time 12 11

    Information (more information to be provided at the beginning) 9 9

    Subjects Learned

    Within the scope of the STEM education program, 13 STEM modules were implemented. Wide array of

    knowledge encompassing domain specific subjects as well as interdisciplinary concepts were embedded in the

    STEM activities designed as hands-on and collaborative explorations. The analysis of the evaluation forms

    revealed that the subjects that were most commonly cited by the students were solid structure construction by

    experimenting on bridges (24%), cryptology with its applications in decimal system (16%) and kaleidoscope

    construction considering its mathematical implications (16%). Other frequently noted subjects were drawing

    and calculating velocity-time and distance time graphs (11%) followed by mechanical energy (10%), renewable

    and nonrenewable energy (10%), and wind turbine construction (8 %). Conducting qualitative and quantitative

    observation (8%) was also noted by the students in a way of attributing to all STEM training activities. One of

    the students, for example, stated: I learnt how to conduct a scientific research by doing qualitative and

    quantitative observation. Other noted subjects were tool utilization (thermometer, probe, sonar) (7%) and

    center of gravity (6%).

  • 16 Baran, Canbazoglu Bilici, Mesutoglu & Ocak

    Skills Developed

    Skills developed through STEM activities were coded under six categories: Cognitive skills (argumentation,

    reasoning, thinking, observing, planning, mental skills, imagining) (25%), math and science skills (7%), design

    skills (11%), engineering skills (11%), and computer skills (11%). Students noted that they developed their

    handcraft skills considering that the STEM activities were mainly hands-on that required students design and

    develop tools. Cognitive skills (e.g., argumentation, reasoning, thinking, observing, planning, mental and

    imagination) were also notable in students responses. One of the students, for example, explained: I believe

    that with STEM activities, I developed my argumentation, questioning and reasoning skills. Students also

    stated that they developed their engineering skills such as building balanced and resistant bridges and designing

    fast cars. Design and computer skills were also noted followed by mathematics and science skills (7%). One of

    the students expressed: I improved my imagination and my engineering skills with this activity. Another

    student explained his thoughts at the end of the we are building our own structures activity: I feel that I

    progressed in both planning and designing stages.

    Future Use

    Students believed that they would use their learning in STEM education program in their future career and

    profession (83%) and schoolwork (16%). Some of the students gave specific examples to the professions such

    as architect, engineer, doctor and web designer where the STEM activities would contribute. One student, for

    example, stated: When I am employed as an engineer in the Ministry of Transportation, I am going to benefit

    from what I have learnt from the STEM activities. Another student noted: I am going to benefit from what I

    have learnt from STEM activities when I become seismologist. The student who wanted to become a science

    teacher commented: When I become a science teacher, I am going to use the knowledge I learnt from STEM

    activities. Another area that students noted was their schoolwork. Students stated that they planned to make use

    of the activities in their future school life such as homework, projects, and laboratory work. One of the students

    commented: I am going to use the knowledge that I learnt from STEM activities while conducting experiments

    in science classes.

    Suggestions for Improvement

    The students reported suggestions for the improvement of the activities implemented in the STEM education

    program. The suggestions addressed use of materials (69%), time (11%), attention and elements of fun (12%),

    and information provided (8%). As for the materials, students had different recommendations. Some of them

    agreed that they needed more materials to complete the activities. According to some, the materials should have

    been more advanced to match their age, and some agreed on using more user-friendly materials. One of the

    students, for example, commented: I suggest using more advanced tools for the activity of force and motion

    with probes. Students also stated that they needed more time for certain activities. Some students suggested

    designing the activities with more fun elements. Lastly, students suggested providing more information at the

    beginning of the activities. One of the students, commented: I want to be more informed about the activities

    throughout the process.

    Conclusion

    STEM education is now considered as one of the critical focus areas within Turkish education to increase

    countrys innovation development capacity and to enhance countrys competitiveness within the global

    economy (Corlu, Capraro, & Capraro, 2014). Yet, there is limited evidence on out-of-school STEM models and

    their impact on students learning, attitudes, and perceptions towards STEM in Turkey and in the world. This

    research confirmed the effectiveness of out-of-school STEM education programs in their capacity of engaging

    students in design and engineering practices that are not common in traditional classrooms (Rogers &

    Portsmore, 2004). These programs may help expand students knowledge and interest towards STEM (Weber,

    2011).

    The integrated STEM education program followed hands-on, collaborative, design-based, and inquiry oriented

    pedagogical approach. This approach helped students engage in problem solving exercises relevant to their lives

    (Schnittka, Bell, & Richards, 2010). Students in this study noted the contribution of this approach to their

    cognitive, design, engineering and computer skills. The activities, giving students tangible application of

  • 17

    Int J Educ Math Sci Technol

    scientific, mathematical and technological concepts, helped them develop insights into engineering design

    practices.

    Students perceptions about the STEM activities are critical, as their evaluation of the design, content, and scope

    of these activities may reveal areas for improvement. This study revealed that students valued hands-on nature

    of the STEM activities that gave them opportunities to design artifacts and engage in design challenges. The

    research results suggested that the integration of STEM activities into out-of-school education programs may

    support developing students interest in pursuing STEM related careers.

    Recommendations

    The connections between the STEM activities implemented in out-of-school programs and students coursework

    should be closely linked. These connections with formal curriculum would also help teachers and students

    extend students learning outside of the classroom with collaborative, applied, and project-based learning

    activities. During their evaluations, students recommended tapping on their prior knowledge before the activities

    and providing more information about the activity scope and content. Future STEM education programs may

    spend more time in eliciting students knowledge to address their learning needs and misconceptions. Inquiry

    based activities would encourage students learning of concepts addressed in the STEM activities.

    The research findings suggested that collaborative learning opportunities enhanced students engagement with

    STEM, yet students needed practice on collaborative learning processes. Future STEM activities may model

    effective collaborative work, and present students guidelines for collaboration. The study revealed that students

    had difficulty in completing some STEM activities due to the time limit. Planning therefore emerged as an

    important finding under the design skills. Future STEM activities may emphasize the planning phase of

    engineering design processes, and scaffold students planning stages. The study results presented students high

    interest towards STEM careers after they attended to the program. Future research may track their interest, 6

    months and 1 year after the programs to examine whether their ideas sustained in the long term.

    The STEM education program implemented in this research was supported by a grant. While the project used

    low-cost materials for the STEM activities, systematic integration of STEM into curriculum would require

    continuous financial and administrative support. Future research should investigate policy and curriculum

    models for the implementation of large-scale STEM programs. The STEM education approach used in this

    research suggested implementing STEM activities that address at least two disciplines in hands-on applied

    STEM activities. Same approach could be integrated to formal curriculum with the inclusion of activities

    covering objectives from different STEM disciplines and using big-idea focused problem solving projects.

    Future research may investigate the integration of the activities presented in this research to formal curriculum

    followed in schools.

    Acknowledgements

    The research quoted in this chapter was supported by The Scientific and Technological Research Council of

    Turkey (project number 1059B291400247).

    References

    Akgndz, D., Aydeniz, M., akmak, G., avas, B., Corlu, M. S., ner, T., &. zdemir, S. (2015). STEM

    eitimi Trkiye raporu: Gnn modas m yoksa gereksinim mi? [A report on STEM Education in

    Turkey: A provisional agenda or a necessity?][White Paper]. stanbul, Turkey: Aydn niversitesi.

    Retrieved from http://www.aydin.edu.tr/belgeler/IAU-STEM-Egitimi-Turkiye-Raporu-2015.pdf

    Bozkurt, E. (2014). Mhendslk tasarm temell fen etmnn fen blgs retmen adaylarinin karar verme

    becers, blmsel sre becerler ve srece ynelk alglarna etks [The effect of engineering design

    based science instruction on science teacher candidates' decision making skills, science process skills and

    perceptions about the process]. (Unpublished doctoral dissertation). Gazi University, Ankara.

    Bybee, R. (2010). Advancing STEM education: A 2020 vision. Technology and Engineering Teacher, 70(1),

    3035.

    avas, B., Bulut, ., Holbrook, J., & Rannikmae, M. (2013). Fen egitimine mhendislik odakl bir yaklasm:

    ENGINEER projesi ve uygulamalar [An engineering-focused approach to science education:

  • 18 Baran, Canbazoglu Bilici, Mesutoglu & Ocak

    ENGINEER projects and applications], Fen Bilimleri retimi Dergisi, 1(1), 1222.

    Corlu, M. S. (2013). Insights into STEM education praxis: An assessment scheme for course syllabi.

    Educational Sciences: Theory & Practice, 13(4), 24772485.

    Corlu, M. S., Capraro, R. M., & Capraro, M. M. (2014). Introducing STEM education: Implications for

    educating our teachers in the age of innovation. Education and Science, 39(171), 7485.

    Ercan, S., & Bozkurt, E. (2013). Expectations from engineering applications in science education: decision-

    making skill. In B. avas & G. Cakmakc, The International Organization for Science and Technology

    Education (IOSTE); IOSTE Eurasian Regional Symposium & Brokerage Event Horizon 2020 Symposium

    Abstracts (1st ed., p. 51). Antalya: IOSTE Eurasian Regional Symposium & Brokerage Event Horizon

    2020. Retrieved from http://www.ioste2013.org/wp-content/uploads/2013/04/abstracts-BOOK1.pdf

    Fan, S., & Ritz, J. (2014). International views of STEM education. In PATT-28 Research into Technological

    and Engineering Literacy Core Connections (pp. 7-14). Orlando: International Technology and

    Engineering Educators Association. Retrieved from

    http://www.iteea.org/Conference/PATT/PATT28/Fan%20Ritz.pdf

    Ministry of National Education (2009). MEB 2010-2014 stratejik plan [MoNE 2010-2014 strategic plan].

    Ankara, Turkey: Milli Egitim Bakanlg Strateji Gelistirme Baskanlg.

    Mohr-Schroeder, M. J., Jackson, C., Miller, M., Walcott, B., Little, D. L., Speler, L., & Schroeder, D. C. (2014).

    Developing middle school students interests in STEM via summer learning experiences: See Blue

    STEM Camp. School Science & Mathematics, 114(6), 291301.

    Moore, T.J., Stohlmann, M. S., Wang, H. H., Tank, K. M., & Roehrig, G. H. (2014). Implementation and

    integration of engineering in K-12 STEM education. In J. Strobel, S. Purzer, & M. Cardella (Ed.),

    Engineering in precollege settings: Research into practice (pp. 3560). Rotterdam, the Netherlands:

    Sense Publishers.

    National Academy of Sciences (2006). Rising above the gathering storm: Energizing and employing America

    for a brighter economic future. Washington, DC: National Academies Press. Retrieved from

    http://www.nap.edu/catalog/11463/rising-above-the-gathering-storm-energizing-and-employing-america-

    for

    National Academy of Engineering (2009). Engineering in K12 education: Understanding the status and

    improving the prospects. Washington, DC: National Academies Press.

    National Research Council (2011). Successful K-12 STEM Education: Identifying Effective Approaches in

    Science, Technology, Engineering, and Mathematics. Committee on Highly Successful Science Programs

    for K-12 Science Education. Board on Science Education and Board on Testing and Assessment,

    Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies

    Press. Retrieved from http://www.nap.edu/catalog/13158/successful-k-12-stem-education-identifying-

    effective-approaches-in-science

    National Research Council (2012). A Framework for K-12 Science Education: Practices, Crosscutting

    Concepts, and Core Ideas. Washington, DC: The National Academies Press.

    http://www.nap.edu/catalog/13165/a-framework-for-k-12-science-education-practices-crosscutting-

    concepts

    OECD (2013). PISA 2012 results: What students know and can do (volume I): student performance in

    mathematics, reading and science. OECD publishing. Retrieved from

    http://www.oecd.org/pisa/keyfindings/pisa-2012-results-volume-I.pdf

    Rogers, C., & Po