I Conference in Modern Technologies of Mathematical Education for Engineering Students

- MetaMath

QUANTITATIVE EVALUATION OF MODERNIZED COURSESDr. Christian MercatPedro Lealdino Filho

Université Claude Bernard – Lyon I

RESEARCH QUESTION

Is there any difference between modernized courses and the olderones in terms of student’s scores?

On the next slides we present the results from each Institutionregarding the overall scores of modernized courses against the olderones.

Participants of the Study - MetaMath

University Students Courses

LETI 213 Calculus

OMSU 82 Algebra and Geometry

TSU 74 Fuzzy Logic

51 Probability

UNN 47 Math Modeling

46 Data Analysis

KAI 126 Probability and Statistics

22 Optimization Methods

Total 661

LETI – Saint-Petersburg Electrotechnical UniversityANCOVA ANALYSIS

Df Sum Sq Mean Sq F Value Pr (> F)

pretest 1 5256 5256 25.830 8.26e-07***

treatment 1 108 108 0.533 0.46617

pretest:treatment 1 1708 1708 8.394 0.00416**

Summary – LETI

Pre-Test Pos-Test Diff(Pos – Pre) N - treatment Variance Test t - test

Mean 21.92 52.51 30.59

Old 119

F 0.946 t 0.919

Sd 9.49 13.08 14.98 num df 118 df 211

Median 21.43 53.57 28.57 den df 93

Mean 20.89 53.39 32.50

Mod 94 p-value 0.77 0.35Sd 9.24 16.89 15.21

Median 17.86 53.57 32.14

KAI – Kazan National Research Technical UniversityANCOVA ANALYSIS

Df Sum Sq Mean Sq F Value Pr (> F)

pretest 1 13098 13098 56.387 5.72e-12 ***

treatment 1 4261 4261 18.343 3.35e-05 ***

pretest:treatment 1 1113 1113 4.793 0.0302 *

Summary – KAI

Pre-Test Pos-Test Diff(Pos – Pre) N - treatment Variance Test t - test

Mean 42.80 56.52 13.73

Old 71

F 0.714 t 2.88

Sd 19.71 20.38 18.05 num df 76 df 146

Median 40.50 58.50 8.00 den df 70

Mean 47.14 69.43 22.29

Mod 77 p-value 0.15 0.004 *Sd 16.67 14.82 18.04

Median 48.50 71.50 13.50

OMSU – Ogarev Mordovia State UniversityANCOVA ANALYSIS

Df Sum Sq Mean Sq F Value Pr (> F)

pretest 1 12801 12801 81.315 9.98E-14 ***

treatment 1 117 117 0.744 0.391

pretest:treatment 1 58 58 0.368 0.546

Summary – OMSU

Pre-Test Pos-Test Diff(Pos – Pre) N - treatment Variance Test t - test

Mean 25.97 45.03 19.05

Old 37

F 1.007 t - 0.46

Sd 10.14 17.33 12.95 num df 44 df 80

Median 25.00 47.00 22.00 den df 36

Mean 30.91 48.67 17.76

Mod 45 p-value 0.99 0.64Sd 10.18 17.95 12.40

Median 31.00 50.00 16.00

TSU – Tver State UniversityANCOVA ANALYSIS

Df Sum Sq Mean Sq F Value Pr (> F)

pretest 1 20188 20188 109.64 < 2e-16 ***

treatment 1 194 194 1.055 0.3064

pretest:treatment 1 525 525 2.853 0.0938

Summary – TSU

Pre-Test Pos-Test Diff(Pos – Pre) N - treatment Variance Test t - test

Mean 44.72 64.16 19.44

Old 62

F 0.82 t 0.69

Sd 19.53 19.59 12.98 num df 61 df 123

Median 47.62 65.62 20.83 den df 62

Mean 46.76 68.05 21.29

Mod 63 p-value 0.44 0.48Sd 17.70 17.61 16.53

Median 48.96 69.39 20.00

Perception of MathematicsDescription – Example

Perception of MathematicsPCA

CODE QUESTIONN1 I think solving math problemsis quite boringN2 Solving math problems is funN3 The entire process of solving mathematical problems is very engaging for meN4 I am OK with how I am doing at solving math problemsN5 I consider solving math problems as an opportunity to prove myselfN6 I think mathematics is very interestingN7 I liked working on math problemsN8 I find mathematics to be very hardN9 I think I am very good in mathN10 I think I have a talent for mathematicsN11 It is very important for me to be able solve math problemsN12 I think math problems are very boringN13 I worry a lot about the tasks, which I am not sure I can masterN14 I like situations, in which I have to prove my skillsN15 I am afraid to make mistakes even if they might pass unnoticedN16 I try to do my best when solving math problemsN17 I like tasks that show what I am good atN18 I prefer easy tasks, in which I know I won’t make any mistakeN19 I am scared to have to solve exercises that might cause me making mistakesN20 I think, in math, main principles are more important than applied knowledgeN21 I enjoy theoretical aspects of mathematics more than practical problem solving N22 I think for an engineer, problem solving skills are more important than math theoryN23 I think we need fewer mathematics course in universityN24 I think for my future studies at this university, mathematics has little importanceN25 I think for my future career, mathematics has little importanceN26 I think, all technical subjects require math knowledge N27 I think, I need to study math to be successful in the future

CODE QUESTIONN1 I think solving math problemsis quite boringN2 Solving math problems is funN3 The entire process of solving mathematical problems is very engaging for meN4 I am OK with how I am doing at solving math problemsN5 I consider solving math problems as an opportunity to prove myselfN6 I think mathematics is very interestingN7 I liked working on math problemsN8 I find mathematics to be very hardN9 I think I am very good in mathN10 I think I have a talent for mathematicsN11 It is very important for me to be able solve math problemsN12 I think math problems are very boringN13 I worry a lot about the tasks, which I am not sure I can masterN14 I like situations, in which I have to prove my skillsN15 I am afraid to make mistakes even if they might pass unnoticedN16 I try to do my best when solving math problemsN17 I like tasks that show what I am good atN18 I prefer easy tasks, in which I know I won’t make any mistakeN19 I am scared to have to solve exercises that might cause me making mistakesN20 I think, in math, main principles are more important than applied knowledgeN21 I enjoy theoretical aspects of mathematics more than practical problem solving N22 I think for an engineer, problem solving skills are more important than math theoryN23 I think we need fewer mathematics course in universityN24 I think for my future studies at this university, mathematics has little importanceN25 I think for my future career, mathematics has little importanceN26 I think, all technical subjects require math knowledge N27 I think, I need to study math to be successful in the future

CODE QUESTIONN1 I think solving math problemsis quite boringN2 Solving math problems is funN3 The entire process of solving mathematical problems is very engaging for meN4 I am OK with how I am doing at solving math problemsN5 I consider solving math problems as an opportunity to prove myselfN6 I think mathematics is very interestingN7 I liked working on math problemsN8 I find mathematics to be very hardN9 I think I am very good in mathN10 I think I have a talent for mathematicsN11 It is very important for me to be able solve math problemsN12 I think math problems are very boringN13 I worry a lot about the tasks, which I am not sure I can masterN14 I like situations, in which I have to prove my skillsN15 I am afraid to make mistakes even if they might pass unnoticedN16 I try to do my best when solving math problemsN17 I like tasks that show what I am good atN18 I prefer easy tasks, in which I know I won’t make any mistakeN19 I am scared to have to solve exercises that might cause me making mistakesN20 I think, in math, main principles are more important than applied knowledgeN21 I enjoy theoretical aspects of mathematics more than practical problem solving N22 I think for an engineer, problem solving skills are more important than math theoryN23 I think we need fewer mathematics course in universityN24 I think for my future studies at this university, mathematics has little importanceN25 I think for my future career, mathematics has little importanceN26 I think, all technical subjects require math knowledge N27 I think, I need to study math to be successful in the future

CODE QUESTIONN1 I think solving math problemsis quite boringN2 Solving math problems is funN3 The entire process of solving mathematical problems is very engaging for meN4 I am OK with how I am doing at solving math problemsN5 I consider solving math problems as an opportunity to prove myselfN6 I think mathematics is very interestingN7 I liked working on math problemsN8 I find mathematics to be very hardN9 I think I am very good in mathN10 I think I have a talent for mathematicsN11 It is very important for me to be able solve math problemsN12 I think math problems are very boringN13 I worry a lot about the tasks, which I am not sure I can masterN14 I like situations, in which I have to prove my skillsN15 I am afraid to make mistakes even if they might pass unnoticedN16 I try to do my best when solving math problemsN17 I like tasks that show what I am good atN18 I prefer easy tasks, in which I know I won’t make any mistakeN19 I am scared to have to solve exercises that might cause me making mistakesN20 I think, in math, main principles are more important than applied knowledgeN21 I enjoy theoretical aspects of mathematics more than practical problem solving N22 I think for an engineer, problem solving skills are more important than math theoryN23 I think we need fewer mathematics course in universityN24 I think for my future studies at this university, mathematics has little importanceN25 I think for my future career, mathematics has little importanceN26 I think, all technical subjects require math knowledge N27 I think, I need to study math to be successful in the future

CODE QUESTIONN1 I think solving math problemsis quite boringN2 Solving math problems is funN3 The entire process of solving mathematical problems is very engaging for meN4 I am OK with how I am doing at solving math problemsN5 I consider solving math problems as an opportunity to prove myselfN6 I think mathematics is very interestingN7 I liked working on math problemsN8 I find mathematics to be very hardN9 I think I am very good in mathN10 I think I have a talent for mathematicsN11 It is very important for me to be able solve math problemsN12 I think math problems are very boringN13 I worry a lot about the tasks, which I am not sure I can masterN14 I like situations, in which I have to prove my skillsN15 I am afraid to make mistakes even if they might pass unnoticedN16 I try to do my best when solving math problemsN17 I like tasks that show what I am good atN18 I prefer easy tasks, in which I know I won’t make any mistakeN19 I am scared to have to solve exercises that might cause me making mistakesN20 I think, in math, main principles are more important than applied knowledgeN21 I enjoy theoretical aspects of mathematics more than practical problem solving N22 I think for an engineer, problem solving skills are more important than math theoryN23 I think we need fewer mathematics course in universityN24 I think for my future studies at this university, mathematics has little importanceN25 I think for my future career, mathematics has little importanceN26 I think, all technical subjects require math knowledge N27 I think, I need to study math to be successful in the future

спасибоThank you!

Merci!Obrigado!