30 item multiple choice to probe student’s understanding of basic concept of force and motion....

27
30 item multiple choice to probe 30 item multiple choice to probe student’s understanding of basic student’s understanding of basic concept of force and motion. concept of force and motion. Widely used in high school and Widely used in high school and universities. universities. Translated in 10 languages Translated in 10 languages 1 . . The Force Concept Inventory The Force Concept Inventory (FCI)* (FCI)* estenes D, Wells M & Swackhammer G (1992). The Physics Teacher, 30. 141-151 alloun I, Hake,R, Mosca E, Hestenes D, (1995). In Mazur: Peer imstruction. ahasa Malaysia Translation Jaafar Jantan. UiTM (unpublish)
  • date post

    21-Dec-2015
  • Category

    Documents

  • view

    213
  • download

    1

Transcript of 30 item multiple choice to probe student’s understanding of basic concept of force and motion....

30 item multiple choice to probe 30 item multiple choice to probe student’s understanding of basic student’s understanding of basic concept of force and motion.concept of force and motion.

Widely used in high school and Widely used in high school and universities.universities.

Translated in 10 languagesTranslated in 10 languages11..

The Force Concept Inventory The Force Concept Inventory (FCI)*(FCI)*

*Hestenes D, Wells M & Swackhammer G (1992). The Physics Teacher, 30. 141-151*Halloun I, Hake,R, Mosca E, Hestenes D, (1995). In Mazur: Peer imstruction.1Bahasa Malaysia Translation Jaafar Jantan. UiTM (unpublish)

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Concepts covered: kinematics, Concepts covered: kinematics, newton’s first law, second law and newton’s first law, second law and third law, resultant force, and types third law, resultant force, and types of forces.of forces.

The distracters are meant to probe The distracters are meant to probe the student’s most common the student’s most common responses based upon responses based upon ‘commonsence concept’ or ‘commonsence concept’ or misinterpretation.misinterpretation.

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Diagnostic tool to probe misconception/ Diagnostic tool to probe misconception/ common sense conceptcommon sense concept

Measure teaching effectiveness Measure teaching effectiveness (pre-test and post test)(pre-test and post test)

Design/ modify teaching strategyDesign/ modify teaching strategy

The Mechanics Baseline Test The Mechanics Baseline Test (MBT)(MBT)**

26 item multiple choice to probe 26 item multiple choice to probe understanding of mechanics.understanding of mechanics.

More quantitative and problem solving test, though its main intension is to assess qualitative understanding.

Distracters are designed to detect deficiencies in understanding rather than due carelessness or mathematical disability

* Hestenes D % Well M.(1992) The Physics Teacher 30, 159-166

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Mean score (pre test)Mean score (pre test)

Threshold: Competent – 60% Mastery – 80%

USA 27% - 52% UKM 22.4%

UK 28% - 33% UiTM 20.0%

Finland 45.7 % UPM 21.2%

Russia 46.5 %

1. Dua biji bola A dan B mempunyai saiz yang sama tetapi bola A beratnya dua kali ganda lebih berat. Bola-bola tersebut dijatuhkan serentak daripada bumbung sebuah bangunan dua tingkat. Masa yang diambil untuk bola-bola tersebut sampai ke tanah ialah:

(A) bola A mengambil masa saparuh sahaja masa yang diambil oleh bola B.

(B) bola B mengambil masa separuh sahaja masa yang diambil oleh bola A.

(C) masa diambil adalah sama.

(D) bola A lebih cepat sampai tetapi tak semestinya separuh masa yang diambil oleh bola B.

(E) bola B lebih cepat sampai tetapi tak semestinya separuh masa yang diambil oleh bola A.

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Correct answer: C

Q1Q1 AA BB CC DD EE

UPMUPM 37%37% 3%3% 15%15% 42%42% 3%3%

UKMUKM 26%26% 6%6% 12%12% 54%54% 2%2%

UiTMUiTM 31%31% 7%7% 11%11% 48%48% 3%3%

D – heavier object moves faster

6. Rajah di sebelah menunjukkan suatu saluran tanpa geseran dalam bentuk separa bulatan yang berpusat pada “O”. Saluran ini dilekatkan pada permukaan meja mendatar tanpa geseran. Anda sedang melihat dari atas. Sebiji bola memasuki saluran dengan kelajuan tinngi. Arah laluan manakah dalam rajah di atas yang akan dilalui oleh bola apabila keluar dari saluran.

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Correct answer: B

Q6Q6 AA BB CC DD EE

UPMUPM 44%44% 42%42% 8%8% 3%3% 2%2%

UKMUKM 41%41% 42%42% 6%6% 9%9% 2%2%

UiTMUiTM 35%35% 47%47% 9%9% 4%4% 5%5%

The Force Concept Inventory (FCI)The Force Concept Inventory (FCI)

4. Bayangkan suatu perlanggaran secara berdepan diantara sebuah lori balak dan sebuah kereta Kancil. Sewaktu perlanggaran.

(A) lori mengenakan daya yang lebih besar terhadap kereta berbanding dengan daya kereta terhadap Iori.

(B) kereta mengenakan daya yang lebih besar terhadap lori berbanding dengan daya lori terhadap kereta.

(C) tiada daya yang kenakan oleh lori terhadap kereta dan sebaliknya; kereta menjadi remuk kerana ianya menjadi penghalang kepada pergerakan lori.

(D) lori mengenakan daya terhadap kereta tetapi kereta tidak mengenakan daya terhadap lori.

(E) lori dan kereta masing-masingnya mengenakan daya yang sama magnitudnya.

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Q 15Q 15 AA BB CC DD EE

KSUKSU 22%22% 9%9% 60%60% 9%9% 0%0%

UPMUPM 7%7% 22%22% 56%56% 15%15% 1%1%

Correct answer: A

KSU – Kansas State University: Rebello N S & Zollman D A (2004). Am J Phy, 72(1)

B: heavier object exerts more forceC: no force by heavy object – no motion

The Force Concept Inventory (FCI)The Force Concept Inventory (FCI)

Sebuah lori mengalami kerosakan dan menerima tolakan dari belakang oleh sebuah kereta kecil untuk menghantarnya ke bandar. Sewaktu kereta kecil tersebut menolak lori dan memecut untuk mencapai kelajuan seragam;

(A) daya tolakan yang dikenakan oleh kereta terhadap lori adalah sama dengan daya lori menolak kereta.

(B) daya tolakan yang dikenakan oleh kereta terhadap lori adalah lebih kecil berbanding dengan daya lori menolak kereta.

(C)daya tolakan yang dikenakan oleh kereta terhadap lori adalah lebih besar berbanding dengan daya lori menolak kereta.

(D) oleh kerana enjin kereta hidup, maka ia mengenakan tolakan terhadap lori tetapi lori tidak mengenakan tolakan terhadap kereta kerana enjin lori tidak dihidupkan. Lori tersebut ditolak hanyalah kerana ia mengganggu laluan kereta.

(E) tidak ada daya dikenakan oleh kereta dan oleh lori. Lori tersebut ditolak hanyalah kerana ia mengganggu laluan kereta.

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Q 27Q 27 AA BB CC DD EE

KSUKSU 51%51% 3%3% 39%39% 2%2% 4%4%

UPMUPM 27%27% 40%40% 21%21% 8%8% 4%4%

Correct answer: A

KSU – Kansas State University: Rebello N S & Zollman D A (2004). Am J Phy, 72(1)

B: car exerts more force because forward motionC: heavy object exerts more force

Sebiji bola yang agak berat disambungkan kepada sautas tali dan diputarkan pada satah yang mendatar seperti yang ditunjukkan dalam gambarajah di sebelah. Pada titik yang ditunjukkan di dalam gambarajah, tali tersebut putus. Jika peristiwa ini di lihat daripada atas, tentukan laluan yang diikuti oleh bola apabila putusnya tali tersebut.

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

34%41%

6%

8%

11%

Universiti Putra Malaysia

KSU – Kansas State University: Rebello N S & Zollman D A (2004). Am J Phy, 72(1)

Sebiji bola terjatuh daripada bahagian kargo sebuah kapalterbang sewaktu kapalterbang tersebut terbang dalam arah mendatar. Laluan manakahdalam gambarajah di bawah yang paling tepat sekali bagi mewakili pergerakan bola tersebut jika dilihat oleh pemerhati pegun yang sedang berdiri di permukaan bumi?

The Force Concept Inventory (FCI)The Force Concept Inventory (FCI)

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

66%20%

4%

9%

0%

Universiti Putra Malaysia

KSU – Kansas State University: Rebello N S & Zollman D A (2004). Am J Phy, 72(1)

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

0.190.1936%36%21%21%UPM1UPM1

0.080.0828.5%28.5%22.4%22.4%UKMUKM

0.020.0222%22%20%20%UiTMUiTM

GainGainPost-testPost-testPre-testPre-testMean scoreMean score

FCI gain=Posttest % - pretest %

100 – pretest %

Hake (1998). Am J Phy 66, 64-74

Low gain g < 0.3Medium gain g > 0.3High gain g > 0.7

POST-TEST vs POST-TEST

UPM2UPM2 20%20% 23%23% 0.040.04

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

POST-TEST vs POST-TEST

1. Hake (1998). Am J Phy 66.2. Pearce & Roux 3. Savinainen & Scott (2002). Phy Edu 37(1).

Interactive engagement more effective compared to traditional lecture to convey conceptual understanding

FCI GainFCI Gain TraditionalTraditional InteractiveInteractive

USAUSA11 0.230.23 0.480.48

South AfricaSouth Africa22 0.040.04 0.230.23

FinlandFinland33 -- 0.570.57

It is very difficult to change an established mental model substantially.

For most students, reading and listening to lectures, are ineffective to change their mental models or removing the misinterpretation.

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

UKM Q1 correct answer C

1219

54

45

0

10

20

30

40

50

60

1

score

freq

UiTM Q1 correct answer C

12

48 47

11

0

10

20

30

40

50

60

1

correct answer is C

freq

Q1 UPM2 correct answer C

27

16

3741

26

39

0

10

20

30

40

50

1

answer

freq

Q1 UPM 1 correct answer C

37

25

13

4145

30

0

10

20

30

40

50

1

answer

freq

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Q6 UKM

4144 42

38

0

10

20

30

40

50

1

Correct answer B

freq

Q6 UiTM

3439

48 46

0

10

20

30

40

50

60

1

correct abswer B

freq

Q6 UPM 1

45

2

41

89

0

20

40

60

80

100

1

correct answer B

freq

Q6 UPM2

29

4244

60

0

10

20

30

40

50

60

70

1

freq

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

QUESTION NO 1 2 3 4 5 6 7 8 9 10

%of corr. ans.(PRE) 0.16 0.10 0.25 0.09 0.29 0.42 0.45 0.16 0.20 0.18

%of corr. ans.(POST) 0.37 0.20 0.45 0.10 0.43 0.60 0.64 0.26 0.28 0.38

UP / DOWN 0.21 0.10 0.20 0.00 0.14 0.18 0.18 0.11 0.08 0.20

                     

Highest incorrect (PRE) 0.41 0.31 0.41 0.82 0.38 0.44 0.39 0.38 0.29 0.51

Popular wrong ans.(PRE) D,A B,D B A C A A A B,C D

Popular wrong ans.(POST) A,D D B A B A A A B D

Highest incorrect (POST) 0.27 0.25 0.29 0.82 0.20 0.29 0.25 0.48 0.39 0.4311 12 13 14 15 16 17 18 19 20

0.07 0.29 0.02 0.04 0.05 0.48 0.11 0.05 0.49 0.12

0.11 0.49 0.01 0.12 0.11 0.51 0.17 0.20 0.45 0.24

0.04 0.21 -0.01 0.07 0.06 0.04 0.06 0.15 -0.04 0.13

                   

0.39 0.51 0.59 0.62 0.55 0.32 0.58 0.36 0.24 0.51

C,B C B A C C A D,E C C

C C C,B A C C A D C C

0.42 0.39 0.50 0.65 0.65 0.39 0.64 0.49 0.26 0.42

QUESTION NO

%of corr. ans.(PRE)

%of corr. ans.(POST)

UP / DOWN

 

Highest incorrect (PRE)

Popular wrong ans.(PRE)

Popular wrong ans.(POST)

Highest incorrect (POST)

Not the true picture?

Good grades in semester exams may not necessary good understanding of the concept

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Good grades in semester exams may not necessary good understanding of the concept

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Pearce & Roux (Uni Cape Town)Exam (75%), pretest (33%), posttest (50%)Exam (54%), pretest (13%), posttest (20%)

Subject coverage?Is it language problem?Seriousness of respondance

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

The effect of distracters

Rebello N S & Zollman D A (2004). Am J Phy, 72(1)

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

The effect of distracters

Rebello N S & Zollman D A (2004). Am J Phy, 72(1)

A B C D E

51% 3% 39% 2% 4%

3% 9% 32% 43% 10%

Question 27

The Force Concept Inventory The Force Concept Inventory (FCI)(FCI)

Conclusion

FCI provide detailed information on the strength and weakness of students understanding of the force concept. This can be used to monitor students learning and evaluate teaching effectiveness.