A Construct Validation of the Kilos at Kalooban ng Mag-aaral (KKM) in a Public

High School in Quezon City

Maxine Joyce T. Pinson

Arsenio Sze Alianan, Jr.

Kilos at Kalooban ng Mag-aaral

• Developed to measure factors that would

hinder students’ performance

• Test development: etic and emic approaches

• Two validity scales and 8 problem scales

• Six subscales patterned after the syndrome

scales of the Youth Self Report (YSR; Achenbach &

Rescorla, 2001)

KKM YSR

Nerbyos (NB) Anxiety

Kalungkutan (KL) Depression

Paglabag sa Panuntunan (PN) Rule-breaking Behaviors

Marahas na Kilos (MK) Aggressive Behaviors

Problema sa Pag-iisip (PI) Thought Problems

Problema sa Pag-pokus (PO) Attention Problems

Di-wastong Pag-kain (PK) -

Kalagayan ng Tahanan (KT) -

Di-pangkaraniwang Sagot

(K1)

-

Pagpapakitang-tao (K2) -

Internalizing Behaviors

Nerbyos (NB)

•6 items

•Feelings, thoughts, and behavioral manifestations that are

experienced as a result of anxiety

Kalungkutan (KL)

•9 items

•Feeling sad, crying, loss of hope, and thoughts of suicide

and self-harm

Externalizing Behaviors

Paglabag sa Panuntunan (PN)

•12 items

•Behaviors that are prohibited in school (tardiness, truancy

and absenteeism, cheating, smoking, drinking alcohol,

using illicit drugs, vandalism, gambling, theft)

Marahas na Kilos (MK)

•11 items

•Intentionally inflicting physical and emotional harm on

others; giving threats and retaliating

Executive Function Scales

Problema sa Pag-iisip (PI)

• 14 items

• Seen in people who may be experiencing

psychosis (hearing voices, seeing things or

people that others cannot hear and/or see,

lethargy, confused states, display of strange

behaviors)

Executive Function Scales

Problema sa Pag-pokus (PO)

•12 items

•Inability to stay still, listen to teachers, and finish

schoolwork; acknowledgement of rowdy behaviors

and attitude of indifference to teachers as well as

to one’s studies

External Factors

Di-wastong Pag-kain (PK)

•11 items

•The acknowledgement of insufficient, untimely, and

unhealthy food consumption. This also includes the youth's

perception of his/her health

Kalagayan ng Tahanan (KT)

•10 items

•A complete and peaceful home environment;

acknowledgement of the help and support provided by the

parents in the students’ education

Aim of the Study

Test the latent structure of the constructs measured by the KKM

Sample

• 821 students (52% males)

• Age: 12 to 22 years (M=14, SD=1.60)

Freshmen N = 234 (28%)

Sophomores N= 240 (29%)

Juniors N = 168 (21%)

Seniors N = 179 (22%)

Measure

Kilos at Kalooban ng Mag-aaral (KKM)

• 99 items, self-report

• 4-point Likert scale

• (0=hindi nangyayari; 3=palagi)

NB α = .69 PI α = .76 K1 α = .71

KL α = .80 PO α = .78 K2 α = .72

PN α = .71 PK α = .76

MK α = .80 KT α = .78

Data Analysis

Confirmatory Factor Analysis (CFA)

• Mplus 6.12

• Maximum likelihood with robust standard errors (MLR)

χ2 Test of Model Fit p ≥ .05

RMSEA ≤ .08

CFI ≥ .90

SRMR < .08

CFA Results

Internalizing Behaviors (NB, KL)

χ2 (89) = 267.72, p < .05

RMSEA = 0.05

CFI = 0.91

SRMR = 0.04

Factor covariance = .65

Factor loading = .33 to .69

CFA Results

Externalizing Behaviors (PN, MK)

χ2 (229) = 672.97, p < .01

RMSEA = 0.05

CFI = 0.78

SRMR = 0.06

Model modifications:

• Added 5 error covariances

• Deleted items 6 (PN), 18 (MK), 27 (PN)

CFA Results Externalizing Behaviors (PN, MK)

χ2 (164) = 318.46, p < .05

RMSEA = 0.03

CFI = 0.90

SRMR = 0.05

Reliability coefficients:

PN α = .68

MK α = .80

Factor covariance = .66

Factor loading = .33 to .67

CFA Results

Executive Function Scales (PI, PO)

χ2 (298) = 804.53, p < .05

RMSEA = 0.05

CFI = 0.81

SRMR = 0.05

Model modifications:

• Added 4 error covariances

CFA Results Executive Function Scales (PI, PO)

χ2 (294) = 569.46, p < .05

RMSEA = 0.03

CFI = 0.90

SRMR = 0.05

Reliability coefficients:

PI α = .76

PO α = .78

Factor covariance: .51

Factor loading = .30 to .64

CFA Results

External Factors (PK, KT)

χ2 (188) = 1564.30, p < .05

RMSEA = 0.09

CFI = 0.61

SRMR = 0.09

Model modifications:

• Added 3 error covariances

• Deleted items 23, 33, 42, 51 (PK)

CFA Results External Factors (PK, KT)

χ2 (115) = 244.71, p < .05

RMSEA = 0.04

CFI = 0.95

SRMR = 0.05

Reliability coefficients:

PK α = .78

KT α = .78

Factor covariance: -.29

Factor loading = .27 to .75

In Summary

• Model specifications were done to achieve adequate to good model fit

• Significant parameter estimates for each factor the items were designed to measure

• Items had zero loadings on other factors

Discussion

• Results provide initial evidence of the construct validity of the KKM

• Highlights construct-related evidence of the 4-factor structure of the KKM

– Internalizing Behaviors

– Externalizing Behaviors

– Executive Functions

– External Factors

Significance & Implications

• Evidence for a new locally made tool for

adolescents

• Practical Implications in the use of the measure −Community mental health

−Education and social work

−Outcome studies and program evaluation

−Research on Filipino Adolescents

Limitations and Future Directions

• Sampling method

• Self-report

• Error covariances

Use a more diverse and representative sample

Gather data from multiple informants

Item-weighting for items with error covariances

Establish cut-off scores for the 2 validity scales

Other evidences of validity: criterion-related

evidence and predictive validity

Thank you.