03/17/1503/17/15

RESEARCH IN RESEARCH IN INFORMATION SYSTEMS INFORMATION SYSTEMS

MANAGEMENTMANAGEMENT(IMS 603)(IMS 603)

Topic 4:Topic 4:Research DesignResearch Design

03/17/1503/17/15

What is Research Design?What is Research Design?

Is the plan and structure of Is the plan and structure of investigation so conceived as to investigation so conceived as to obtain answers to research questions.obtain answers to research questions.The design is a plan for selecting The design is a plan for selecting the sources and types of information the sources and types of information used to answer the research used to answer the research question.question.It is a framework for specifying the It is a framework for specifying the relationship among the study’s relationship among the study’s variablesvariables

03/17/1503/17/15

What is Research Design?What is Research Design?

Is the plan and structure of Is the plan and structure of investigation so conceived as to investigation so conceived as to obtain answers to research questions.obtain answers to research questions.It is a blueprint that outlines each It is a blueprint that outlines each procedure from the hypotheses to the procedure from the hypotheses to the analysis of data. analysis of data.

03/17/1503/17/15

What is Research Design?What is Research Design?

The design module described what The design module described what you are going to do in technical you are going to do in technical terms.terms.Provide information such as sample Provide information such as sample selection and size, data collection selection and size, data collection method, instrumentation, procedures, method, instrumentation, procedures, and ethical requirements.and ethical requirements.

03/17/1503/17/15

Research DesignResearch DesignP

RO

BL

EM

ST

AT

EM

EN

T

Purpose of Study

•Exploration

•Description

•Testing

Types of Investigation

•Relationship

•Correlation

•Group differences

Unit of Analysis

•Individual

•Dyads

•Groups

•Organizations

Sampling Design

•What/Who?

•How many?

Study Setting

•Contrived

•Noncontrived

Researcher Interference

•Minimal

•Manipulation/ control/ simulate

Time Horizon

•Cross-sectional

•Longitudinal

Measurement

•Items

•Scaling

•Categorizing

•Coding

Data Collection

•Observation

•Interviews

•Physical

•Unobstrusive

DA

TA

AN

AL Y

SIS

• Fee

l f o

r d a

ta

• Goo

dnes

s of

da t

a

• Tes

ting

03/17/1503/17/15

What data to collect?What data to collect?

Issue of measurement:Issue of measurement:

Measurement must be Measurement must be validvalid and and reliablereliable

Source:Source: LiteratureLiterature Self-developSelf-develop

03/17/1503/17/15

MeasurementMeasurement

““Development of science is nothing Development of science is nothing but the development of measurement”but the development of measurement”

““Whenever you can, count”Whenever you can, count”

““Everything that countsEverything that counts

should be counted” should be counted”

03/17/1503/17/15

MeasurementsMeasurementsEmpirical research often implies measurementsEmpirical research often implies measurementsQuality of information depends on the Quality of information depends on the measurement processmeasurement processMeasurement Defined: Measurement Defined: The mapping of some propertiesThe mapping of some properties Rules for assigning numbers to empirical propertiesRules for assigning numbers to empirical properties Rules: specify the procedure according to which Rules: specify the procedure according to which

numbers are to be assigned to objectsnumbers are to be assigned to objects

03/17/1503/17/15

Working DefinitionsWorking Definitions MeasurementMeasurement is a process through which the is a process through which the

kind or intensity of something is determined: i.e. kind or intensity of something is determined: i.e. measurement is measurement is the process of linking abstract concepts to empirical the process of linking abstract concepts to empirical

indicants.indicants.

DimensionalityDimensionality refers to the number of different refers to the number of different qualities inherent in a theoretical concept.qualities inherent in a theoretical concept.

A A conceptconcept is a general idea referring to a is a general idea referring to a characteristic of an individual, group, or a nation.characteristic of an individual, group, or a nation.

03/17/1503/17/15

Working DefinitionsWorking Definitions

Example: Example: •The Theoretical Concept: The Theoretical Concept: Social StatusSocial Status•Dimensions:Dimensions: Occupational Prestige, Occupational Prestige, Ethnicity, Popularity, Educational Ethnicity, Popularity, Educational Prestige, Financial Resources, and so on.Prestige, Financial Resources, and so on.

03/17/1503/17/15

How are Variables Measured?How are Variables Measured?

Objective – precise measurementObjective – precise measurementSubjective – nebulous & abstract; e.g. Subjective – nebulous & abstract; e.g. attitude, beliefs, involvement, attitude, beliefs, involvement, satisfactionsatisfactionConcept of Concept of “Thirst”“Thirst”Process of reducing abstract concept to Process of reducing abstract concept to measurable items is called measurable items is called OperationalizationOperationalization

03/17/1503/17/15

OperationalizationOperationalization

Concept

Operational Definition

Dimensions

A generalized idea about a class of objects, attributes, occurrences, or processes e.g. sex, loyalty

Gives meaning to a concept by specifying the activities or operations necessary to measure it

Elements

Broad characteristics to ensure coverage or scope of the concept

Specific items about the identified measurement, which are easily measured

03/17/1503/17/15

Operationalizing: LearningOperationalizing: Learning

Learning

Understanding Retention Application

Answer questions correctly

Give appropriate examples

Recall material

after some lapse

Solve problems applying concepts

understood and recalled

Integrate with other relevant material

e e e e e

d d d

03/17/1503/17/15

Operationalizing: MotivationOperationalizing: MotivationAchievement Motivation

Driven by work

Unable to relax

Impatience with ineffectiveness

Constantly working

Reluctance to take time off

e

d

Seeks moderate challenges

Seeks feedback

Persist despite

setbacks

Work at home

No hobby

Swears at small

mistakes

Does not like to work with incompetent

people

Opt for challenging not routine

Opt for moderate

rather than overwhelming

challenge

Ask for feedback about job

done

Wants immediate feedback

03/17/1503/17/15

Operational definition is Operational definition is NOTNOT

Correlate Correlate

Antecedents Antecedents

ConsequencesConsequences

ReasonsReasons

… … of the conceptof the concept

03/17/1503/17/15

ScalesScales

A tool or mechanism by which A tool or mechanism by which individuals are distinguished on how individuals are distinguished on how they differ from one anotherthey differ from one another

E.g. how do we distinguish individual E.g. how do we distinguish individual A from B in terms of learning?A from B in terms of learning?

Also refers to level of measurementAlso refers to level of measurement

03/17/1503/17/15

Levels Of MeasurementsLevels Of Measurements

Empirical Scale

Basic Operations

Measures of Typical use

Averages

Nominal Determination of equality

Classification Male-Female Occupations

Mode

Ordinal Determination of greater or less

Ranking Preference Attitude

Median

Interval Determination of equality of intervals

Index numbers Temperature

Mean

Ratio Determination of equality of ratios

Sales Unit produced No. of customers

Mean Geometric

03/17/1503/17/15

Nominal ScaleNominal Scale

Classificatory or Categorical

e.g. Sex – Male/Female

Colour

Mutually exclusive & collectively exhaustive

03/17/1503/17/15

Ordinal ScaleOrdinal Scale

Categorize and ranke.g. Preference in job attributes

Please rank from 1 most important to 5 least important the following attributes:

Interacting with others

Using multiple skills

Completing a task from beginning to end

Serving others

Work independently

03/17/1503/17/15

Interval ScaleInterval ScaleAllows for measurement of distance between two points on the scale

e.g. Preference in job attributes Using a scale of 1 (strongly disagree), 2 (disagree), 3 (neither agree nor disagree), 4 (agree) and 5 (strongly agree), please indicate the extent of your agreement by circling the appropriate number.

The following are very important to me

Interacting with others 1 2 3 4 5

Using multiple skills 1 2 3 4 5

Complete a task from beginning to end 1 2 3 4 5

Serving others 1 2 3 4 5

Working independently 1 2 3 4 5

03/17/1503/17/15

Ratio ScaleRatio Scale

Has absolute zero; thus allowing for not only differences but also proportions in the differences

e.g. Number of years in the organization

03/17/1503/17/15

Properties of the 4 ScalesProperties of the 4 Scales

Characteristics

Difference Order Distance Unique Origin

Measure of Center

Measure of Dispersion

Scale

Nominal

Ordinal

Interval

Ratio

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Mode

Median

Mean

Arithmetic &Geometric

mean

Semi-interquartile

range

Standard deviation

Standard deviation, Coefficient of variation

03/17/1503/17/15

Scaling MethodsScaling MethodsRating Scales

•Dichotomous Scale

•Category Scale

•Likert scale

•Numerical Scale

•Semantic Differential Scale

•Itemized rating scale

•Graphic rating scale

Ranking Scales

•Paired Comparison

•Forced Choice

•Comparative Scale

03/17/1503/17/15

Examples: Rating ScaleExamples: Rating Scale

Likert

Do you own a car Yes NoDichotomous

Where do you stay Kedah Penang

Perlis

Category

My work is very interestingMy work is very interesting

Strongly agreeStrongly agree

AgreeAgree

Neither agree nor disagreeNeither agree nor disagree

DisagreeDisagree

Strongly disagreeStrongly disagree

03/17/1503/17/15

Examples: Rating ScaleExamples: Rating ScaleHow would you rate your work partners

Responsive __ __ __ __ __ __ __ Unresponsive

Semantic Differential

Numerical Rating Scale

How please are you with your insurance agent

Extremely Extremely

Pleased __ __ __ __ __ __ __ displeased

Itemized Rating Scale

Very netiher unlikely Very

Likely likely nor likely unlikely unlikely

1 2 3 4 5

I will be changing my job within the next 3 months __

I will take on new assignment in the near future __

03/17/1503/17/15

Examples: Rating ScaleExamples: Rating Scale

Graphic Rating Scale

On a scale of 1 to 10 how would you rate your supervisor

1 Very bad

5 all right

10 Excellent

03/17/1503/17/15

Examples: Ranking ScaleExamples: Ranking Scale

When comparing a small number of objects, respondents are asked to choose between two objects at a time

Paired Comparison

Forced Choice

Rank your preferences among the following magazines, which you would like to subscribe to, 1 being the most preferred choice and 4 being the least preferred:

Asiaweek __

Economist __

Fortune __

Newsweek __

03/17/1503/17/15

Examples: Ranking ScaleExamples: Ranking Scale

Comparative Scale

In a volatile financial environment, compared to stocks, how wise or useful is it to invest in bonds? Please circle the appropriate response.

More usefulMore useful About the sameAbout the same Less usefulLess useful

11 22 33 44 55