LECTURE 4: SCALES AND QUESTIONNAIRES

Co-lab

NJIT

LECTURE 4: SCALES AND QUESTIONNAIRES

NOMINAL LEVEL

ORDINAL

INTERVAL

RATIO

LEVELS OF MEASUREMENT AND SCALES

ORDINAL LEVEL: THE LIKERT- TYPE SCALE

EXAMPLE OF A LIKERT SCALE

An INTERVAL level scale

Example of a semantic differential scale

The "RATIO" level of measurement

“Items” and Scales

CONSTRUCTING VALID AND RELIABLE SCALES

Example of a Lickert Scale

Second “negative” statement

Positive Items in sample 4- item scale

SCORING:

Validating Scales

PAIRED COMPARISONS

THURSTONE’S METHOD OF SCALE VALIDATION

THURSTONE’S METHOD OF SCALE VALIDATION

THURSTONE’S METHOD OF SCALE VALIDATION

The "Q-sort"

OTHER METHODS OF SCALE VALIDATION

STATISTICAL METHODS OF SCALE VALIDATION

USING A PRETEST AND STATISTICAL METHODS

USING A PRETEST AND STATISTICAL METHODS, CON’T

Item Response Scores

Item Response Scores

STATISTICAL VALIDATION

Examples of Scale Development for Information Systems Evaluation

BAILEY & PEARSON- USER SATISFACTION SCALE

B. Weighting Factors

C. Measuring Factors

Sample Scale- DEFINITION:

SAMPLE SCALE: 5 ITEMS (QUESTIONS)

D. Validating Scales

DESIGNING QUESTIONNAIRES

PARTS OF A QUESTIONNAIRE

THE INTRODUCTION

THE INTRODUCTION

PRESENTING YOURSELF

APPEARANCE AND INTERVIEWER BEHAVIOR

APPEARANCE AND INTERVIEWER BEHAVIOR

2. EXPLAINING SPONSORSHIP AND PURPOSE

2. EXPLAINING SPONSORSHIP AND PURPOSE

3. EXPLAINING SELECTION OF THE RESPONDENT--

SAMPLE EXPLANATIONS OF PURPOSE

SUMMARY: EXAMPLE OF INTRODUCTION

THEN FIRE THE FIRST QUESTION...

THE FIRST QUESTION

THE FIRST QUESTION

DATA COLLECTION:

RULES FOR QUESTION WORDING

1. SIMPLE WORDS

2A. TRADE-OFF BETWEEN EXCESSIVE LENGTH AND DIFFICULT WORDS

POSSIBLE COMPROMISE--

2B. QUESTION MAY ALSO BE TOO CRYPTIC

3. VAGUE QUESTIONS

VAGUE QUESTION- REVISION:

PROBLEM:

4. QUESTIONS MAY BE TOO SPECIFIC HOWEVER...

5. BIASED QUESTIONS--

B. BIAS DUE TO INCOMPLETE CATEGORIES

C. BIAS DUE TO UNBALANCED CATEGORIES:

6. DOUBLE QUESTIONS

7. DOUBLE NEGATIVES

8. CATEGORIES MUST BE EXHAUSTIVE AND MUTUALLY EXCLUSIVE

REVISION:

B. NOT MUTUALLY EXCLUSIVE (COULD CHECK MORE THAN ONE)

9. QUESTIONS THE RESPONDENT CANNOT HONESTLY ANSWER

PP Presentation

9. QUESTIONS THE RESPONDENT CANNOT HONESTLY ANSWER

B. HYPOTHETICAL SITUATIONS

10. OBJECTIONABLE QUESTIONS

ASKING OBJECTIONABLE QUESTIONS

ASKING OBJECTIONABLE QUESTIONS

ASKING OBJECTIONABLE QUESTIONS

THE WHOLE NOTES OF LECTURE 4