Module 3 Arm
Module 3 Arm
Module 3
Scales of Measurement & Data Processing
Scaling
The word scale or scaling is generally used for indicating measurements or measuring
something. Many aspects of social phenomena like emotion, attitude, faiths etc. are
not measurable directly. They are not quantitative in nature.
In social phenomena there are two types of variables- quantitative and qualitative.
Measurement or scaling implies conversion of qualitative data into quantitative data
and then measuring them. Various kinds of statistical measurements are used for this
purpose. Scaling is an attempt to bring about greater accuracy which is desired in both
physical and social sciences.
Scales: Scales are devised for measuring variable in social science research. Scaling is
the procedure for determining the quantitative measure of abstract concepts like
leadership style, brand image of product etc. It is therefore,
a. Any series of items which is progressively arranged according to value or
magnitude into which an item can be placed according to its quantification.
b. A continuous spectrum or series of categories.
c. Used to represent, usually quantitatively, an items or persons place in
that spectrum.
1. Nominal scales
2. Ordinal scales
3. Interval scales
4. Ratio scale
5. Other type of Scales
1. Nominal Scale: Numbers or letters assigned to objects which serve as labels for
identification or classification. They are Scales “in name only”.
2. Ordinal Scale: Arranges objects or alternatives according to their magnitude in
an ordered relationship. eg rating career opportunities as excellent, good,
average poor or very poor.
3. Interval Scale: Interval scales not only indicate order, they also measure order
2. Ranking Scales: Ranking scales are identical to rating scales. In ranking scales,we
make relative the score will place judgments against other similar objects. There
are two generally used approaches of ranking scales namely.
Method of Paired Comparison where the respondent can express his attitude by
making a choice between two objects.
Method of Ranking Order where the respondents are asked to rank their
choices.
3. Attitude Scales: In this type of scale, the attitude of an individual towards a matter
can be known from the score of his responses given on a questionnaire. The score
will place him in a scale. He simply expresses his likes or dislikes, agreement or
disagreement with the issue involved as given in the forms of questions. On the
basis of reply, he is assigned a score which indicates his position. In the attitude
scale some relevant statements are to be considered by the respondents. The
statements are found in such a way as to be intimately related to the attribute
which is sought to be measured.
4. Factor Scaling: This is a type of scaling in which multi dimensions of a complex
attitude is identified.
5. Sociometry: Sociometry is a qualitative method for measuring social
relationships. It was developed by psychotherapist Jacob L. Moreno and Helen
Hall Jennings in their studies of the relationship between social structures and
psychological well-being, and used during Remedial Teaching. Sociometry:
Preschool and elementary school teachers use Sociometry rating scales to measure
how a child is accepted or rejected by his or her classmates.
“Sociometry is a way of measuring the degree of relatedness among people.
Measurement of relatedness can be useful not only in the assessment of behavior
within groups, but also for interventions to bring about positive change and for
determining the extent of change”.
6. Checklist : The Checklist is a one-page, non-technical checklist for the key points
of good practice in research. Use of the Checklist can assist researchers and
organisations in fulfilling the requirements of regulatory, funding and other bodies
and ensure that important issues have not been overlooked.
Checklist is a selected list of words, Phrases, Sentences and paragraphs
following which an observer records a check mark to denote a presence or
absence of whatever is being observed.
After creating your questionnaire, you will need to check and review the
outline of the survey, the questions being asked, and the response options for
the respondents. To test the efficiency of the questionnaire, here is a
questionnaire checklist that will serve as your guide.
The following questionnaire checklist includes three sections: the outline and
format, the questions and pre-test or pilot testing.
Sound measurement must meet the tests of validity, reliability and practicality. In fact,
these are the three major considerations one should use in evaluating a measurement
tool. Validity refers to the extent to which a test measures what we actually wish to
measure. Reliability has to do with the accuracy and precision of a measurement
procedure. Practicality is concerned with a wide range of factors of economy,
convenience and interpretability.
1) Test of Validity: Validity is the most critical criterion and indicates the degree to
which an instrument measures what it is supposed to measure. Validity can also be
thought of as utility. In other words, validity is the extent to which differences
found with a measuring instrument reflect true differences among those being
tested. Three types of validity in this connection are: (i) Content validity; (ii)
Criterion-related validity and (iii) Construct validity.
i. Content validity is the extent to which a measuring instrument provides
adequate coverage of the topic under study. If the instrument contains a
representative sample of the universe, the content validity is good. Its
determination is primarily judgemental and intuitive. It can also be determined by
using a panel of persons who shall judge how well the measuring instrument meets
the standards, but there is no numerical way to express it.
ii. Criterion-related validity relates to our ability to predict some outcome or
estimate the existence of some current condition. This form of validity reflects the
success of measures used for some empirical estimating purpose. The concerned
criterion must possess the following qualities:
a. Relevance: (A criterion is relevant if it is defined in terms we judge
to be the proper measure.) Freedom from bias: (Freedom from bias is
attained when the criterion gives each subject an equal opportunity to
score well.)
b. Reliability: (A reliable criterion is stable or reproducible.)
c. Availability: (The information specified by the criterion must be
available.)
In fact, a Criterion-related validity is a broad term that actually refers to (i) Predictive
validity and (ii) Concurrent validity. The former refers to the usefulness of a test in
predicting some future performance whereas the latter refers to the usefulness of a test
in closely relating to other measures of known validity. Criterion-related validity is
expressed as the coefficient of correlation between test scores and some measure of
future performance or between test scores and scores on another measure of known
validity.
iii. Construct validity is the most complex and abstract. A measure is said to
possess construct validity to the degree that it confirms to predicted
correlations with other theoretical propositions. Construct validity is the
degree to which scores on a test can be accounted for by the explanatory
constructs of a sound theory. For determining construct validity, we associate a
set of other propositions with the results received from using our measurement
instrument. If measurements on our devised scale correlate in a predicted way
with these other propositions, we can conclude that there is some construct
validity. If the above stated criteria and tests are met with, we may state that
our measuring instrument is valid and will result in correct measurement;
otherwise we shall have to look for more information and/or resort to exercise
of judgment.
2) Test of Reliability
The test of reliability is another important test of sound measurement. A
measuring instrument is reliable if it provides consistent results. Reliable measuring
instrument does contribute to validity, but a reliable instrument need not be a valid
instrument. Two aspects of reliability viz., stability and equivalence deserve
special mention. The stability aspect is concerned with securing consistent results
with repeated measurements of the same person and with the same instrument.
The equivalence aspect considers how much error may get introduced by
different investigators or different samples of the items being studied.
Reliability can be improved in the following two ways:
a. By standardising the conditions under which the measurement takes place
i.e., we must ensure that external sources of variation such as boredom,
fatigue, etc., are minimised to the extent possible. That will improve stability
aspect.
b. By carefully designed directions for measurement with no variation from
group to group, by using trained and motivated persons to conduct the
research and also by broadening the sample of items used. This will improve
equivalence aspect.
3) Test of Practicality
The practicality characteristic of a measuring instrument can be judged in terms of
economy, convenience and interpretability. From the operational point of view, the
measuring instrument ought to be practical i.e., it should be economical, convenient
and interpretable.
Economy consideration suggests that some trade-off is needed between the ideal
research project and that which the budget can afford. The length of measuring
instrument is an important area where economic pressures are quickly felt. Although
more items give greater reliability as stated earlier, but in the interest of limiting the
interview or observation time, we have to take only few items for our study
purpose. Similarly, data-collection methods to be used are also dependent at times
upon economic factors.
Convenience test suggests that the measuring instrument should be easy to
administer. For this purpose one should give due attention to the proper layout of
the measuring instrument. For instance, a questionnaire, with clear instructions
(illustrated by examples), is certainly more effective and easier to complete than
one which lacks these features.
Interpretability consideration is specially important when persons other than the
designers of the test are to interpret the results. The measuring instrument, in order
to be interpretable, must be supplemented by
(a) detailed instructions for administering the test;
(b) scoring keys;
(c) evidence about the reliability and
(d) guides for using the test and for interpreting results.
1. Checking: When the data is collected through questionnaires, the first steps of
data preparation process is to check the questionnaires if they are accepted or not.
Not accepted if:
Incomplete partially or fully.
Answered by a person who has inadequate knowledge.
Which gives the impression that the impression that the respondent could not
understand the questions.
2. Field Work Validation: The second step in the processing of begins post the
primary data survey. The researcher needs to validate the fieldwork to check
whether the execution of the study was handled properly. Thus, he or she must
meticulously go over all the raw data forms and check them for errors and find out
3. Editing: Editing is the process of examining the data collected through various
methods to detect errors and omissions and correct them for further analysis.
Though editing, it is ensured that the collected data are accurate, consistent with
other facts gathered, uniformly entered and well-arranged so that further analysis
is made easier Practical guidelines for editing. While editing care has to be taken
to see that the data are as accurate and complete as possible. The following points
are to be noted;
a) The editor should familiarize with the copy of instructions given to the
interviewers.
b) The original entry, if found incorrect, should not be destroyed or erased. On the
other hand, it should be crossed out in such a manner that it is still eligible.
c) Any, modification to the original entry by the editor must be specifically
indicated.
d) All completed schedules must bear signature of the editor and the date.
e) Incorrect answer to the questions can be corrected only if the editor is
absolutely sure of the answer, otherwise leave it as such.
f) Inconsistent, incomplete or missing answers should not be used.
g) Sere that all numerical answers are converted to same units.
Steps in coding
1. Study the answers carefully.
2. Develop a coding frame by listing the answers and by aligning codes to each of
them.
3. Prepare a coding manual with the detail of variable names, codes and instructions.
4. If the coding manual has already been prepared before the collection of the data,
make the required additions for the open ended and partially coded question.
Coding rules
Types of Tables
1. Simple Table: Here the data are presented only for one variable or characteristic.
Any frequency distribution of a single variable is simple table.
2. Complex table: In complex table, two or more characteristics are shown. If the
study is related to more than two variables, it is called multivariate analysis. They
may be of the following tables.
a) One- way table: In this type of table, data of only one characteristic will
be shown. It means that when one type of information is secured about
different groups or individuals, it can be displayed with the help of one-
waytable
b) Two- way table: When mutually related attributes of a phenomenon are to
be displayed, two way tables are used. In other words, this table shows two
types of characteristics.
c) Three-way table: It displays three types of attributes: It is used when
three inter- related or mutually related attributes or characteristics of a
phenomenon are to be displayed.
d) Manifold tables: When information about different mutually attributes or
characteristics of a phenomenon is to be displayed, manifold table is used.
Such tables display information about various characteristics orattributes.
pictures.
2) They make the whole data readily intelligible.
3) They can be used for comparison purpose.
4) They are useful in analyzing complex economic theories.
5) They save much time in understanding data.
6) Facts can be understood without doing mathematical calculations.
7) They help in locating statistical measures such as median. quartile, mode etc.
Types of Graphs
1) Line Graphs: A line graph displays information in a series of data points that
each represents an individual measurement or piece of data. The series of points
are then connected by a line to show a visual trend in data over a period of time.
The line is connected through each piece chronologically.
2) Bar Charts: The bar graph is a common type of graph which consists of parallel
bars or rectangles with lengths that are equal to the quantities that occur in a
given data set. The bars can be presented vertically or horizontally to show the
contrast and record information. Bar graphs are used for plotting discontinuous
(discrete) data. Discrete data contains discrete values and are notcontinuous.
Histogram: A histogram is a graph of frequency distributions. It is a set of
vertical bars whose are proportional to the frequencies. While constructing
histogram, the variable is always taken on the x- axis and the frequencies on
y-axis.
Frequency Polygon: The frequency polygon is a graph of frequency
distribution. Here we draw histogram of the data and then join by straight line
and mid points of upper horizontal sides of these bars. Join both ends of the
frequency polygon with the x- Axis.
Frequency Curves: A continuous frequency distribution can be represented by
a smoothed curve known as Frequency curves
Ogive or Cumulative Frequency Curve: A frequency distribution can be
cumulated in two ways, less than cumulative series and more than cumulative
series. Smoothed frequency curves drawn for these two cumulative series are
3) Circle Charts or Pie Diagram: A pie graph is a circle divided into sections
which each display the size of a relative piece of information. Each section of the
graph comes together to form a whole. In a pie graph, the length of each sector is
proportional to the percentage it represents. Pie graphs work. Particularly well
when each slice of the pie represents 25 to 50 percent of the given data.
Meaning of Data
Data is a collection of facts, figures, objects, symbols, and events gathered from
different sources.
Types of Data
a) Primary data
Primary data means first-hand information collected by an investigator.
It is collected for the first time.
It is original and more reliable.
For example, the population census conducted by the government of India
afterevery ten years is primary data.
b) Secondary data
Secondary data refers to second-hand information.
Sources of Data
The sources of data can be classified into two types: Statistical and Non- Statistical.
Statistical sources refer to data that is gathered for some official purposes, incorporate
censuses, and officially administered surveys. Non-statistical sources refer to the
collection of data for other administrative purposes or for the private sector.
The following are the two sources of data:
1. Internal sources
When data is collected from reports and records of the organisation itself, they
are known as the internal sources.
For example, a company publishes its annual report‟ on profit and loss, total
sales, loans, wages, etc.
2. External sources
When data is collected from sources outside the organisation, they are known
as the external sources. For example, if a tour and travel company obtains information
on Karnataka tourism from Karnataka Transport Corporation, it would be known as an
external source of data.
Data Collection
Data collection is one of the most important stages in conducting a research. You can
have the best research design in the world but if you cannot collect the required data
you will be not be able to complete your project.
a) In primary data collection: Primary data means original data that have been
collected specially for the purpose in mind. It means when an authorized organization
or an investigator or an enumerator collects the data for the first time himself or with
Structured Interviews: The interviewer asks each respondent the same series of
questions. The questions are created prior to the interview, and often have a limited set
of response categories. The interviewer plays a neutral role and acts casual and
friendly, but does not insert his or her opinion in the interview.
Telephonic Interview: Telephonic Interviewing stands out as the best method for
gathering quickly needed information. Responses are collected from the respondents
by the researcher on telephone.
Personal Interview: It is the most versatile of the all methods. They are used
when props are required along with the verbal response. Nonverbal responses can also
be observed.
Behavioral Based Interviews: Behavioral based interviews focus on a person‟s
specific past performances and experiences. Questions will predominately surround
past work experiences that can illustrate the candidate‟s competence. For these types
of interviews, the STAR system (Situation/Task, Action, and Result) may be useful
for answering questions. These four titles serve as a framework for describing work
experiences.
Case Interviews: Case questions are most commonly used in consulting
interviews. In this type of interview, the candidate is given a scenario and is tasked
with working through the details. These interviews highlight a candidate‟s analytical
ability and poise.
Informational Interviews: Informational Interviews are forums by which you can
discover the nature of the industry without performance pressure. This style of
interview allows candidates the opportunity to compare their expectations with the
position. You may have the opportunity to speak with those currently employed in
the position. Take this opportunity to discover the positive, and less positive,
aspects of the position.
In-Person (Traditional): A staple of the job application process, the traditionalin-
person, one-on-one interview is your opportunity to shine and to show a prospective
employer why they should hire you.
Phone Interview: Despite the fact that a phone interview is the least formal
method of interviewing, phone interviews can be challenging because of a candidate's
inability to sense subtle non-verbal cues, which would be otherwise obvious in an in-
person setting.
Second Interview: Being asked to return for a second interview could mean a few
different things. It might mean that you made an excellent impression, but the
prospective employer is having difficulty deciding between a few exceptionally strong
candidates.
Group or Panel Interview: A group or panel interview may be the most
challenging type of interview. This type involves being interviewed by multiple people
simultaneously. During a group or panel interview, maintain eye contact with the
speaker or the person whose question you are answering, think carefully about your
response to each question, and, if needed, ask for time to consider a question.
Depth Interview Method : They generally use small samples and also conduct
Advantages of FGD
Disadvantages of FGD
Lack of privacy/anonymity;
Having to carefully balance the group to ensure they are culturally and gender
appropriate (i.e. gender may be an issue);
Potential for the risk of „group think‟ (not allowing for other attitudes, beliefs
etc.);
Potential for group to be dominated by one or two people;
Group leader needs to be skilled at conducting focus groups, dealing with
conflict, drawing out passive participants and creating a relaxed, welcoming
environment;
Are times consuming to conduct and can be difficult and time consuming to
analyze.
4. Survey Method
Surveys provide a means of measuring a population‟s characteristics, self- reported
and observed behavior, awareness of programs, attitudes or opinions, and needs.
Repeating surveys at regular intervals can assist in the measurement of changes over
time. These types of information are invaluable in planning andevaluating government
policies and programs. Unlike a census, where all members of a population are
studied, sample surveys gather information from only a portion of a population of
interest. The size of the sample depends on thepurpose of the study.
Methods or techniques of survey method
a. Self-completion Surveys via mail, email, the internet or SMS are generally the
least expensive, particularly for a widespread sample. They allow respondents time
to consider their answers, refer to records or consult with others (which can be
helpful or unhelpful, depending on the surveys objectives). They also eliminate
interviewer errors and reduce the incidenceof selected people (or units) being
unable to be contacted.
b. Interviewer-based Surveys such as face-to-face or telephone surveys generally
allow more data to be gathered than self-completion surveys and can include the
use of more complex questionnaires. Interviewers can reduce non-response by
answering respondents‟ queries or concerns. They can often pick up and resolve
respondent errors.
c. Face-to-face surveys are usually more expensive than other methodologies. Poor
interviewers can introduce additional errors and, in some cases, the face to face
approach is unsuitable for sensitive topics.
d. Telephone surveys are generally cheaper and quicker than face-to-face surveys,
and are well suited to situations where timely results are needed. However, non-
response may be higher than for face-to-face surveys as it is harder for
interviewers to prove their identity, assure confidentiality and establish rapport.
e. Computer Assisted Telephone Interviewing (CATI) is a particular type of
telephone survey technique that helps to resolve some of the limitations of general
telephone-based surveying. With CATI, interviewers use a computer terminal.
The questions appear on the computer screen and the interviewers enter responses
directly into the computer. The interviewer‟s screen is programmed to show
7. Projective Techniques
Projective Techniques are indirect and unstructured methods of investigation which
have been developed by psychologist and use projection of respondents for inferring
about underline motives, urges or intentions which cannot be secured through direct
questioning as the respondents either resists to reveal them or is unable to figure out
himself. Examples are Word Association Test, Completion test, Construction
techniques, and Expression techniques.
8. Questionnaire Method
A questionnaire is a research instrument consisting of a series of questions and other
prompts for the purpose of gathering information from respondents. Although they are
often designed for statistical analysis of the responses, this is not always the case. The
questionnaire was invented by Sir Francis Galton (1822 - 1911). Questionnaires have
advantages over some other types of surveys in that they are cheap, do not require as
much effort from the questioner as verbal or telephone surveys, and often have
standardized answers that makeit simple to compile data.
Use statements which are interpreted in the same way by members of different
subpopulations of the population of interest.
Use statements where persons that have different opinions or traits will give
different answers.
Think of having an open answer category after a list of possible answers.
Use only one aspect of the construct you are interested in per item.
Use positive statements and avoid negatives or double negatives.
Do not make assumptions about the respondent.
Use clear and comprehensible wording, easily understandable for all
educational levels.
Use correct spelling, grammar and punctuation.
Avoid items that contain more than one question per item (e.g. Do you like
strawberries and potatoes?).
Question should not be biased or even leading the participant towards an
answer.
Advantages of Questionnaires:
Disadvantages of Questionnaires:
To be inadequate to understand some forms of information - i.e. changes of
emotions, behavior, feelings etc.
Phenomenologists state that quantitative research is simply an artificial creation
by the researcher, as it is asking only a limited amount of information without
explanation.
There is no way to tell how truthful a respondent is being.
There is no way of telling how much thought a respondent has put in.
The respondent may be forgetful or not thinking within the full context of the
situation.
People may read differently into each question and therefore reply based on
their own interpretation of the question - i.e. what is „good‟ to someone may be
poor to someone else; therefore there is a level of subjectivity that is not
acknowledged.
9. Schedule Method
A schedule contains a set of questions which are asked and filled by an interviewer in
a face to face situation with a respondent. It is a standardized device or tool of
observation to collect the data in an objective manner. In this method the interviewer
puts certain questions and the respondent furnishes certain answers and the
interviewer records them as in a research instruments called schedule.
Diaries: Diaries are personal records and are rarely available but if you are
conducting a descriptive research then they might be very useful. TheAnne
Frank‟s diary is the most famous example of this. That diarycontained the most
accurate records of Nazi wars.
Letters: Letters like diaries are also a rich source but should be checked for
their reliability before using them.
Government Records: Government records are very important for marketing,
management, humanities and social science research.
Census Data/population statistics: Health records; Educational institutes‟
records etc. Public Sector Records: NGOs‟ survey data; Other private
companies records.