Summary information

Study title

Programme for the International Assessment of Adult Competencies (PIAAC), English Pilot Study on Non-Cognitive Skills

Creator

Organisation for Economic Co-operation and Development (OECD)

Study number / PID

ZA6940, Version 1.0.0 (GESIS)

10.4232/1.13062 (DOI)

Data access

Information not available

Series

Not available

Abstract

This online survey was designed to test the measurement properties of nine personality scales – the Big Five, Traditionalism, Self-Control, Self-Efficacy, Honesty/Integrity, Socio-Emotional Skills, Intellectual Curiosity, Job Orientation Preferences and Vocational Interests. Eight of these nine scales are existing scales (or combinations of scales) available for use in public domain. The scale assessing socio-emotional skills was developed by an expert group. The complete formulations of items from all the scales including the different forms/test conditions of the scales are presented in the data documentation. Simplified scales Based on the work of members of the expert group, simplified versions of original scales were developed (see data documentation). This was done in order to make the wording of the original scales more appropriate for use with general adult population (in many cases the original items were perceived as possibly too complex and abstract for less literate members of general population). Not all items have simplified versions since in some cases the original formulations were seen by the expert group as suitable for the target population. This is especially the case in the Job Orientations, Integrity/Honesty and Vocational Interests’ scales as well as the entire Intellectual Curiosity scale. In total, there are 174 original items and 130 simplified or reversed versions of the items. Neutral/middle point In addition to comparing scales containing the original and simplified items, the second main design feature of this online survey was the use of a neutral/middle point in the Likert scales (agree/disagree). In particular, there were two versions of each original and simplified scale – one with 5 agree/disagree response options, including a “neither agree nor disagree” neutral/middle category and another with 4 response options, which did not include the option of “neither agree nor disagree”. This was done in order to see which of the two...
Read more

Methodology

Data collection period

06/2016 - 07/2016

Country

United Kingdom, United States of America

Time dimension

Cross-section

Analysis unit

Not available

Universe

Not available

Sampling procedure

Non-probability: Quota
Non-probability Sample: Quota Sample Around 8,000 complete responses were collected in the first phase and around 2,000 in the second phase. Some 25% of respondents were excluded from the data base after failing to meet various quality control criteria - country of residence, age, testing time, ability test, consistency of answers, and answers on quality control questions. Thus, in the final sample there are 4,957 US respondents 953 UK respondents in the first phase and additional 1,606 US respondents in the second phase. The sample was a convenience sample and is unrepresentative of the populations of the US and UK. Quotas were used to ensure a gender, age and regional distribution that broadly represented census data in the US and UK. These desired gender distribution was not achieved as there are somewhat more women than men in both the US and UK samples. Survey implementation The survey was conducted in two phases: In the first phase, each respondent was randomly assigned to one of the four test conditions (as indicated above, Socio-emotional skills and Vocational interest scales have slightly modified test conditions): Condition A: Original scales with neutral response option Condition B: Original scales without neutral response option Condition C: Simplified scales with neutral response option Condition D: Simplified scales without neutral response option Apart from the nine personality scales, all other scales were assigned to all respondents, including the ability test which was administered as the last scale in the survey. In the second phase, three groups of respondents (around 500 in each group) were administered different sets of personality scales under all four test conditions. In particular, the first group of respondents were assigned the Big Five questionnaire with 60 items in four conditions, representing 240 items in total (plus all other additional variables and ability test). The second group were administered the Traditionalism, Self-Control, Self-Efficacy and Socio-Emotional skills scales (54 items) in all four conditions (216 items in total). The third group was administered the Integrity/Honesty, Job orientations and Vocational Interests scales (54 items) in all four conditions as (216 personality items). The second phase was added to the project in order to complement the between-subject design of the first phase with a within-subject design, in order to identify scale and item properties across different conditions in a more straightforward manner.

Kind of data

Not available

Data collection mode

Self-administered questionnaire: Web-based (CAWI)
Self-administered questionnaire: CAWI (Computer-Assisted Web Interview)The survey was conducted online. The Survey was implemented using the Survey Monkey platform.

Access

Publisher

GESIS Data Archive for the Social Sciences

Publication year

2018

Terms of data access

C - Data and documents are only released for academic research and teaching after the data depositor's written authorization. For this purpose the Data Archive obtains a written permission with specification of the user and the analysis intention.

Related publications

Not available