Methodology Statement and Topline for iMediaEthics Poll on Transgender Use of Restrooms - iMediaEthics

iMediaEthics publishes international media ethics news stories and investigations into journalism ethics lapses.

Menu

Home » Media Polls»

(Credit:iMediaEthics image)

The poll includes telephone interviews with a nationally representative sample of 1,003 adults living in the continental United States. Telephone interviews were conducted by landline (503) and cell phone (500, including 326 without a landline phone). The survey was conducted by Princeton Survey Research Associates International (PSRAI). Interviews were done in English and Spanish by Princeton Data Source from May 5-8, 2016. Statistical results are weighted to correct known demographic discrepancies. The margin of sampling error for the complete set of weighted data is ± 3.6 percentage points.

The poll was sponsored by iMediaEthics, which designed the questions. It was funded by the Perry and Donna Golkin Foundation.

Final Topline Results

May 9, 2016

Total: 1,003 adults age 18 and older
Margin of error: plus or minus 3.6 percentage points
Quarter sample A: 251 adults age 18 and older
Margin of error: plus or minus 7.2 percentage points
Quarter sample B: 255 adults age 18 and older
Margin of error: plus or minus 7.1 percentage points
Quarter sample C: 257 adults age 18 and older
Margin of error: plus or minus 7.1 percentage points
Quarter sample D: 240 adults age 18 and older
Margin of error: plus or minus 7.3 percentage points
Quarter sample E: 224 adults age 18 and older
Margin of error: plus or minus 7.6 percentage points
Quarter sample F: 285 adults age 18 and older
Margin of error: plus or minus 6.7 percentage points
Quarter sample G: 223 adults age 18 and older
Margin of error: plus or minus 7.6 percentage points
Quarter sample H: 271 adults age 18 and older
Margin of error: plus or minus 6.9 percentage points

INTERVIEW DATES: May 5-8, 2016

LANDLINE INTRODUCTION:

Hello, my name is _________________ and I’m calling for Princeton Survey Research. We’re conducting a study about some important issues today, and would like to include your household. [RANDOMIZE RESPONDENT SELECTION: May I please speak with the YOUNGEST ADULT MALE, age 18 or older, who is now at home? (IF NO MALE AT HOME NOW, ASK: May I please speak with the YOUNGEST ADULT FEMALE, age 18 or older, who is now at home?) / May I please speak with the YOUNGEST ADULT FEMALE, age 18 or older, who is now at home? (IF NO FEMALE AT HOME NOW, ASK: May I please speak with the YOUNGEST ADULT MALE, age 18 or older, who is now at home?)]

CELL PHONE INTRO:

Hello, I am ___ calling for Princeton Survey Research. We’re conducting a study about some important issues today. [IF RESPONDENT SAYS DRIVING/UNABLE TO TAKE CALL: Thank you. We will try you another time…]

CELL PHONE SCREENING INTERVIEW:

S1. Are you under 18 years old, OR are you 18 or older? [CONTINUE IF 18 OR OLDER; ALL OTHERS TERMINATE]

READ TO ALL CELL PHONE – INTRODUCTION TO MAIN INTERVIEW: If you are now driving a car or doing any activity requiring your full attention, I need to call you back later. The first question is…

Notes: Due to rounding, percentages may not add to 100%. An asterisk (*) indicates values less than 0.5%. Volunteered responses are indicated by (VOL.).

READ TO ALL: Next…

IM1. Have you heard of the term “transgender”?

%
Yes 93
No 6
(VOL.) Don’t know *
(VOL.) Refused 0

IM2. And how well would you say that you personally understand what the term “transgender” means? [READ IN ORDER]?

%
Very well 54
Fairly well 33
Not too well 6
Not at all 5
(VOL.) Don’t know 1
(VOL.) Refused 1

IM3A. Which of the following statements comes closer to your opinion? [READ IN ORDER]?

Based on quarter sample A (n=251)

%
Transgender people should be able to use public restrooms according to the gender with which they identify 40
Transgender people should be required to use public restrooms only according to the biological sex on their birth certificate 48
(VOL.) Don’t know 8
(VOL.) Refused 5

IM3A1. If transgender people are NOT allowed to use public restrooms according to the gender with which they identify, but are REQUIRED to use public restrooms only according to their biological sex, how upset would you be… [READ IN ORDER]

Based on quarter sample A restroom according to identity (n=108)

%
Very upset 39
Somewhat upset 21
Not too upset 15
Not upset at all 21
(VOL.) Don’t know 2
(VOL.) Refused 3

IM3A2. If transgender people ARE NOT required to use public restrooms only according to their biological sex, but are ALLOWED to use public restrooms according to the gender with which they identify, how upset would you be… [READ IN ORDER]

Based on quarter sample A restroom according to birth (n=110)

%
Very upset 45
Somewhat upset 21
Not too upset 16
Not upset at all 16
(VOL.) Don’t know 1
(VOL.) Refused 1

IM3B. Which of the following statements comes closer to your opinion? [READ IN ORDER]?

Based on quarter sample B (n=255)

%
Transgender people should be required to use public restrooms only according to the biological sex on their birth certificate 34
Transgender people should be able to use public restrooms according to the gender with which they identify 46
(VOL.) Don’t know 12
(VOL.) Refused 8

IM3B1. If transgender people ARE NOT required to use public restrooms only according to their biological sex, but are ALLOWED to use public restrooms according to the gender with which they identify, how upset would you be… [READ IN ORDER]

Based on quarter sample B restroom according to birth (n=86)

%
Very upset 50
Somewhat upset 15
Not too upset 23
Not upset at all 11
(VOL.) Don’t know 1
(VOL.) Refused 0

IM3B2. If transgender people are NOT allowed to use public restrooms according to the gender with which they identify, but are REQUIRED to use public restrooms only according to their biological sex, how upset would you be… [READ IN ORDER]

Based on quarter sample B restroom according to identity (n=119)

%
Very upset 25
Somewhat upset 31
Not too upset 24
Not upset at all 15
(VOL.) Don’t know 1
(VOL.) Refused 3

IM3C. Which of the following statements comes closer to your opinion? [READ IN ORDER]?

Based on quarter sample C (n=257)

%
Transgender people should be able to use public restrooms according to the gender with which they identify 30
Transgender people should be required to use public restrooms only according to the biological sex on their birth certificate 35
Or don’t you care either way? 31
(VOL.) Don’t know 3
(VOL.) Refused 1

IM3C1. If transgender people are NOT allowed to use public restrooms according to the gender with which they identify, but are REQUIRED to use public restrooms only according to their biological sex, how upset would you be: [READ IN ORDER]

Based on quarter sample C restroom according to identity (n=79)

%
Very upset 32
Somewhat upset 27
Not too upset 20
Not upset at all 15
(VOL.) Don’t know 6
(VOL.) Refused 0

IM3C2. If transgender people ARE NOT required to use public restrooms only according to their biological sex, but are ALLOWED to use public restrooms according to the gender with which they identify, how upset would you be: [READ IN ORDER]

Based on quarter sample C restroom according to birth (n=99)

%
Very upset 50
Somewhat upset 24
Not too upset 12
Not upset at all 11
(VOL.) Don’t know 2
(VOL.) Refused 0

IM3D. Which of the following statements comes closer to your opinion? [READ IN ORDER]?

Based on quarter sample D (n=240)

%
Transgender people should be required to use public restrooms only according to the biological sex on their birth certificate 34
Transgender people should be able to use public restrooms according to the gender with which they identify 25
Or don’t you care either way? 35
(VOL.) Don’t know 4
(VOL.) Refused 2

IM3D1. If transgender people ARE NOT required to use public restrooms only according to their biological sex, but are ALLOWED to use public restrooms according to the gender with which they identify, how upset would you be: [READ IN ORDER]

Based on quarter sample D restroom according to birth (n=82)

%
Very upset 49
Somewhat upset 33
Not too upset 3
Not upset at all 10
(VOL.) Don’t know 1
(VOL.) Refused 3

IM3D2. If transgender people are NOT allowed to use public restrooms according to the gender with which they identify, but are REQUIRED to use public restrooms only according to their biological sex, how upset would you be: [READ IN ORDER]

Based on quarter sample D restroom according to identity (n=62)

%
Very upset 38
Somewhat upset 30
Not too upset 18
Not upset at all 11
(VOL.) Don’t know 3
(VOL.) Refused 0

COMBINED RESULTS OF IM3 SERIES:

PUBLIC OPINION ON WHETHER TRANSGENDER PEOPLESHOULD BE ABLE TO USE RESTROOMS

OF GENDER THEY IDENTIFY WITH

Transgender people should use public restrooms according to: FORM A/B* FORM

C/D*

% %
Gender they identify with –  respondent upset if they can’t do that 25 17
Gender they identify with – respondent not upset if they can’t do that 18 10
No opinion/Don’t care 16 38
Sex on birth certificate – respondent not upset if they do use restrooms of gender they identify with 14  8
Sex on birth certificate – respondent upset if they do use restroom of gender they identify with 27 27
*Form A/B was a forced-choice question, with no unsure option offered. Form C/D asked the same question, but included the option, “or don’t you care either way?”

IM4E. Do you think that decisions about which public restroom transgender people can use should be made by [READ IN ORDER]:

ASK IF GAVE RESPONSE:

IM5. Do you feel strongly about that, or not strongly?

Based on quarter sample E (n=224)

%
The Federal government 22
Strongly 18
Not strongly 5
Don’t know/Refused 0
Individual state governments 22
Strongly 15
Not strongly 8
Don’t know/Refused 0
The group or individuals who own the restroom 44
Strongly 33
Not strongly 10
Don’t know/Refused 2
(VOL.) Don’t know 6
(VOL.) Refused 6

IM4F. Do you think that decisions about which public restroom transgender people can use should be made by [READ IN ORDER]:

ASK IF GAVE RESPONSE:

IM5. Do you feel strongly about that, or not strongly?

Based on quarter sample F (n=285)

%
The group or individuals who own the restroom 34
Strongly 24
Not strongly 10
Don’t know/Refused *
Individual state governments 15
Strongly 9
Not strongly 6
Don’t know/Refused 0
The Federal Government 35
Strongly 27
Not strongly 8
Don’t know/Refused *
(VOL.) Don’t know 9
(VOL.) Refused 6

IM4G. Do you think that decisions about which public restroom transgender people can use should be made by [READ IN ORDER]:

ASK IF GAVE RESPONSE:

IM5. Do you feel strongly about that, or not strongly?

Based on quarter sample G (n=223)

%
The Federal government 15
Strongly 12
Not strongly 2
Don’t know/Refused *
Individual state governments 21
Strongly 15
Not strongly 6
Don’t know/Refused 0
The group or individuals who own the restroom 29
Strongly 22
Not strongly 7
Don’t know/Refused *
Are you unsure? 31
(VOL.) Refused 4

IM4H. Do you think that decisions about which public restroom transgender people can use should be made by [READ IN ORDER]:

ASK IF GAVE RESPONSE:

IM5. Do you feel strongly about that, or not strongly?

Based on quarter sample H (n=271)

%
The group or individuals who own the restroom 32
Strongly 22
Not strongly 9
Don’t know/Refused 1
Individual state governments 9
Strongly 5
Not strongly 3
Don’t know/Refused 0
The Federal Government 18
Strongly 14
Not strongly 4
Don’t know/Refused 0
Are you unsure? 34
(VOL.) Refused 7

DEMOGRAPHICS

I have one last set of questions to help us better understand the people who took part in our survey.

SEX Respondent’s sex [DO NOT ASK]

%
Male 49
Female 51

EMPLOY Are you now employed full-time, part-time, or not employed?

%
Employed full-time 45
Employed part-time 10
Not employed 44
(VOL.)Don’t know/Refused *

PAR Are you the parent or guardian of any children under 18 years of age?

%
Yes 30
No 70
(VOL.) Don’t know/Refused *

AGE What is your age?

%
18 to 29 22
30 to 49 31
50 to 64 26
65 and older 18
(VOL.) Refused 3

EDUC What is the highest level of school you have completed or the highest degree you have received? [DO NOT READ]

%
Less than high school (Grades 1-8 or no formal schooling) 4
High school incomplete (Grades 9-11 or Grade 12 with NO diploma) 7
High school graduate (Grade 12 with diploma or GED certificate) 30
Some college, no degree (includes some community college) 18
Two year associate degree from a college/university 12
Four year college or university degree/Bachelor’s degree 16
Some postgraduate or professional schooling, no postgraduate degree 1
Postgraduate or professional degree, including master’s, doctorate, medical or law degree 11
Don’t know/Refused *

Summary: Race/Ethnicity

HISP Are you of Hispanic or Latino origin, such as Mexican, Puerto Rican, Cuban or some other Spanish background?

RACE What is your race? Are you white, black, Asian, or some other race? [IF RESPONDENT SAYS HISPANIC OR LATINO, PROBE: Do you consider yourself a WHITE (Hispanic/Latino) or a BLACK (Hispanic/Latino)?

%
White, non-Hispanic 64
Total non-White 34
Black, non-Hispanic 12
Hispanic 15
Asian/Pacific Islander, non-Hispanic 3
Other, non-Hispanic 4
(VOL.) Don’t know/Refused 2

Summary: Income

INC Last year – that is, in 2015 – approximately what was your total family income before taxes? Just tell me when I get to the right category.

INC1 [IF “DON’T KNOW” OR “REFUSED”, ASK:] Keeping in mind that this is a completely confidential survey, can you please tell me if your total household income BEFORE taxes last year was over or under $75,000?

INC2 [IF UNDER $75,000, ASK:] was it over or under $50,000?

INC3 [IF UNDER $50,000, ASK:] was it over or under $30,000?

%
$75,000 or more 28
$50,000 to under $75,000 14
$30,000 to under $50,000 19
Under $30,000 29
Undesignated 9

REG Which of these statements best describes you? [READ IN ORDER]

%
Are you ABSOLUTELY CERTAIN that you are registered to vote at your current address 71
Are you PROBABLY registered, but there is a chance your registration has lapsed, OR 6
Are you NOT registered to vote at your current address? 20
(VOL.) Don’t know/Refused 2

PARTY In politics TODAY, do you consider yourself a Republican, Democrat, or Independent?

%
Republican 25
Democrat 33
Independent 35
(VOL.) No preference 4
(VOL.) Other party 1
(VOL.) Don’t know/Refused 1

That completes the interview. Thank you very much for your time and cooperation. Have a nice day/evening.

###

Methodology

May 2016 Omnibus Week 1

Prepared by Princeton Survey Research Associates International

May 2016

The PSRAI May 2016 Omnibus Week 1 obtained telephone interviews with a nationally representative sample of 1,003 adults living in the continental United States. Telephone interviews were conducted by landline (503) and cell phone (500, including 326 without a landline phone). The survey was conducted by Princeton Survey Research Associates International (PSRAI). Interviews were done in English and Spanish by Princeton Data Source from May 5-8, 2016. Statistical results are weighted to correct known demographic discrepancies. The margin of sampling error for the complete set of weighted data is ± 3.6 percentage points.

Details on the design, execution and analysis of the survey are discussed below.

DESIGN AND DATA COLLECTION PROCEDURES

Sample Design

A combination of landline and cellular random digit dial (RDD) samples was used to represent all adults in the continental United States who have access to either a landline or cellular telephone. Both samples were provided by Marketing Systems Group (MSG) according to PSRAI specifications.

Numbers for the landline sample were drawn with equal probabilities from active blocks (area code + exchange + two-digit block number) that contained one or more residential directory listings. The cellular sample was not list-assisted, but was drawn through a systematic sampling from dedicated wireless 100-blocks and shared service 100-blocks with no directory-listed landline numbers.

Contact Procedures

Interviews were conducted from May 5-8, 2016. As many as three attempts were made to contact every sampled telephone number. Sample was released for interviewing in replicates, which are representative subsamples of the larger sample. Using replicates to control the release of sample ensures that complete call procedures are followed for the entire sample. Calls were staggered over times of day and days of the week to maximize the chance of making contact with potential respondents. Each phone number received at least one daytime call when necessary.

For the landline sample, interviewers asked to speak with the youngest adult male or female currently at home based on a random rotation. If no male/female was available, interviewers asked to speak with the youngest adult of the other gender. This systematic respondent selection technique has been shown to produce samples that closely mirror the population in terms of age and gender when combined with cell interviewing. Prior to dialing, the landline sample was scrubbed of numbers that have been ported to wireless service by comparing the sample file to the most recently available Intermodal Ported Telephone Number Identification Service database.

For the cellular sample, interviews were conducted with the person who answered the phone. Interviewers verified that the person was an adult and in a safe place before administering the survey.

WEIGHTING AND ANALYSIS

Weighting is generally used in survey analysis to compensate for sample designs and patterns of non-response that might bias results. The sample was weighted to match national adult general population parameters. A two-stage weighting procedure was used to weight this dual-frame sample.

The first stage of weighting corrected for different probabilities of selection associated with the number of adults in each household and each respondent’s telephone usage patterns. This weighting also adjusts for the overlapping landline and cell sample frames and the relative sizes of each frame and each sample.

This first-stage weight for the ith case can be expressed as:

WTi=[(SLLFLL×1ADi×LLi)+(SCPFCP×CPi)(SLLFLL×1ADi×LLi×SCPFCP×CPi)]-1

Where SLL = the size of the landline sample

FLL = the size of the landline sample frame

SCP = the size of the cell sample

FCP = the size of the cell sample frame

ADi = Number of adults in household i

LLi=1 if respondent has a landline phone, otherwise LL=0.

CPi=1 if respondent has a cell phone, otherwise CP=0.

The second stage of weighting balanced sample demographics to population parameters. The sample is balanced to match national population parameters for sex, age, education, race, Hispanic origin, region (U.S. Census definitions), population density, and telephone usage. The basic weighting parameters came from the US Census Bureau’s 2014 American Community Survey data. The population density parameter was derived from Census 2010 data. The telephone usage parameter came from an analysis of the January-June 2015 National Health Interview Survey.

Weighting was accomplished using SPSSINC RAKE, an SPSS extension module that simultaneously balances the distributions of all variables using the GENLOG procedure. Weights were trimmed to prevent individual interviews from having too much influence on the final results. The use of these weights in statistical analysis ensures that the demographic characteristics of the sample closely approximate the demographic characteristics of the national population. Table 1 compares weighted and unweighted sample distributions to population parameters.

Table 1: Sample Demographics
Parameter Unweighted Weighted
Gender
Male 48.3 50.2 48.9
Female 51.7 49.8 51.1
Age
18-24 12.9 9.6 13.1
25-34 17.6 10.5 16.0
35-44 16.7 11.7 16.7
45-54 17.8 17.6 18.2
55-64 16.4 18.9 16.8
65+ 18.6 31.7 19.1
Education
HS Grad or less 40.7 31.3 40.8
Some College/Assoc Degree 31.5 29.1 30.6
College Graduate 27.8 39.6 28.6
Race/Ethnicity
White/not Hispanic 65.3 72.7 65.9
Black/not Hispanic 11.8 9.5 11.5
Hispanic 15.3 12.2 15.3
Other/not Hispanic 7.6 5.7 7.3
Region
Northeast 18.2 21.0 18.4
Midwest 21.3 21.6 21.3
South 37.6 36.4 37.8
West 22.9 20.9 22.5
County Pop. Density
1 – Lowest 19.9 22.3 20.1
2 20.0 23.0 20.3
3 20.1 18.3 20.1
4 20.0 19.6 20.1
5 – Highest 20.0 16.7 19.4
Household Phone Use
LLO 6.2 5.4 6.2
Dual 43.1 62.1 44.1
CPO 50.7 32.5 49.8

Effects of Sample Design on Statistical Inference

Post-data collection statistical adjustments require analysis procedures that reflect departures from simple random sampling. PSRAI calculates the effects of these design features so that an appropriate adjustment can be incorporated into tests of statistical significance when using these data. The so-called “design effect” or deff represents the loss in statistical efficiency that results from unequal weights. The total sample design effect for this survey is 1.34.

PSRAI calculates the composite design effect for a sample of size n, with each case having a weight, wi as:

In a wide range of situations, the adjusted standard error of a statistic should be calculated by multiplying the usual formula by the square root of the design effect (√deff ). Thus, the formula for computing the 95% confidence interval around a percentage is:

where is the sample estimate and n is the unweighted number of sample cases in the group being considered.

The survey’s margin of error is the largest 95% confidence interval for any estimated proportion based on the total sample— the one around 50%. For example, the margin of error for the entire sample is ±3.6 percentage points. This means that in 95 out every 100 samples drawn using the same methodology, estimated proportions based on the entire sample will be no more than 3.6 percentage points away from their true values in the population. It is important to remember that sampling fluctuations are only one possible source of error in a survey estimate. Other sources, such as respondent selection bias, questionnaire wording and reporting inaccuracy, may contribute additional error of greater or lesser magnitude.

RESPONSE RATE

Table 2 reports the disposition of all sampled telephone numbers ever dialed from the original telephone number samples. The response rate estimates the fraction of all eligible sample that was ultimately interviewed. Response rates are computed according to American Association for Public Opinion Research standards. Thus the response rate for the landline samples was 6 percent. The response rate for the cellular samples was 7 percent.

Table 2. Sample Disposition
Landline Cell
1,767 157 Non-residential/Business
508 —- Cell in landline frame
2,275 157 OF = Out of Frame
29,431 3,390 Not working
982 7 Computer/fax/modem
30,413 3,397 NWC = Not working/computer
2,817 339 NA/Busy
0 2,614 VM not set up / out of range
2,817 2,953 UHUONC = Non-contact, unknown if household/unknown other
3,813 3,841 Voice mail
28 16 Other non-contact
3,841 3,857 UONC = Non-contact, unknown eligibility
2,753 3,278 Refusals
684 389 Callbacks
3,437 3,667 UOR = Refusal, unknown if eligible
20 40 O = Other
—- 260 Child’s cell phone
—- 260 SO = Screen out
94 170 R = Refusal, known eligible
503 500 I = Completed interviews
43,400 15,001 T = Total numbers sampled
19.5% 70.5% e1 = (I+R+SO+O+UOR+UONC)/(I+R+SO+O+UOR+UONC+OF+NWC) – Est. frame eligibility of non-contacts
100.0% 72.0% e2 = (I+R)/(I+R+SO) – Est. screening eligibility of unscreened contacts
48.0% 43.8% CON = [I + R + (e2*[O + UOR])]/[I + R + (e2*[O + UOR + UONC]) + (e1*e2*UHUONC)]
12.4% 15.0% COOP = I/[I + R + (e2*[O + UOR])]
87.6% 85.0% REF = [R + (e2*[O + UOR])]/[I + R + (e2*[O + UOR])] = 1 – COOP
6.0% 6.6% AAPOR RR3=I/[I+R+[e2*(UOR+UONC+O)]+[e1*e2*UHUONC]] = CON*COOP

Read the poll here.

For more information about the poll, contact iMediaEthics at info@asrlab.org or 212.925.8812

UPDATED: 6/24/2016 12:35 PM

Submit a tip / Report a problem

Methodology Statement and Topline for iMediaEthics Poll on Transgender Use of Restrooms

Share this article:

Comments Terms and Conditions

  • We reserve the right to edit/delete comments which harass, libel, use coarse language and profanity.
  • We moderate comments especially when there is conflict or negativity among commenters.
  • Leave a Reply

    Your email address will not be published. Required fields are marked *