Weighting

Fact [V] p005-06

Thanks to Dorothy Seaman for sampling and weighting

The HSOAC team also thanks Dorothy Seaman for producing the sampling and weighting for these analyses.

p. 5 · NCIER Claim Map

cite page 5 About This Report

Report page 5 with the cited passage highlighted — Source page 5 · click to enlarge · all claims on this page

Fact [V] p023-02

1,746 individuals completed the 20-minute survey, weighted to national principal population

In total, 1,746 individuals completed our 20-minute survey, and we weighted their responses to be representative of the national population of K–12 public school principals and the schools in which they serve.

p. 23 · NCIER Claim Map

cite page 23 Ch 1: Introduction

Report page 23 with the cited passage highlighted — Source page 23 · click to enlarge · all claims on this page

Fact [V] p112-03

All appendix estimates are weighted to represent national K–12 public school principals and their sc

All survey estimates presented below have been weighted to be representative of the national population of K–12 public school principals and the schools in which they serve.

p. 112 · NCIER Claim Map

cite page 112 Appendix A: Survey Frequencies

Report page 112 with the cited passage highlighted — Source page 112 · click to enlarge · all claims on this page

Fact [V] p152-13

1,746 cases received a weight, a 32.0 percent completion rate (AAPOR RR6)

Sample (no n: a percentage change, not a share of a sample) · a percentage that is not a share of a sample (e.g. a percentage-point change or a weighted estimate of the population)

Excluding these 38 principals and the cases in which respondents did not complete a significant portion of the survey, a total of 1,746 cases received a weight. This corresponds to a 32.0 percent completion rate using the American Association for Public Opinion Research’s Response Rate 6 definition (American Association for Public Opinion Research, 2023).

p. 152 · NCIER Claim Map

cite page 152 Appendix B: Survey Methods

Report page 152 with the cited passage highlighted — Source page 152 · click to enlarge · all claims on this page

Fact [V] p153-01

Responses weighted to represent the national population of public school principals

Principals’ survey responses have been weighted to be representative of the national population of public school principals at the time the survey was administered.

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Report page 153 with the cited passage highlighted — Source page 153 · click to enlarge · all claims on this page

Fact [V] p153-02

Sampling weights created so the weighted sample resembles K–12 public school principals

To provide a weighted sample similar to the population of K–12 public school principals in the United States, we created sampling weights.

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Fact [V] p153-03

Weighting accounts for selection probability and response likelihood, then calibrates to the populat

The weighting process accounts for the probability of selection into the survey from the panel and the likelihood an invited principal completes the survey (the response weight), and these likelihoods are combined and calibrated to reproduce the population distribution of K–12 educators.

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Fact [V] p153-04

Final analysis weights are the product of three interim weights

More specifically, the final analysis weights used in our analyses are the product of the following three interim weights:

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Definition [V] p153-05

Interim weight 1: calibrated weight of the sampling frame, matched to NTPS national characteristics

calibrated weight of the sampling frame (a calibration weight that assigns a weight for each panelist based on individual- and school-level characteristics so that the sum of the weights along the calibration factors closely match the national characteristics of the national population of public school principals based on the NCES’s National Teacher and Principal Survey)

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Definition [V] p153-06

Interim weight 2: sample selection weight, inverse of probability of selection from the panel

sample selection weight (the inverse of the probability of selection into the survey sample using the panel as the frame)

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Definition [V] p153-07

Interim weight 3: survey response weight, inverse of modeled probability of completing the survey

survey response weight (the inverse of modeled probability of a principal completing the survey. The response adjustment is important to eliminate observed sources of response bias).

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Fact [V] p153-08

Products of the weights were recalibrated and trimmed if necessary

The products of these weights were subsequently recalibrated and trimmed if necessary.

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Fact [V] p153-09

Table B.3: respondents similar to the population before and after weighting

As shown in Table B.3, both before and after weighting, survey respondents look similar to the population of U.S. public school principals on a variety of person-level and school-level characteristics.

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Fact [V] p153-10

Samplewide and subgroup-specific means and proportions reported, weighted

We report samplewide and subgroup-specific means and proportions of variables of interest, weighted using the survey weights we describe in the previous section.

p. 153 · NCIER Claim Map

cite page 153 Appendix B: Survey Methods

Fact [V] p154-01