Volume 3, Issue 1 p. 167-182
ARTICLE
Open Access

Effects of informational nudges on preordered food choices of middle school National School Lunch Program participants

Jaclyn D. Kropp

Corresponding Author

Jaclyn D. Kropp

Food Resource Economics Department, University of Florida, Gainesville, Florida, USA

Correspondence Jaclyn D. Kropp, Food Resource Economics Department, University of Florida, PO Box 110240, Gainesville, FL 32611.

Email: [email protected]

Search for more papers by this author
Sonam Gupta

Sonam Gupta

American Institutes for Research, Arlington, Virginia, USA

Search for more papers by this author
First published: 15 January 2024

Abstract

We examine the effects of own order history, peer order history, and MyPlate nudges received by middle-school National School Lunch Program (NSLP) participants while preordering on the selection of fruits and vegetables. Students receiving own order history nudges were significantly less likely to select a vegetable during the postintervention phase. Students who received peer order history nudges were significantly less likely to select a vegetable during the nudging and postintervention phases, suggesting that receiving information on peer selection negatively impacted the selection of vegetables. The MyPlate recommendations nudge may mitigate the negative effects of receiving peer selection information.

1 INTRODUCTION

Changes to the National School Lunch Program (NSLP), the United States' second largest food assistance program, under the Healthy, Hunger-Free Kids Act of 2010 aimed to improve the dietary quality of participants (United States Department of Agriculture [USDA], 2012). Although consumption of fruits and vegetables is linked to various health benefits including lower risk of obesity, chronic noncommunicable diseases, and some cancers (Fung et al., 2001; Kranz et al., 2012; Maynard et al., 2003; Rolls et al., 2004), only 2% of adolescents consume the USDA recommended amounts of vegetables and only 7% of adolescents consume the USDA recommended amounts of fruits (Lange et al., 2021).

Recent research suggests employing behavioral economic principles such as nudging and precommitment can lead to students selecting and consuming healthier foods (Lai et al., 2020; Marcano-Olivier et al., 2019; Miller et al., 2016; World Health Organization, 2022). Nudges or subtle behavioral cues aim to influence the choices made by individuals without taking away their freedom of choice (Thaler & Sunstein, 2009). Prior studies conducted in school settings indicate nudges can increase the selection and consumption of fruits, vegetables, and white milk, as well as lower the selection and consumption of less healthful foods, during and after the various interventions (Lai et al., 2020; Marcano-Olivier et al., 2019; Miller et al., 2016). A recent systematic review of nudge interventions in schools by Metcalfe et al. (2020) found that behavioral nudges generally have a positive relationship with selection of meal items and mixed relationship with consumption.

Previous studies examining precommitment, which involve making choices in advance of mealtime in the absence of stimuli such as smell and visualization of the foods, found these methods to be an effective means of encouraging healthier choices (Just et al., 2008; Miller et al., 2016; Stites et al., 2015). Miller et al. (2016), combining preordering and nudging, found that students in fourth and fifth grade who preordered their lunches were more likely to select the fruit, vegetable, and low-fat milk NLSP meal components than students who did not preorder. Students who received a nudge based on USDA MyPlate recommendations while preordering were 51.4%, 29.7%, and 37.3% more likely to select a fruit, vegetable, and low-fat milk, respectively, than students who went through the normal lunch line. Outside the school setting, Van Epps et al. (2016) found calorie content of selected meals had a strong negative relationship with the time between preordering and receiving the meal.

Other studies suggest peers are a powerful influence. Lowe et al. (2004) showed primary-school students' videos of peer-aged “heroes” eating and enjoying produce and gave small prizes to students who selected and consumed fruits and vegetables during school lunch and snack times. During the intervention, students ate more fruits and vegetables at school and at home. The students also expressed increased enjoyment from fruits and vegetables following the intervention. Trogdon et al. (2008) highlighted a positive correlation between mean peer weight and individual weight in adolescents. Holford (2015) found peers influence participation in free-school school meal programs in the United Kingdom. Peer effects and social comparisons on individual choices also affect energy conservation, voting, retirement savings, and charitable giving (Allcott, 2011; Ayres et al., 2013; Costa & Kahn, 2013; Frey & Meier, 2004; Gerber & Rogers, 2009; Nolan et al., 2008; Schultz et al., 2007). Furthermore, the effects of peer influence on adolescent risk behaviors such as the use of alcohol, drugs or tobacco, unprotected sexual activity, crime, and reckless driving are well documented (Albert et al., 2013). While not still fully understood why, adolescents are more susceptible to peer influences than adults. Peer influences are linked to the brain's socioemotional reward system; as individuals age and the cognitive-control system develops, individuals develop additional capacity to resist peer influence (Albert et al., 2013).

In this study, we combine the behavioral economics principles of nudging, precommitment, and social comparisons to encourage the selection of fruits and vegetables by middle school children participating in the NSLP in two Florida schools. Miller et al. (2016) and Allcott (2011) provide the motivation for this study. Allcott (2011) provides Home Energy Report letters to residential customers. These reports present bar graph depictions of the customers' electricity use as well as information pertaining to the electricity use of the customers' neighbors. Allcott found that the letters reduced energy consumption by 2.0%. In the current study, similar to Miller et al., we invited participants to preorder their school lunches each morning during their homeroom class for 9 weeks. During Weeks 4 through 7, all participants received informational nudges related to their own prior selections of fruits and vegetables when they preordered their meals. In addition to receiving information pertaining to their own selections, some participants (treatment B) also received information pertaining to the prior selections of their peers defined as other study participants in the same grade and school. A final group of participants (treatment C) received information pertaining to their selections, peer selections, and USDA-recommended selections. Like Allcott (2011), we provide participants with information regarding their own and peers' behaviors using bar graphs.

Economic theory predicts students should select the foods that maximize their utility. However, this is not always the case. Economists have identified numerous biases and cognitive errors that lead individuals to make suboptimal decisions (The Decision Lab, 2020). For example, present biasedness may prevent an individual from selecting a healthier food option even if they value sound nutrition as the benefits of healthy eating are received in the future while the cost (eating a less desirable food) is incurred up front (Sunstein, 2015). Furthermore, to reduce the mental burden of the decision-making process, individuals often take shortcuts by making habitual decisions, which can lead to poor dietary choices (Cohen & Babey, 2012). The ability to employ shortcuts in some decision-making processes is known as the dual-process theory prevalent in both cognitive and social psychology (Evans & Stanovich, 2013). Dual-process theory draws a distinction between two kinds of thinking, one fast and intuitive, the other slow and deliberative. Often, fast and intuitive thinking is optimal—like when driving a car. However, at times, habitual decisions can lead to suboptimal outcomes, such as habitually snacking on a bag of chips while watching TV. Precommitment can prevent impulsive decisions by eliminating sensory cues that trigger individuals to choose less healthy choices (Stites et al., 2015). Similarly, informational nudges can encourage decision makers to overcome biases and cognitive errors by causing them to switch from fast and intuitive thinking to slow and deliberative thinking as depicted in Figure 1.

Details are in the caption following the image
Behavioral economic interventions and dual-process theory.

By providing students with information regarding their prior selection of fruits and vegetables while preordering, we are making these choices more salient in hopes of interrupting habitual behaviors. Hence, we anticipate students who receive information regarding prior selections will be more likely to select the vegetable and fruit meal components when nudged during preordering. While peer pressure and influence frequently lead adolescents to make unhealthy or risky choices, we anticipate that providing students with information about their peers' selections of fruits and vegetables will enable them to make social comparisons and encourage the selection of these items. We recognize the potential for boomerang effects (Schultz et al., 2007), in which individuals who are consuming more fruits and vegetables than their peers may decrease their selection of these items following social comparisons. We also hypothesize that students who receive informational nudges containing the USDA recommendations will be reminded of the importance of consuming a healthy diet and be more likely to select vegetable and fruit components when nudged. Thus, we anticipate the effect of each treatment will be positive with the largest effect occurring when the three nudges are combined.

To the best of our knowledge, this is the first study that uses informational nudges related to own or peer groups' prior behaviors to encourage the selection of fruits and vegetables among middle school children while preordering. While we hypothesize that informational and social comparison nudges will positively impact the selection of fruits and vegetables, we find negative effects on the selection of vegetables and no significant effects on the selection of fruits. At the first study school, we found that students in the treatment groups who received own order history nudges and who received own and peer order history nudges were significantly less likely to select a vegetable during the postintervention phase of the study. At the second study school, we found students in the second treatment group, who received own and peer order history nudges, were significantly less likely to select a vegetable during both the intervention and postintervention phases of the study relative to their selections during the baseline period, suggesting receiving information on peer selection backfired and negatively impacted the selection of vegetables with the impacts persisting after nudging ceased.

2 METHODS

2.1 Experimental design

The study was conducted during the 2013–2014 school year in Alachua County, Florida, following the University of Florida Institutional Review Board (IRB) approval (#2012-U-1245). Students at two middle schools (grades 6–8) were recruited to participate in early September through a demonstration of the preordering program in their homeroom classrooms. While participants did not receive monetary compensation, they were allowed to pick up their lunches before other students.

Potential study schools (from the set of seven middle schools in the district) were identified by the district's Director of Food and Nutrition Services in coordination with the district's Superintendent and the school principals; budget constraints only allowed the study to be implemented in two schools. We sought schools that collectively represented the district's demographics and schools that were not participating in other nutrition-related interventions during the study period. The Alachua County Public School system is made up of both schools that receive Title I funding and those that do not. Thus, the study was conducted at one school that did not receive Title I funding (school 1) and one lower income, Title 1 school (school 2). While both schools have diverse student bodies with respect to race and ethnicity, school 2 has a higher proportion of students from underrepresented groups.

During the study, participants preordered their lunches each morning for nine consecutive weeks using a web-based computer program designed for this study. For the first 3 weeks (baseline phase), students preordered their lunches without receiving any nudges. Then, students were randomly assigned to one of three treatment groups, and for the next 4 weeks (intervention phase) students received informational nudges while preordering. The nudges received by the students depended on their assigned treatment group, which remained the same throughout the study.

Students in treatment A received information pertaining to the average number of servings of fruits and vegetables they selected in the past five school days when they ate an NSLP lunch, students in treatment B received information on their own selections for the past five school days as well as information pertaining to the average selections of their peers for the same period, and students in treatment C received information on their own selections, peer selections, and the USDA recommended number of servings. Peer selection information was the average number of servings of fruits and vegetables selected per day by students who ate an NSLP lunch and were in the same grade and school. Recommended information was based on USDA MyPlate guidelines, which recommend consuming a protein, grain, fruit, vegetable, and dairy at each meal (USDA, n.d.). Thus, the recommended servings of fruits and vegetables were one serving of each item per meal. The information pertaining to own, peer, and recommended servings was presented using bar graphs. Teachers, administration, and students were consulted at both study schools before finalizing the design to ensure participants could correctly understand and interpret the graphical information. An example of a graph received by participants in treatment C is shown in Figure 2.

Details are in the caption following the image
Example of nudge received by students in treatment C.

Following the intervention phase, participants preordered for another 2 weeks without receiving nudges. This allowed us to determine if the nudges had effects that lasted past the end of the intervention.

Randomization into treatment groups was done by school and strata based on the number of times the student preordered during the 3-week baseline phase of the study; students who ordered less than 40% of the time during the baseline period formed one stratum and those who ordered more frequently were a different stratum. At school 1, one-third of the students in each stratum were randomly assigned to each of the three treatments, while at school 2 half of the students in each stratum were assigned to treatment A and the other half were assigned to treatment B. Once assigned to a treatment, the student remained in the same treatment group for the duration of the study. Students at the second study school were only randomized into treatments A and B due to high rates of attrition during the baseline period of the study. In accordance with IRB regulations, children participating in the study had the option to withdraw from the study at any time. Approximately 27% of the students enrolled in grades 6–8 at school 2 signed the assent form agreeing to participate in the study, yet only 62% of the students who signed the assent form preordered a lunch during the baseline period of the study. In contrast, approximately 14% of the students enrolled in grades 6–8 at school 1 signed the assent form and 79% of these students preordered a lunch during the baseline period of the study.1

We analyze attrition bias by constructing an indicator variable that takes the value of 1 if the participant preordered in all three phases of the study, and 0 otherwise. We then model attrition as a function of assigned treatment, school, and student-level demographic variables using logit regression analysis. We find no evidence of attrition bias across treatment groups; however, students at school 2 were significantly more likely to exit the study than students at the first study school.2

During the study, on school days when participants choose to eat the school lunch (as opposed to bringing a lunch from home), participants preordered their lunches before 9:00 a.m. Schools participating in the NSLP program are required to offer the five NLSP meal components (meat/meat alternative, grain, fruit, vegetable, and milk) each school day. During preordering, available items were displayed by meal component categories (e.g., broccoli and carrots as vegetable options and apple wedges and melon as fruit options). Each offering was categorized based on discussions with the food service director and in accordance with the NSLP guidelines. While the menu was set at the district level, each school had some flexibility in the specific fruit and vegetable items offered. French fries were served more frequently as a vegetable option at school 1. The cafeteria staff at the study schools referred to the meat/meat alternative lunch component as the main dish and the grain component as starch; hence, the preordering program employed the same terminology to avoid confusing the participants.

Students must select at least three of the five offered components and one of the selected components must be a fruit or vegetable for the school to receive reimbursement for the lunch under the NSLP (USDA, 2012). Thus, participants who selected less than three items were prompted to select additional items and given the opportunity to change their orders. If a student ordered more than one item from any NSLP meal component category, they were prompted that they would need to pay extra for each additional item and given the opportunity to change their order. These prompts were similar to the verbal prompts that students received from cafeteria staff. Participants received these prompts less than 1% of the time when preordering. We analyze students' final selections.

At lunchtime, study participants picked up their preordered meals and completed their transactions as normal using their personal identification numbers (PINs). These PINs were linked to account information indicating if the student qualified to receive a free or reduced-price lunch. Students from households with incomes less than 130% of the federal poverty level can qualify for free lunches, while students from households with incomes between 130% and 185% of the federal poverty level can qualify for reduced-price lunches; students who do not qualify for free or reduced-price lunches may purchase full-price lunches, which are minimally subsidized (USDA, 2015). The preordering software allowed students to order only NSLP lunch components. Additional à la carte items could be purchased in the cafeteria at lunch.

Participants also used their PIN to log on to the preordering software program, allowing us to track students throughout the study and match their orders with race, gender, grade level, and NSLP income-eligibility status (free, reduced price, or full price) information provided by the school district's administration.

2.2 Data

Over the course of the 9-week study, 211 students, for which we acquired complete demographic data, preordered 3484 lunches. Supporting information S1: Tables A.1A.2, and A.3 summarize the characteristics of the study participants at study schools 1 and 2 and for the pooled sample, respectively. Participants were predominantly Black females who received free or reduced-price lunches. School 1 had significantly more male participants and more White participants than school 2.

We check the balance of the randomization by testing for differences in the proportions between each pair of treatment groups for each of the demographic variables. For school 1, we find that significantly more males were in treatment B than treatment C, the percentage of participants that qualify for free or reduced-price lunches was statistically higher for treatment group A than treatment B, and significantly more eighth graders were in treatment C than treatment A. These imbalances arose by chance because we did not stratify on demographic characteristics. Because of these imbalances, we control for the demographic characteristics in the regression analyses. We find the panel to be balanced for school 2.

2.3 Empirical analysis

To determine the impacts of the various treatments on the selection of the fruit and the vegetable NSLP meal components, we compare the selection behaviors of the students across the study phases (baseline, intervention, and postintervention) by treatment group using proportions tests. We also conduct several regression analyses to determine the impacts of the various nudges on the selection of fruits and vegetables.

First, we estimate separate logit regressions for each treatment group to determine the impacts of the treatment on the selection of food item j (fruit or vegetable) during the intervention (nudging) and postintervention (preordering without nudging following the nudging period) phases of the study relative to the baseline phase. The dependent variable is an indicator variable that takes the value of 1 if food item j was selected, and 0 otherwise. We model food item selection as a function of the study phase and student-level characteristics. Specifically, Intervention takes the value of 1 during the intervention period of the study, and 0 otherwise. Postintervention takes the value of 1 during the postintervention period of the study, and 0 otherwise. The coefficients of interest are the estimated coefficients on Intervention and Postintervention, which indicate the effects of nudging and persistence of the effects of the nudge once nudging has ended, respectively, on the selection of item j. Additional covariates are a set of indicator variables for the student's race/ethnicity where Black is the excluded category, gender where female is the excluded category, and eligibility for free or reduced-price lunches (NSLP participation status) where qualification for free or reduced-price meals is the excluded category. Race/ethnicity and gender were self-reported by the student's parent or caregiver at the time of first enrollment with the school district.3 Separate regressions are estimated for the selection of fruits and vegetables for each of the three treatment groups.

Next, we use a difference-in-difference (DID) approach to determine the differential effects of the various nudges across treatment groups. Treatment A serves as the base of comparison or “control” group in the DID analyses. Treatment B equals 1 for those students who were assigned to treatment group B, and 0 otherwise. Treatment C equals 1 for those students who were assigned to treatment group B, and 0 otherwise. The coefficients of interest are the coefficients on the interaction of treatments and phases of the study; these coefficients indicate the effects of treatments B and C during the intervention and postintervention phases of the study relative to treatment A. Wald tests are conducted to compare the effects of treatment B to the effects of treatment C. A statistically significant difference indicates that the nudge received by students in treatment group B has a statistically different effect than the nudge received by students in treatment C. Wald tests are also conducted to compare the effects of the same treatment across the intervention and postintervention study phases. Separate logit regressions are estimated for the selection of fruits and vegetables. We present these results in Supporting information S1: Section A.1.4.

Inference is based on standard errors clustered at the student level. For ease of interpretation, odds ratios from the logit regressions are presented. Significance is set at the 10% level. Analyses are performed using Stata 17, with logit regressions estimated using xtlogit. We estimate the models with and without the inclusion of the student-level control variables. Due to differences in menu offerings, attrition rates, assignment of the treatments, and the characteristics of participants across the two study schools, we conduct the analyses for each school separately. The pooled results are presented in the Supporting Information.

3 RESULTS

3.1 Selection by treatment group during the baseline period

Since treatment assignment was random, we expect to see minimal significant differences in selection across treatment groups during the baseline period of the study. However, we found that the selection of vegetables during the baseline period by students in treatment A was statistically different than the selection of vegetables by students in treatment group B at both study schools. Table 1 reports the proportion of preordered meals containing vegetables and fruits by treatment and study phase for each of the study schools; Supporting Information S1: Tables A.4 and A.5 report the differences in selection behaviors by treatment and study phases and p values from the associated proportion tests for schools 1 and 2, respectively. Supporting Information S1: Table A.6 presents selection information for the pooled sample, while Supporting Information S1: Table A.7 presents the proportions tests for the pooled sample.

Table 1. Proportion of meals containing vegetables and fruits by study phase and school.
Baseline
Sample Treatment A Treatment B Treatment C
School 1
Vegetable 0.853 0.822 0.877 0.862
Fruit 0.888 0.906 0.877 0.880
Observations 822 286 260 276
School 2
Vegetable 0.714 0.750 0.677
Fruit 0.953 0.962 0.944
Observations 720 364 356
Intervention phase
Sample Treatment A Treatment B Treatment C
School 1
Vegetable 0.865 0.882 0.847 0.862
Fruit 0.874 0.894 0.847 0.878
Observations 724 263 215 246
School 2
Vegetable 0.664 0.765 0.579
Fruit 0.953 0.986 0.924
Observations 611 281 330
Postintervention phase
Sample Treatment A Treatment B Treatment C
School 1
Vegetable 0.725 0.721 0.642 0.809
Fruit 0.896 0.886 0.881 0.922
Observations 364 140 109 115
School 2
Vegetable 0.613 0.710 0.513
Fruit 0.947 0.992 0.899
Observations 243 124 119

3.2 Selection by treatment group during the intervention period

As shown in Supporting Information S1: Table A.4, selection of both vegetables and fruits was statistically similar across the treatment groups at school 1 during the intervention period of the study. As shown in Supporting Information S1: Table A.5, during the intervention period at school 2, participants in treatment group A selected both vegetables and fruits at statistically higher rates than participants in treatment group B.

3.3 Selection by treatment group during the postintervention period

As shown in Supporting Information S1: Table A.4, in the postintervention period, participants in treatment group C at school 1 ordered vegetables at a higher rate than students in treatment B. At school 2, students in treatment A selected both vegetables and fruits at higher rates than students in treatment B (Supporting Information S1: Table A.5).

3.4 Comparing selection across study phases by treatment group

At school 1, students in treatment A selected vegetables at statistically different rates across all three phases of the study as shown in Supporting Information S1: Table A.4, while students in treatment B selected vegetables at statistically different rates during the postintervention phase of the study relative to the baseline and intervention phases. At school 2, students in treatment B selected vegetables at statistically different rates during the baseline phase of the study relative to the intervention and postintervention phases (Supporting Information S1: Table A.5). Also at school 2, students in treatment A selected fruits at statistically different rates during the baseline phase of the study relative to the intervention and postintervention phases, while selection of fruits by students in treatment B statistically differed between the baseline and postintervention phases.

3.5 Logit model results

The impacts of the three treatments on the likelihood of students preordering the vegetable and fruit meal components are estimated using logit models with the odds ratios reported in the tables. As shown in Table 2, which presents the analyses for school 1, students in treatments A and B were significantly less likely to order a vegetable in the postintervention phase than in the baseline phase. The effect of treatment C was not statistically significantly different in either the intervention or postintervention period, suggesting that vegetable selection was not impacted by the treatment. For school 2 (Table 3), we find students in treatment B were significantly less likely to select a vegetable during the intervention and postintervention phases than during the baseline phase. The results for the pooled sample are presented in Supporting Information S1: Section A.1.3 and Table A.8.

Table 2. Odds ratios for the selection of vegetables by treatment for school 1.
Treatment A Treatment B Treatment C
Model 1 Model 2 Model 1 Model 2 Model 1 Model 2
Intervention 1.435 (0.451) 1.431 (0.456) 0.661 (0.240) 0.659 (0.240) 1.062 (0.235) 1.071 (0.244)
Postintervention 0.406** (0.151) 0.414** (0.155) 0.179*** (0.0674) 0.178*** (0.0678) 0.578 (0.246) 0.574 (0.245)
Male 0.414 (0.275) 0.705 (0.411) 2.029 (1.189)
White 0.376 (0.250) 0.160 (0.186) 0.209** (0.162)
Other/mixed race 0.402** (0.159) 0.664 (0.392)
Paid 0.353 (0.309) 0.957 (0.765) 2.139 (1.630)
Seventh grade 2.817 (2.129) 1.501 (0.896) 4.425 (4.486)
Eighth grade 2.878 (2.345) 2.633 (2.261) 1.945 (1.608)
Number of observations 689 689 584 584 637 637
Number of students 33 33 31 31 33 33
  • Note: Robust seeform in parentheses.
  • ***p < 0.01; **p < 0.05.
Table 3. Odds ratios for the selection of vegetables by treatment for school 2.
Treatment A Treatment B
Model 1 Model 2 Model 1 Model 2
Intervention 0.853 (0.240) 0.833 (0.236) 0.611** (0.118) 0.605*** (0.117)
Postintervention 0.806 (0.360) 0.776 (0.345) 0.492*** (0.0862) 0.485*** (0.0859)
Male 1.068 (0.723) 0.917 (0.313)
White 22.12*** (20.90) 0.396** (0.174)
Other/mixed race 14.83*** (12.81) 1.337 (0.899)
Paid 2.532 (1.769) 1.110 (0.671)
Seventh grade 9.127*** (7.535) 0.760 (0.343)
Eighth grade 11.50*** (8.830) 1.050 (0.570)
Number of observations 769 769 805 805
Number of Students 50 50 64 64
  • Note: Robust seeform in parentheses.
  • ***p < 0.01; **p < 0.05.

The analyses for the selection of fruit presented in Supporting Information S1: Table A.9A.11 indicate that none of the treatments had a statistically significant impact on the selection of the fruit component.

3.6 Robustness checks, placebo tests, and falsification tests

As a result of the relatively high rate of attrition at school 2 during the baseline period of the study, we only assigned participants to two of the three treatments at the second study school. This led to a lack of balance in the number of students assigned to each treatment group. To address the lack of balance as well as concerns regarding the differences in the attrition rates and menu offerings across the two schools, we conduct a series of robustness checks. We also conduct a placebo test to test the parallel trends assumption and falsification tests using the participants' selection of milk. These can be found in Supporting Information S1: Section A.1.5.

4 DISCUSSION

School administrators and policymakers are showing interest in innovative ways to increase the consumption of healthier items in school cafeterias while also improving the efficiency and profitability of school meal programs. Previous studies found preordering and nudging can be effective means of achieving these objectives. We contribute to this growing body of literature by combining preordering with nudging. To our knowledge, Miller et al. (2016) is the only prior study that analyzes the impacts of preordering with nudging among NSLP participants. We expand on their study by adding an element of social comparison.

Although Miller et al. (2016) found nudges received during preordering increased the likelihood of students selecting a fruit, vegetables, and low-fat milk, the analysis for school 2 presented here suggests that receiving information regarding peer behaviors while preordering backfired leading to a negative impact on the selection of vegetables with the impact persisting after nudging ceased. We found no statistically significant effects of the other two nudging treatments during the intervention phase. Unlike the study conducted by Miller et al. (2016), we cannot compare the effects of our nudging interventions on students who did not preorder because we do not have a record of selections made by students who did not preorder. We also note selection rates of the fruit and vegetable components during the baseline period of our study are much higher than the selection rates reported by Miller et al. (2016) during the baseline phase of their study hence leaving less room for improvement.

We hypothesized providing students with information regarding their prior sections would nudge them toward making healthier choices. However, we found that this nudge (treatment A) did not have a significant impact during the nudging phase. Surprisingly, students who received information about their prior selections were significantly less likely to select a vegetable once nudging ceased at school 1. We also found that providing information regarding peer behaviors had a negative impact on selection of vegetables during the nudging phase of the study and the effects intensified when the nudging ceased at school 2. The negative effects observed during the postintervention phase of the study are similar to widely cited rebound effects in the medical literature in which a patient's symptoms reappear after the use of a medication is ceased. Similarly, in the psychology literature, there is some evidence that behaviors also return when efforts to suppress these behaviors are ceased (Denzler et al., 2010; Follenfant & Ric, 2010; Leckman, 1986). However, unlike the rebound effects found in the medical and psychology literatures, our treatments had null and negative effects during the nudging phase of the study.

One possible justification for observed negative impacts is that differences in vegetable offerings across the study phases are driving selection behaviors. Supporting Information S1: Table A.27 in the supporting information summarizes the most offered vegetables by school and study phase. French fries were offered more frequently during the baseline than in the other two phases of the study at both schools. To determine if our results are driven by differences in the availability of French fries across study phases, we constructed a control variable that took the value of 1 when French fries were offered, and 0 otherwise. Using this additional control variable, we repeated the analyses for the selection of vegetable by treatment. The results of these analyses presented in Supporting Information S1: Tables A.28 and A.29 in the supporting information are similar to the results in Tables 2 and 3, respectively. The only noteworthy exception is that the effect of treatment A at school 1 is no longer significant during the postintervention phase. The similarity of other treatment effects when controlling for offering of French fries suggests that our findings are not driven by offerings of French fries.

The negative estimated treatment effect for treatment B suggests that eating vegetables may be stigmatized or perceived as uncool; we speculate that students receiving peer information may have been reminded that eating vegetables was uncool and hence selected this lunch component less frequently. Further investigation indicates that the results were not driven by the so-called boomerang effect (Schultz et al., 2007), in which students who were selecting vegetables more frequently than their peers reduced their selection of vegetables. To determine this, we constructed a variable that took the value of 1 when the participants received graphical information that their own prior selections exceeded that of their peers, and 0 otherwise. We interacted this indicator variable with the treatment variable and repeated the analyses, presented in Tables 2 and 3, and Supporting Information S1: A.8 for treatment B to conduct a heterogeneous treatment analysis. We find that participants whose average selection of vegetables for the prior 5 days exceeded that of their peers were more likely to select the vegetable component during the intervention phase of the study as shown in Supporting Information S1: Tables A.30 and A.31.

Receiving information about the USDA recommendations seemed to mitigate the negative effects of receiving information on peer selections. Perhaps, the inclusion of the USDA recommendations reminded the students of the importance of eating healthy, providing a nudge that was sufficient to offset the negative effect of the peer information. Prior studies suggest that MyPlate nudges positively influence behavior; Miller et al. (2016) found MyPlate nudges positively impacted the selection of fruits, vegetables, and low-fat milk while preordering. Similarly, Brown et al. (2014) found undergraduate students who received biweekly text messages of the MyPlate icon and the USDA's Dietary Guidelines for 7 weeks self-reported increased consumption of fruits. However, we are cautious to draw strong conclusions about the impact of the MyPlate nudge in our study due to the relatively small number of students assigned to this treatment group.

We find no effect of the interventions on the selection of fruit. This may be due to strong preferences for the fruit component as suggested by approximately 92% of the meals selected during the baseline phase contained a fruit.

A limitation of our study is the lack of a control group in which students either ordered in the cafeteria or preordered without receiving nudges throughout the duration of the study. The decision to treat all study participants stemmed from our desire to minimize spillover effects. Students ordered during their homeroom class, taking turns on the available computers. While efforts were taken to provide privacy while ordering, we felt that if students observed only some students received graphs on their screens while preordering, they would be more likely to discuss the study with other participants. While efforts were taken to minimize spillover effects such as using privacy screens and reminding the students not to discuss the study with other students, given the length of the study, we recognize that spillover effects were likely and may have impacted the findings. Unfortunately, we have no means of estimating these effects. Originally, we intended to add a network analysis component to the study and collect information about participants' friend network and who they ate lunch with. However, the district did not approve this part of the study due to concerns over the ability to maintain students' confidentially. Social network analysis to better understand spillover effects and the role of peers in food choices is an area for future research.

We also found the attrition rates varied by school. While this is purely speculation, differences in the attrition rates across schools may have been driven by differences in the availability of computers for preordering at the two study schools. At school 1, students preordered their lunches using computers within their homeroom classrooms. At school 2, students had to go to the library or computer lab to access a computer to complete the preordering process. It is likely that this additional burden of preordering at school 2 contributed to the higher attrition rate. A recent study that asks participants to narrate their thinking aloud as they navigate placing hypothetical preorders using a web-based program suggests that restrictive timeframes within which preorders could be placed are a potential barrier to engaging in preordering; furthermore, the study finds some participants did not like forecasting in the morning what they would feel like eating for lunch (Breathnach et al., 2020). These factors may have contributed to attrition. Following our study, the study district conducted a pilot program allowing high school students to preorder. The district administrators informed us the pilot program was abandoned because students preferred the social aspect of waiting in line.

While we took care to confirm with teachers and administrators that the students in our sample could understand and interpret bar graphs, some students may have had limited ability to understand them. A lack of ability to understand the information conveyed in the nudges could render them less effective.

Furthermore, our sample was relatively small. Future research could explore if similar results are obtained from larger samples or in other districts.

5 CONCLUSIONS

Preordering can create opportunities to actively involve parents in children's decisions. The software used in this study could easily be converted into a phone application, allowing parents to track their kid's selection of various meal items and use this information to educate and influence them.

Interest in the use of preordering programs by administrators and policymakers centers around it being an easily implemented, low-cost intervention (Migliavada et al., 2021). Preordering may help reduce food waste by allowing food service personnel to prepare only the necessary number of servings; however, uncollected orders can be a significant source of food waste (Migliavada et al., 2021). Metcalfe et al. (2020) found nudging interventions in schools generally increase food waste. More research is needed to fully understand the implications of preordering on reducing food waste and the cost of serving school lunches.

ACKNOWLEDGMENTS

We are thankful to the Alachua County Public Schools for partnering with us. We are thankful to Gabriella Miller for her assistance with the data collection. We are also grateful for the comments received on earlier versions of this work presented at the Agricultural and Applied Economics Association, Southern Agricultural Economics Association, Smarter Lunchroom Symposium, Center for Behavioral Economic Health Research, Florida Agricultural Policy Outlook Conference, and Associate for Public Policy Analysis and Management. This work was supported by the United States Department of Agriculture (USDA) (59-5000-0-0090; 59-5000-5-0110), the Institute of Food and Agricultural Science, University of Florida through the Early Career Scientist Seed Funding program, and the USDA Cooperative State Research, Education and Extension Service (Hatch Grant #5337).

    DATA AVAILABILITY STATEMENT

    Our data agreement with the Alachua County Public School System prevents us from sharing the data without written consent from the district. If the manuscript is accepted, we will seek such approval. We are willing and able to share our code for replication according to the Data and Documentation Policy. The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

    • 1 Some students who signed the form but never preordered may have brought their lunches from home for the duration of the study or may have arrived too late to school to preorder.
    • 2 These regression results are available from the authors upon request.
    • 3 Race/ethnicity choices were Asian, Black, White, Hispanic, or Other. Parents and caregivers were only permitted to select one option.

    The full text of this article hosted at iucr.org is unavailable due to technical difficulties.