As the obesity epidemic spreads across America, new public policies seek to incorporate environmental solutions as a method to improve health.
However, the value or efficacy of the interventions are often obscure.
New health policies include banning sodas from school vending machines, building walking paths and playgrounds, adding supermarkets to food deserts and requiring nutritional labels on restaurant menus.
These population based solutions attempt to stem the increase the obesity, but which of these changes actually make an impact?
The new interventions are often called “natural experiments” as they compare people’s calorie consumption or physical activity levels before and after a policy or environmental change.
Or, they may compare the target group against a similar group of people not affected by that change. But not all natural experiments are created equal.
“Rigorous science is needed to evaluate these natural or quasi-experiments,” said Amy Auchincloss, Ph.D., an associate professor at the Drexel University School of Public Health.
Auchincloss was a member of a research team that authored a new study published online ahead of print in Obesity Reviews: “Impact of policy and built environment changes on obesity-related outcomes: a systematic review of naturally occurring experiments.ā€¯
The review was led by Stephanie Mayne, a doctoral student supervised by Auchincloss, and also co-authored by Yvonne Michael, Sc.D., an associate professor and associate dean for academic and faculty affairs in the Drexel University School of Public Health.
The Drexel team reviewed the state of the science on this topic, evaluating the results and methods of all previous such studies published in the medical literature, in particular:
- Which policies and built environment changes have been evaluated via natural- or quasi-experiments and what are the results from these studies?
- Are there issues of concern with the studies’ design, including methods of assessment?
- What are the limitations of these studies and areas where additional science is needed?
Researchers say this is the first review that has examined the use of natural- or quasi-experiments to evaluate the efficacy of policy and built environment changes on obesity-related outcomes (body mass index, diet, or physical activity).
The review identified certain types of interventions that are more successful than others in improving obesity-related outcomes, and identified areas where more research is needed to draw conclusions about obesity-related outcomes:
Changes with strong impacts were ones that improved the nutritional quality of foods:
- trans-fat bans;
- sugary food and beverage availability limits;
- higher-fat food availability limits.
Changes that had smaller or no impacts in the research to date included:
- nutritional information requirements;
- supermarkets built in underserved areas.
Researchers did observe that some changes had stronger health impacts. These included infrastructure improvements that encourage walking and cycling (active transportation). Furthermore, they found long-term studies were more effective in identifying the interventions that had a meaningful impact.
Investigators recommend additional research to look at physical activity effects (not just use of amenities) for built environment changes including:
- park improvements;
- active transportation infrastructure.
The researchers noted that a common shortcoming in many studies is that they only measured process outcomes such as food purchases or use of bike/transit infrastructure, rather than measuring the desired health outcomes, such as weight loss.
“Research suggests that people will use new amenities like bike shares, and limit purchases of unhealthy foods in specific contexts like schools,” said Mayne. “But it is less clear whether these changes translate into overall improvements in diet and physical activity.”
Likewise, only a few studies directly assessed impacts on BMI or weight; thus, the authors concluded that evidence is lacking on whether environmental and policy modifications are successful in maintaining healthy weight or reducing excess weight.
A key value of a natural experiment is that it can narrowly focus on the direct impact of a change in policy or infrastructure on an affected population — making natural experiments an important way to check on what kinds of public policies and investments make real-world impacts on health, and to what degree.
The authors concluded that more natural experiments are needed to strengthen the evidence base about obesity-related policies and interventions.
Source: Drexel University