Design, Validation and Reproducibility of a Short Food Frequency Questionnaire to Assess Fruit and Vegetable Intake in Schoolchildren from Northwest Mexico
Trinidad Quizán-Plata1, *, Julián Esparza-Romero2, Adriana Verónica Bolaños-Villar2, María Guadalupe Corella Madueño3, Antonio Rascón Careaga3
1Nutritional Sciences Coordination, Department of Chemical and Biological Sciences, Division of Biological and Health Sciences, University of Sonora, Hermosillo, Mexico
2Department of Health and Public Nutrition, Nutrition Coordination, Center for Food Research and Development, Hermosillo, Mexico
3Department of Chemical and Biological Sciences, Division of Biological and Health Sciences, University of Sonora, Hermosillo, Mexico
To cite this article:
Trinidad Quizán-Plata, Julián Esparza-Romero, Adriana Verónica Bolaños-Villar, María Guadalupe Corella Madueño, Antonio Rascón Careaga. Design, Validation and Reproducibility of a Short Food Frequency Questionnaire to Assess Fruit and Vegetable Intake in Schoolchildren from Northwest Mexico. International Journal of Nutrition and Food Sciences. Vol. 5, No. 5, 2016, pp. 337-343. doi: 10.11648/j.ijnfs.20160505.14
Received: August 20, 2016; Accepted: September 2, 2016; Published: September 21, 2016
Abstract: In Mexico, the 2012 National Health and Nutrition Survey estimated that 65.6% of the schoolchildren aged 5-11 years has inadequate intake of fruits and vegetables. This study was conducted to validate and determine the reproducibility of a short Food Frequency Questionnaire (FFQ) designed to measure changes in fruit and vegetable intake in schoolchildren from Northwest Mexico. To the development of the FFQ, a total of 249 Dietary Recalls (24HR) were collected from 189 schoolchildren. To evaluate validity and reproducibility, two non-consecutive 24HR (as reference method) and two FFQ were collected from 124 schoolchildren. They were randomly divided into two groups: intervention (62) used for reproducibility and control (62) to evaluate validity. The intervention group received a program that promotes consumption of fruits and vegetables for a period of 6 months. Spearman correlations, Wilcoxon test and Bland-Altman plots were used to assess validity. Reproducibility statistics included Spearman correlations, Percent agreement and Weighted Kappa (κw) test and Bland-Altman plot. For validity, the mean intake estimated did not differ significantly for vegetable and the combined vegetable and fruit but it was different in fruit intake. There was a moderate correlation between FFQ1 and the 24HR to estimate the consumption of fruit or vegetable (r = 0.38, r = 0.48) and improves for fruit and vegetables combined (r = 0.69) and the bland and altman plot, showed a homogeneous dispersion of points around the line of the differences for the consumption of fruit and vegetable. For FFQ reproducibility the spearman coefficient values ranged from 0.47 for fruit intake to 0.73 for vegetable and fruit combined intake. Cross-classification between the two methods showed that > 30% of subjects were classified correctly and the κw ranged between 0.425 for fruit to 0.605 for vegetable and fruit, indicating from moderate to substantial level of agreement. The results on validation and reproducibility indicate that the two methods (FFQ and 24HR) give similar results. Food frequency questionnaire has validity and reproducibility to evaluate intake of fruit and vegetable in schoolchildren from northwest Mexico, and can be used to evaluate changes in fruit and vegetable intake on intervention programs, specially aimed to increase the consumption of such food.
Keywords: Food Frequency Questionnaire, Validity, Fruit and Vegetable Intake, Schoolchildren, Northwest Mexico
In September 2004, WHO office In Kobe Japan held the first workshop on "fruits and vegetables for health", led by experts from the sectors of nutrition, agriculture and health and other institutions. The objective of this workshop was the improvement of working parameters to guide the development of interventions promoting fruit and vegetables consumption in the world. Two of the conclusions of the workshop included recommendations for further work to promote the intake of fruits and vegetables, involving the development of intervention models, especially in developing countries and, the improvement of simple tools to measure the effectiveness of such interventions, as short food frequency questionnaires .
The World Health Organization (WHO) suggests a daily intake of 400 g of fruits and vegetables to prevent chronic diseases such as heart disease, cancer, diabetes or obesity; as well as to prevent and mitigate micronutrient deficiencies . However, the estimated current consumption of fruits and vegetables is highly variable around the world, ranging from 100 g per day in less developed countries to about 450 g per day in Western Europe .
In Mexico, the 2006 National Health and Nutrition Survey estimated that only 30% of Mexican population has an adequate intake of fruits and vegetables, and only 17% of the schoolchildren aged 5-11 years, adhere to the international recommendations . Therefore, Mexico have launched some nutritional public policies on healthy food products; including the National Strategy against Overweight and Obesity. One of the objectives of this program is to promote the design of intervention programs to increase the daily consumption of at least 5 fruits and vegetables in schoolchildren . Public Health Institutions have being doing some efforts to meet the recommendations. Thus, the results of the National Survey of Health and Nutrition 2012, demonstrated that the consumption of fruits and vegetables was 34.4% in the schoolchildren . Therefore, it is important to consider the suggestion of WHO of having valid and reproducible dietary tools that can accurately determine changes in the consumption of fruits and vegetables, especially when interventions aimed to increase its consumption. The food frequency questionnaire (FFQ) is a tool suggested by epidemiologists to explore changes over time in food consumption because it is cheap, easy and quick to apply. One of the advantage of FFQ is that requires less effort by the respondent than other methods, it does not alter the usual pattern of consumption and the variation of inter-individual intake is lower even with a single interview of FFQ when compared with a single application of a 24HR. The FFQ is able to classify individuals by its consumption allowing comparisons and identifying high-risk behaviors . Although some studies indicate that consumption of fruits and vegetables among Mexican schoolchildren is limited, there is not an exclusive FFQ to assess its consumption. Ramirez-Silva et al. (2009), reported that consumption of fruits and vegetables among schoolchildren in the northern region of Mexico, is low compared to the center and south regions .
Therefore, having a valid and reproducible FFQ that reveals the cultural and seasonal consumption of fruits and vegetables in schoolchildren in Northwest Mexico, is important for carrying out interventions that promote the consumption of fruits and vegetables.
In the international context, there are well validated FFQs, designed to assess fruit and vegetable consumption [9–13]. However, all of these studies have a cross-sectional design. Conversely, our study determined fruit and vegetable consumption after an intervention aimed to increase its consumption. Thus, we wanted to validate the FFQ and to estimate its reproducibility to classified schoolchildren from Northwest Mexico, according to their usual fruit and vegetable intake and the changes in their consumption.
2.1. Study Design and Subjects
In total, 189 participants were randomly recruited for the study from august 2009 to September 2010 from Northwest Mexico. The participants were first grade students of public primary school aged between 6 to 8 years old including boys and girls. An inclusion criteria used in this study, was to select the participants considering the index of marginalization (IM) where their schools were located. IM is a measure of lack in education, housing services and monetary income; and classifies regions in five categories: very low, low, medium, high and very high. Higher IM indicates lower income, poor housing services and lower education. For this study only areas with very low to medium IM were selected.
After having received verbal and written information, all participants gave written consent about the study. The study was carried out at the Health Sciences Postgrad of University of Sonora and was approved by the local ethics committee.
2.2. FFQ Development
To design the FFQ of fruit and vegetable, two nonconsecutive 24 hour dietary recalls (24HR), applied by a trained interviewer were collected from 60 schoolchildren and a 1 day 24HR from 129, making 249 dietary recalls. Food and beverages consumed by schoolchildren during the 24 hours before the interview were registered. The day was divided in six periods (morning, midmorning, lunch time, afternoon, dinner and later in the evening). 24HRs were applied to the child in the presence of his mother. The amount of each food and drink consumed was recorded, regardless of whether or not it was fruit or vegetable, including recipes and preparation form. Cardboard and plastic food models were used to obtain a more accurate quantitative estimate of dietary intake.
From the dietary information of the 24HR, a selection of fruit and vegetable to include them in the FFQ was performed according to the following criteria: a) fresh fruits and 100% pure juice were listed in the fruit group; b) vegetables were considered those fresh or cooked; and c) food consumed by at least 30% of the population on one week .
FFQ was ordered as follow:
Food groups: Selected foods were classified into two groups: 1) fruits and 2) vegetables, and both were sorted alphabetically.
Mean portion: To obtain the mean portion (0.50), the average consumption of each fruit and vegetable was estimated in grams from the nonconsecutive 24HR. The mean portion in the questionnaire was added in terms of numbers of pieces, slices or household measures for quantitative estimation .
Size portion: Three categories of portion size were defined: small (S), medium (M) and large (L). Small and large sizes were defined as 0.25 and 0.75 respects to mean portion .
Frequency: Five response categories were established: daily (D), weekly (W), monthly (M), yearly (Y) and never (N) according to Block et al. .
A total of 36 items constituted the food frequency questionnaire and it was applied to the child’s parent or caregiver (Figure 1).
2.3. FFQ Validation and Reproducibility
To evaluate validity and reproducibility, 124 schoolchildren were chosen. Then, they were randomly divided into two groups: intervention (62) used for reproducibility and control (62) to evaluate validity. Only the intervention group received a program that promotes consumption of fruits and vegetables for a period of 6 months. Data collection period to validity and reproducibility are showed in Figure 2.
2.4. Additional Surveys
A socio-demographic questionnaire to parents was applied. Marital status, head of the household, level of education of both parents were asked, and whether or not they had medical services. Schoolchildren were measured weight and height in accordance to the internationally standardized procedures. The weight and height were assessed by the WHO Anthro version 1.0.4 Plus program, obtaining the body mass index for age Z score .
2.5. Data Analysis
All statistical analyses and calculations were performed using the computer program IBM SPSS statistic version 19 .
Data from the first food frequency questionnaire (FFQ1), second food frequency questionnaire (FFQ2) and the estimated from 24 hour recalls were recorded in grams. Differences between the sociodemographic characteristics and anthropometrics data of the participants were assessed using Chi2, Mann-Whitney and independent T test.
Validity of FFQ was made with dietary data from control group. A comparison of intake´s median of fruits, vegetables and total fruits and vegetables from two 24HR and FFQ1 using Wilcoxon test was made. Also, Spearman correlation coefficients were used to measure the strength of the relationship between the consumption of fruits, vegetables and fruits and total vegetables between two 24-hour recalls and FFQ1. Likewise, a Bland-Altman analysis was performed to graphically examine the agreement between the two methods (FFQ1 and 24HR). The plots include lines for the mean difference and the Limits of Agreement (LOA), defined as mean difference ± 1.96 x SD
Spearman correlation coefficient was used to assess the reproducibility and the effect of the intervention for correlations between (changes in) dietary intake assessed with the FFQ1 and FFQ2. The degree of agreement between FFQ1 and FFQ2 was further evaluated using contingency tables of tertiles and weighted Kappa (κw) test with values of κw between 0.40 and 0.59 considered moderate, 0.60 to 0.79 substantial and 0.8 outstanding as per Landis & Koch . Also, a Bland-Altman plot from the intake of fruit and vegetable from FFQ1 and FFQ2 was used to graphically examine the agreement between FFQ1 and FFQ2.
3.1. General Characteristics
A total of 124 participants completed the FFQ1, FFQ2 and two 24HR. The average age of intervened schoolchildren was 7.2 years (range 6.6-8.5) and 7.1 years of the control group (range 6.6-7.6). Weight, height and BMI/age percentile are shown in Table 1.
1 T test for independent samples
Sociodemographic characteristics of families in both study groups are shown in Table 2. In both groups the average family size was 5 members. Parents are mostly household responsible and most of them were married. The educational level of parents was quite similar in both groups and more than 85% of schoolchildren in both groups had free medical service.
|Marital status (mother)1||Married||45||72.6||47||73.4||0.91|
|Parents School level1||Elementary||7||5.8||6||5.0||0.22|
|Jr. High school||41||34.2||39||32.8|
|Family monthly income (USD)2||791||681||0.21|
|(554, 1231)||(475, 1187)|
|Family size (mean)3||5±1||5±1||0.9|
1 Chi2 test
2 Mann-Whitney test
3 Independent sample T test
3.2. FFQ Validation
The mean intake estimated in the control group with two 24HR and the FFQ1 for only vegetable and the combined vegetable and fruit did not differ significantly. In contrast, the consumption of fruit estimated by both methods was statistically different (Table 3). There was a moderate correlation between FFQ1 and the two 24HR to estimate the consumption of fruit or vegetable and improve of fruit and vegetables combined in the control group (Table 3).
|Food intake||24HR||FFQ1||P||r (24 HR vs. FFQ1)|
|Total Fruit (g)||291.3 (193.7, 512.8)||250.4 (147.5, 383.4)||0.031||0.38*|
|Total Vegetable (g)||85.9 (47.6, 135.0)||77.8 (51.0, 132.9)||0.664||0.48**|
|Total Vegetable and Fruit (g)||459.3 (254.3, 646.7)||470.2 (201.0, 482.0)||0.573||0.69**|
For intake comparison we use the Wilcoxon paired test. Data are showed as median (interquartile values)
*P= 0.041, **P= 0.001
The degree of concordance between the consumption of fruit and vegetable estimated by two 24HR and the FFQ, showed a homogeneous dispersion of points around the line of the differences for the consumption of fruit and vegetable in the control group (Figure 3). However, the degree of agreement of the consumption of fruit and vegetable in the intervention group analyzed with the FFQ1 and FFQ2, showed a less homogeneous dispersion, with the majority of the points located at the bottom of the line of the differences; nevertheless, they lie within two standard deviations suggested (Figure 4).
3.3. FFQ Reproducibility
Regarding the reproducibility of the questionnaire, the Spearman coefficient values ranged from 0.47 for the consumption of fruit to 0.73 for the consumption of vegetable and fruit. All associations were significant (Table 4).
|Food intake||FFQ1 vs. FFQ2||P|
|Total Fruit (g)||0.47||0.025|
|Total Vegetable (g)||0.49||0.001|
|Total Vegetable and Fruit (g)||0.73||0.001|
Table 5, illustrates the reproducibility of the FFQ in terms of absolute agreement (cross-classification of participants by tertiles) between the FFQ1 and FFQ2. The questionnaire classified over 30% of the participants in the same category of consumption of fruit, vegetable and fruit and vegetable combined, when the FFQ was administered repeatedly. κw ranged between 0.425 for fruit to 0.605 for vegetable and fruit, indicating a moderate to substantial level of agreement (Table 5).
|Vegetable and fruit||60||40||95||0.605|
* T1, T2 and T3 correspond to tertiles of consumption
This study was conducted to validate and determine the reproducibility of a short FFQ designed to measure changes in the intake of fruit and vegetable in a Mexican school population where the consumption is only of 34% .
The results on validation average indicate that overall the two methods (FFQ and 24HR) give similar results (r=0.69). This is based on a good correlation between total fruit and vegetable intake measured by both methods. After 6 month of intervention, the reproducibility on total consumption of fruit and vegetable of the questionnaire was 0.73. According to these results the magnitude of association is high for both validation and reproducibility.
Our food frequency questionnaire seems therefore less suitable for measuring vegetable and fruit consumption alone than combined fruit and vegetable intake. In fact, the weakest correlations were obtained from consumption of fruit. Other research studies have obtained correlations slightly higher for consumption of only fruit than the obtained in our work [21-24]. There are possible explanations for this level of validity for fruit. Schoolchildren might eat fruit less frequently or by season which can lead to a lower validity for this variable. Otherwise, is possible to require more 24HR to be applied for a more precise estimation of fruit intake. We think that it could be because the list of food items in the present study was kept short too (36 items). That is why in this FFQ some open questions have been added to know if schoolchildren have consumed a fruit or vegetable not listed on it. In general, the correlations observed in the literature ranged from 0.5 to 0.8; this studio has similar correlations except the one for consumption of only fruit [22-28].
On the other hand, with the Bland-Altman test, the validation was confirmed by observing consistent distribution of points for the control group when the total consumption of fruit and vegetable obtained by the 24H recall was compared with that of FFQ1. Moreover, the distribution of points behaved differently when the difference in the consumption of fruits and vegetables of FFQ1 against FFQ2 in the intervention group was plotted; here, most of the points were distributed at the bottom of the chart, which was expected because the consumption of fruits and vegetables was promoted and therefore the difference between consumption by FFQ1 and FFQ2 turned to the most schoolchildren in a negative value. These results indicate that the questionnaire is reproducible to measure changes in consumption of fruits and vegetables in schoolchildren.
Another result that confirmed reproducibility of the food frequency questionnaire was the cross tabulation, which ranks individuals according to fruit and vegetable intake, when compared the FFQ1 vs. FFQ2. The distribution of fruit and vegetable intake was acceptable to be divided into equal tertiles, so it may be consider reproducible to assess changes in consumption over time.
Mexico has a food frequency questionnaire made with 130 foods classified into 16 food groups to estimate the usual diet in Mexican schoolchildren aged 5 to 11 years designed by the National Health Survey (validation is not published). However, is not exclusive to evaluate the consumption of fruits and vegetables, and its application takes longer . In addition, the Mexican FFQ includes fruits and vegetables commonly consumed in the south and center of the country, but little or no consumed in the northwest region. For example, fried banana, crystallized or dried fruit, fruit in syrup, chayote, etc. and in turn discarded fruits and vegetables commonly consumed by schoolchildren in the northwest. Researchers in the area of social nutrition, considered inappropriate to include unusual food consumption, because it would fall into a false response (e.g., shame can lead them to say regularly consuming such foods) and consequently an overestimation of consumption of such food. In this sense, there are two important advantages offered by our questionnaire. First, the exclusivity to estimate the consumption of fruit and vegetable and therefore an application time of only 15 minutes, plus the included foods are culturally consumed by schoolchildren from northwest Mexico. Furthermore, several studies have shown that the intra- and inter-subject variation decreases when information is recorded by frequency consumption than by other dietary method . A limitation of this study might be the relatively small sample size. However, even so, this sample size is most likely to be sufficient, given the positive results found.
Finally, due to the overweight and obesity epidemic facing schoolchildren (up 34.4%) in Mexico, which is the highest in the world ; this questionnaire will be useful for studies and intervention programs for promoting consumption fruit and vegetable in the schools in the short and medium term.
This food frequency questionnaire has validity and reproducibility to evaluate intake of fruit and vegetable in schoolchildren from northwest Mexico, and can be used to evaluate changes in fruit and vegetable intake on intervention programs, specially aimed to increase the consumption of such food. Due to this FFQ has open questions about the consumption of fruits and vegetables, it has the possibility of increase the quantity of items, this fact will improve the estimation of habitual intake of fruit and vegetables in schoolchildren.