This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
It is a challenge to assess children's dietary intake. The digital photographic method (DPM) may be an objective method that can overcome some of these challenges.
The aim of this study was to evaluate the validity and reliability of a DPM to assess the quality of dietary intake from school lunch sandwiches brought from home among children aged 7–13 years.
School lunch sandwiches (
Correlation coefficients between the DPM and the weighed foods ranged from 0.89 to 0.97. The proportion of meals classified in the same or an adjacent quartile ranged from 98% (starch) to 100% (fruits, vegetables, fish, whole grain, and Meal IQ). There was no statistical difference between fish, fat, starch, whole grains, and Meal IQ using the two methods. Differences were found for fruits and vegetables; Bland–Altman analyses showed a tendency to underestimate high amounts of these variables using the DPM. For interrater reliability, kappa statistics ranged from 0.59 to 0.82 across the dietary components and Meal IQ.
The standardised DPM is a valid and reliable method for assessing the dietary quality of school lunch sandwiches brought from home.
Childhood represents an important life stage for the development of healthy nutritional behaviour, and some evidence exists that nutritional behaviour tracks from childhood into adulthood (
The accuracy of self-reported methods has been questioned. Studies using doubly labelled water have shown that misreporting of food intake is a common problem for these methods (
The digital photographic method (DPM) is a relatively new method. It overcomes children's recall problems and difficulties in estimating portion sizes, and it also minimises the burden of the respondent. The method is unobtrusive, highly reliable, and highly valid when used to estimate the food intake of individual meals of adults and school children in cafeteria settings (
It is relatively easy to get information on the composition of lunches provided by the schools, because recipes are available and through them more information on the non-visual food items; furthermore, the meals are often standardised. However, it can be a major challenge to collect objective data on lunches brought from home. In Denmark, school lunches brought from home usually comprise open sandwiches (often on rye bread) with spread and cold sliced meat, sometimes with fruits and vegetables (
The aim of this study was to evaluate the validity and reliability of a DPM to assess the quality of dietary intake from school lunch sandwiches brought from home among children aged 7–13 years.
A total of 191 school lunch sandwiches were prepared based on digital images from a database comprising 2735 school lunch sandwiches brought from home. The database was developed as part of another project where school lunch sandwiches were collected from 8 schools representing different geographical areas in Denmark and from children aged 7–13 years. The size of the study sample was chosen to ensure presence of all relevant food components examined in the dietary assessment procedure (especially fish and snack products) described below. Around 200 lunches would ensure this aspect and because there were 8 schools and two age groups, 12 lunches from each age group and from each of the 8 schools were randomly selected – in total 192 lunches. One meal was excluded because it consisted of only beverages. When the digital images were collected for the database all children were asked to show clearly any non-visible food items (like spreads). During the preparation of the school lunch sandwiches the weight in grams of each food component was registered using a Soehnle 8026 digital balance (0–1,000 g=1 g, 1,000–2,000 g=2 g). A digital image was taken of the final lunch following the procedure described below.
A standardised DPM was developed to collect data on the school lunch sandwiches. The meals were photographed using a digital camera (Nikon S700) mounted on a tripod with the lens 0.37 m above the meal with a camera angle of approximately 45° – a procedure that allows visibility of the foods in three dimensions in a digital image. To standardise the digital images, a placemat (0.6×0.6 m) with markings for placement of the plate and some standardised cutlery were fixed to a table. The placemat was divided into squares of 2×2 cm to support the estimation of the size and weight of the different food items. Markings were also made for where to place the camera tripod. To optimise and standardise the quality of the digital images, a cube light was used (
The standardised digital photographic method.
A Meal IQ that was developed as a scoring system and published earlier (
Study design. d.i.: digital images.
Fruits, vegetables, and fish were estimated in grams. To estimate total fat, saturated fat, whole grain, and snack products in the lunch meals, unit sizes were defined in terms of household measures, such as slices, cups, and pieces (
The components of the Meal IQ and the total Meal IQ score were determined from the objectively weighed 191 school lunch sandwiches. Fruits, vegetables, and fish were already registered in grams, and although weights in grams were assigned to each of the units, it was possible from the registered weights of the food items to calculate the number of fat, saturated fat, starchy, and whole-grain units (to measure the relative (total) fat content of the meal, the number of fat units was subtracted from the number of starchy food units).
The components of the Meal IQ and the total Meal IQ score were also determined from the digital images. To support the conversion of food items in the digital images into weights and unit sizes, reference material was developed. The reference foods were selected to represent the foods most frequently consumed at school lunch by children who brought lunches from home, selected on the basis of the 191 meals representing the study sample. Each food item was photographed in up to eight different portion sizes, and prepared or cut in different ways. The food items were also photographed in different positions on the plate – at the back and the front and at one of the sides of the plate. The reference foods were photographed with exactly the same camera angle and distance from the food, using a cube light so that the apparent size of all foods remained constant across the digital images. These reference foods were supplemented with material from a previous study also using a standardised DPM (
Some food items are in standardised portions. These products were not photographed but instead presented in reference lists. Some fatty foods (e.g. sliced meat) were presented in a reference list containing information about typical portion sizes and information on content of fat per 100 g and per portion of the food item, which is necessary for estimating the fat units [see Ref. (
If food items that did not make their fat content visible were presented in the digital images, for example, we used data from GfK (Gesellschaft für Konsumforschung) Denmark, which does market research, to determine the type of product. The assessment was in these cases based on information on the most used product of the category (
A database was developed using Microsoft Excel for the dietary assessment of the 191 digital images in order to make the necessary notes on the dietary components (grams or units) while watching the digital image.
Ten school lunch sandwiches were used to train the image analysts in portion size estimation on the basis of the photographed reference foods and reference lists. Different persons handled the test and reference methods.
The standardised DPM was validated, testing the agreement of the dietary components included in the Meal IQ and the overall Meal IQ score obtained using the digital images and the weighed foods of the lunches (
Interrater reliability testing was conducted on the standardised DPM to assess the ability of the method to yield consistent results for the amount of fruits, vegetables, fish, and fat units (inclusive saturated fat units); the amount of starchy units (inclusive units from whole-grain products); the presence of snack products; as well as the overall dietary quality measured by the Meal IQ score by two raters. The two digital-image analysts’ ratings were compared for each dietary component and the total Meal IQ score for the 191 digital images of the school lunches.
Most of the dietary data were non-normally distributed, both before and after log transformation; therefore, medians and 5th and 95th percentiles are presented. The Wilcoxon signed-rank test was used to analyse the difference in dietary components, and the Meal IQ assessed by the DPM and the food record method.
To validate the DPM, correlation coefficients between the selected dietary components and the Meal IQ estimated from the digital images and from the weighed foods were assessed. As the data on dietary intake were not normally distributed, Spearman's correlation coefficient was used (
To test the interrater reliability of the DPM, a weighted kappa statistic was calculated for each of the dietary components and the Meal IQ. To conduct the kappa statistics on the continuous components and the Meal IQ, the variables were divided into 10 groups according to percentiles.
In the analysis specific for fruits, vegetables, and fish, the meals not containing the respective food item were excluded from the analysis in both the validity and reliability testing.
Each of the dietary components and the Meal IQ were estimated from the digital images and the weighed foods of the lunches.
Dietary components and the Meal IQ score estimated from weighed foods and digital images (median and 5th and 95th percentiles)
| Components |
|
Actual content from weighed foods: median (P5, P95)§ | Estimated content from digital images: median (P5, P95)§ |
|
Classified into same/same or adjacent quartile (%) | Correlation coefficients Spearman$ |
|---|---|---|---|---|---|---|
| Fruits (g) | 67 | 87 (13; 195) | 80 (15; 174) | <0.0001 | 84/100 | 0.96 |
| Vegetables (g) | 130 | 52 (10; 141) | 48 (10; 125) | 0.0003 | 76/100 | 0.96 |
| Fish (g) | 21 | 24 (11; 50) | 22 (7; 52) | 0.0611 | 81/100 | 0.89 |
| Fat units | 191 | 1.5 (0; 4.5) | 1.5 (0; 5) | 0.0855 | 79/99 | 0.93 |
| Saturated fat units | 191 | 1.5 (0; 4) | 1.5 (0; 4) | 0.0457 | 72/99 | 0.91 |
| Starchy units | 191 | 1.75 (0.5; 3.5) | 1.75 (0.5; 3) | 0.2344 | 74/98 | 0.89 |
| Whole grain units | 191 | 1 (0; 2.5) | 1 (0; 2) | 0.0615 | 87/100 | 0.96 |
| Meal IQ score | 191 | 16 (5; 20) | 16 (6; 20) | 0.3394 | 80/100 | 0.97 |
§P5: 5th percentile; P95: 95th percentile.
$All Spearman's correlation coefficients were significant,
The Spearman correlation coefficients between the dietary components and the Meal IQ estimated from the digital images or the weighed foods were highest for the Meal IQ score (
The proportion of meals classified in the same or adjacent quartiles of dietary intake ranged from 98% (starchy units) to 100% (fruits, vegetables, fish, and whole-grain units, and total score of Meal IQ). Gross misclassification was not found for any of the dietary components or the total Meal IQ score (
Snack products were present in only 13 of the 191 lunches, and the assessment of the occurrence was correct in all the cases.
Bland–Altman plots of agreement on the weight of fruits (
The results for interrater reliability of the dietary components and the Meal IQ are reported in
Interrater reliability measures of the digital photographic method using weighted kappa test statistics (
| Interrater | Reliability | |
|---|---|---|
| Components in Meal IQ | Kappa | 95% confidence interval |
| Fruits | 0.82 | 0.76–0.88 |
| Vegetables | 0.79 | 0.75–0.83 |
| Fish | 0.70 | 0.60–0.79 |
| Fat units | 0.69 | 0.63–0.74 |
| Saturated fat units | 0.69 | 0.64–0.75 |
| Starchy units | 0.59 | 0.52–0.66 |
| Whole-grain units | 0.76 | 0.68–0.84 |
| Presence of snack products | 0.80* | 0.69–0.91 |
| Meal IQ | 0.76 | 0.72–0.81 |
*Simple kappa coefficient.
This study is the first to investigate if a standardised DPM is valid and reliable for assessment of selected dietary components and the overall dietary quality of school lunch sandwiches brought from home.
The analysis of the difference between the amount of fruits and vegetables estimated from the digital images shows a difference from the weighed foods, despite almost the same medians and averages of these variables. The Bland–Altman analyses show acceptable limits of agreement for fruits (−29.4 and 20.8 g) and vegetables (−34.5 and 22.2 g), with some variability but on the same level as found by others (
When estimating the defined units of fat, starch, and whole grains from the digital images, no statistical difference from the weighed foods was shown. It is easier to estimate variables in household measures, because they do not require the same degree of accuracy as the variables assessed in grams. But for fish, no difference between the estimated amount from the digital images and the true weight from the food record was found, probably because it is easier to estimate the relatively small amounts of fish compared to the voluminous and especially large quantities of fruits and/or vegetables. The Bland–Altman analysis for fish shows tight limits of agreement (−14.7 to 10.0 g), but also for this food item, the Bland–Altman plots illustrate a tendency towards larger variability of the range of intake. This result must be treated with caution, since the sample for the fish analyses is relatively small (
The Meal IQ consists of both the variables estimated in grams and components assessed in units. Compared to the results from the weighed food record method, the DPM was found to provide a good assessment of the overall dietary quality assessed by the Meal IQ. No difference was found between the Meal IQ score assessed using the two methods (
The correlation coefficients between the dietary components and the Meal IQ assessed from either the DPM or the weighed food record were high (
In this study, the interrater reliability was assessed from kappa statistics. The kappa coefficient shows a moderate strength of agreement for the assessment of starchy units by the two raters (
The validity and reliability of the method are highly dependent on the skills of the image analysts. To reduce the variability caused by using many raters, intensive training of one or possibly two raters might be preferable to training many raters. Also, future training procedures of image analysts should focus on the underestimation we found, especially for the high amount for fruits and vegetables. Others have also reported underestimation when using the DPM (
An advantage of the DPM is the opportunity to collect dietary intake data from large populations (
The most time-consuming step when using the DPM for dietary assessment is the nutritional evaluation, due to reliance on human analysts to estimate food intake and possibly subsequent calculations of the nutrient content. To make the method as cost-effective as possible, we used the Meal IQ in addition to the individual dietary components to assess the dietary quality of the lunches. The Meal IQ score is obtained easily through a simple evaluation process. There is no need to calculate the nutrient content, which would make the calculation of the total score more complex and labour intensive.
It is challenging to assess digital images of school lunch sandwiches brought from home rather than school lunches provided by the school, because recipes and product specifications are not available. But we believe that the method is appropriate for this type of meal as well, because the school lunch sandwiches brought from home normally consist of bread, spread, sliced cold meat, and a piece of fruits or some vegetables, often in relatively standardised portions. A limitation of the DPM may be the dependence of visibility of the food or nutrient of concern. The digital images do not always show details about particular foods (e.g. fat-reduced products). In this study, we used data from GfK Denmark to determine the type of product when the digital image gave too little information (
The DPM is very unobtrusive and would probably not influence the usual eating patterns of the children, but this is still unclear.
This study shows that the DPM in combination with the Meal IQ is valid and reliable when used to assess the quality of dietary intake from school lunch sandwiches brought from home. There is no reason to believe that the DPM in combination with the Meal IQ would be less accurate with adults. The Meal IQ has to be adjusted just a little, so the cut-off points for the different components included in the Meal IQ are adapted to the official recommendations for adults.
Compared to the more traditional dietary assessment methods, the DPM has mainly been used to collect data on individual meals. Measuring the entire diet of free-living individuals complicates the usability of the DPM. Normally, the respondents are not involved in the collection of data. If the whole diet has to be assessed, it will require that the respondents capture the digital images themselves, thereby introducing greater burden on the respondent and the possibility of increased estimation errors because of lower photo quality and a decreased standardisation of the method. The higher response burden could also affect the compliance negatively. Some studies have examined the possibility of assessing food intake among free-living people. Lassen et al. (
When food selection and also food intake have to be measured, the standardised DPM is most appropriate when the study population eats in a cafeteria or a classroom, because this makes it possible to collect data on the leftovers. In Denmark, the oldest students often go outside the school during the lunch break, which complicates the use of a standardised DPM. Other methods that incorporate technology would be appropriate for this target group. Boushey et al. (
There is much potential in technological methods for assessment of dietary intake, and future advancements are possible (
Automation of the nutrient evaluation could be developed and would improve the cost-effectiveness of the method.
In conclusion, the standardised DPM is a valid and reliable approach for assessing the dietary quality of school lunch sandwiches brought from home for children aged 7–13 years. The method does not rely on the respondents to estimate portion sizes and overcomes the recall problems that exist when collecting dietary data on children. The method is cost-effective and enables data collection for large numbers of people. The method is potentially useful for evaluating the effect of different intervention programmes on dietary behaviours from diverse population groups across different ages.
The project is part of the EVIUS study funded by the Danish Food Industry Agency, DTU National Food Institute and Division of Nutrition, National Food Institute. All of the authors contributed to the study concept and design, interpretation of data, and preparation of the manuscript. The authors thank all participants in this study. They also thank Professor Bent Egberg Mikkelsen, Food, People & Design, Department of Development and Planning, Aalborg University, for advice in the initial phase of the project; and Anne Dahl Lasse PhD, DTU National Food Institute, for advice and constructive discussions.
The authors declare no conflict of interest.