Validity of 10 Electronic Pedometers for Measuring Steps, Distance, and Energy Cost : Medicine & Science in Sports & Exercise

Journal Logo

APPLIED SCIENCES: Physical Fitness and Performance

Validity of 10 Electronic Pedometers for Measuring Steps, Distance, and Energy Cost

CROUTER, SCOTT E.; SCHNEIDER, PATRICK L.; KARABULUT, MURAT; BASSETT, DAVID R. JR.

Author Information
Medicine & Science in Sports & Exercise 35(8):p 1455-1460, August 2003. | DOI: 10.1249/01.MSS.0000078932.61440.A2
  • Free

Abstract

CROUTER, S. E., P. L. SCHNEIDER, M. KARABULUT, and D. R. BASSETT, JR. Validity of 10 Electronic Pedometers for Measuring Steps, Distance, and Energy Cost. Med. Sci. Sports Exerc., Vol. 35, No. 8, pp. 1455–1460, 2003.

Purpose 

This study examined the effects of walking speed on the accuracy and reliability of 10 pedometers: Yamasa Skeletone (SK), Sportline 330 (SL330) and 345 (SL345), Omron (OM), Yamax Digiwalker SW-701 (DW), Kenz Lifecorder (KZ), New Lifestyles 2000 (NL), Oregon Scientific (OR), Freestyle Pacer Pro (FR), and Walk4Life LS 2525 (WL).

Methods 

Ten subjects (33 ± 12 yr) walked on a treadmill at various speeds (54, 67, 80, 94, and 107 m·min−1) for 5-min stages. Simultaneously, an investigator determined steps by a hand counter and energy expenditure (kcal) by indirect calorimetry. Each brand was measured on the right and left sides.

Results 

Correlation coefficients between right and left sides exceeded 0.81 for all pedometers except OR (0.76) and SL345 (0.57). Most pedometers underestimated steps at 54 m·min−1, but accuracy for step counting improved at faster speeds. At 80 m·min−1 and above, six models (SK, OM, DW, KZ, NL, and WL) gave mean values that were within ± 1% of actual steps. Six pedometers displayed the distance traveled. Most of them estimated mean distance to within ± 10% at 80 m·min−1 but overestimated distance at slower speeds and underestimated distance at faster speeds. Eight pedometers displayed kilocalories, but except for KZ and NL, it is unclear whether this should reflect net or gross kilocalories. If one assumes they display net kilocalories, the general trend was an overestimation of kilocalories at every speed. If one assumes they display gross kilocalorie, then seven of the eight pedometers were accurate to within ±30% at all speeds.

Conclusion 

In general, pedometers are most accurate for assessing steps, less accurate for assessing distance, and even less accurate for assessing kilocalories.

The electronic pedometer is a simple device that can be used to assess physical activity. In recent years, a wide variety of new electronic pedometers have been introduced, which makes it necessary to test these new devices for accuracy and reliability. With the phasing out of older analog models, the pedometer has evolved into a device that can also estimate distance traveled and energy expenditure (kcal). Some models have internal clocks and can store information for viewing or downloading to a computer. Concerning principles of operation, electronic pedometers use three basic mechanisms for recording steps. The original and most basic is a spring-suspended horizontal lever arm that moves up and down in response to vertical displacement of the waist. The lever arm opens and closes an electrical circuit with each step, and the number of steps are counted (e.g., Yamax Digiwalker SW-701 and Sportline 345). Some newer models have incorporated a glass-enclosed magnetic reed proximity switch (e.g., Omron and Oregon Scientific). The third type has an accelerometer consisting of a horizontal beam and a piezoelectric crystal (e.g., New Lifestyles and Lifecorder); steps are determined from the number of zero-crossings of the instantaneous acceleration versus time curve.

In 1996, Bassett et al. (1) assessed the accuracy of five electronic pedometers. To date, it is the only multi-brand comparison study of electronic pedometers, and none of the pedometers they examined are currently available. Bassett et al. found that at a walking speed of 2.0 mph, pedometers underestimated steps by 50–75%, but they became more accurate as the walking speed increased. At self-selected walking speeds of 80–107 m·min−1, the Yamax Digiwalker DW-500 recorded average values for steps and distance that were within 1% of actual. Nelson et al. (9) looked at the validity of the Yamax Digiwalker DW-500 in reporting gross kilocalories. Nelson et al. showed that at walking speeds of 3–4 mph on the treadmill, it provides valid results, but it significantly underestimates gross kilocalories at 2 mph and below. However, it is possible that the kilocalorie values displayed by pedometers are supposed to reflect net kilocalories (i.e., physical activity energy expenditure, above resting).

In recent years, new recommendations have been issued concerning the amount of physical activity that one should perform on a regular basis. The current recommendation from the U.S. Surgeon General is to accumulate at least 30 min of moderate-intensity physical activity on most days of the week (16). This is also supported by the Centers for Disease Control and Prevention and the American College of Sports Medicine, which notes that the recommendation can be met by walking 2 miles briskly (10). Studies have shown that 30 min of brisk walking is equal to 3100–4000 steps, depending on the age of the population (13,17,19), which allows one to quantify a time recommendation in terms of steps taken. Others recommend a different approach to daily physical activity. Hatano (6) advocates taking a total of 10,000 steps per day for cardiovascular disease prevention. At the University of Colorado Health Sciences Center, Hill had developed a program called “Colorado On The Move” and recommends a 2000-step increase above one’s normal step count for prevention of weight gain (8).

Taking into consideration these pedometer recommendations, the increasing use of pedometers in intervention studies, and their potential for surveillance of physical activity, it is important to have valid devices for measurement. Therefore, the purpose of this study was to examine the accuracy and reliability of 10 electronic pedometers for measuring steps taken, distance traveled, and kilocalories at various treadmill walking speeds.

METHODS

Subjects.

Five males and five females from the University of Tennessee volunteered to participate in the study. The average (± SD) age and body mass index (BMI) were 33 ± 12 yr and 25.7 ± 6.3, respectively. The testing protocol was approved by the University of Tennessee Institutional Review Board before the start. Written informed consent was obtained from all subjects before testing. Age was recorded, and height and weight were measured in street clothes (without shoes) with a stadiometer and calibrated physician’s scale, respectively. Stride length was measured by having the subjects take 20 strides down an indoor hallway at their normal walking speed. The total distance was divided by 20 to compute stride length. This was repeated three times and an average was programmed into the pedometers. Descriptive data of the subjects is presented in Table 1.

T1-30
TABLE 1:
Physical characteristics of subjects (mean ± SD).

Protocol.

Ten pedometers were examined to determine the effects of walking speed on steps taken, distance traveled, and energy expenditure (kcal): Yamasa Skeletone EM-180 (SK), Sportline 330 (SL330) and 345 (SL345), Omron HJ-105 (OM), Yamax Digiwalker SW-701 (DW), New Lifestyles NL-2000 (NL), Kenz Lifecorder (KZ), Oregon Scientific PE316CA (OR), Freestyle Pacer Pro (FR), and Walk4Life LS 2525 (WL). Before the first trial, the subjects received instructions for walking on the treadmill and were allowed time to adapt to walking at the various speeds. The subjects walked at speeds of 54, 67, 80, 94, and 107 m·min−1 on a motor driven treadmill (Quinton model Q55XT, Seattle, WA). The treadmill speed and grade were calibrated before testing according to the manufacturer’s instructions. Energy expenditure was measured by indirect calorimetry for all trials, except for devices that were solely step counters (SK and SL330). Measurements were made using a TrueMax 2400 computerized metabolic system (ParvoMedics, Salt Lake City, UT), which has been validated against the Douglas bag method in our laboratory (3). Before each test, the O2 and CO2 analyzers were calibrated using gases of known concentrations, and the flowmeter was calibrated using a 3.00-L syringe.

One electronic pedometer of each brand was worn on the right and left sides of the body, in the midline of the thigh. For the electronic pedometers that had a variable sensitivity switch (OR and OM), it was placed in the middle setting. Each trial consisted of 5 min of walking at the given speed to allow the subject to reach steady state. An average of the last 2 min was used for calculation of actual gross kilocalories. An investigator tallied actual steps with a hand counter. Between trials, the subject stepped off the treadmill for 1 min so that values from the electronic pedometers could be recorded.

Resting metabolic rate (RMR) was measured by a TrueMax 2400 metabolic system. The subjects came in early in the morning after an overnight fast, with the exception of water. They were also asked to refrain from the use of stimulants (including caffeine, tobacco, and medication) and intense physical activity. Once the subject arrived, they were allowed to relax in a reclining position while the test was explained. Gas exchange measurements were made for 40 min. The first 20-min period allowed the individual to return to resting levels and adapt to the mouthpiece, and the second 20 min-period was used for the determination of RMR. The measured RMR was then subtracted from the measured gross kilocalories, during treadmill walking, to obtain net kilocalories.

Statistical treatment.

Statistical analyses were carried out using SPSS version 11.0.1 for windows (SPSS Inc., Chicago, IL). Initially, two-way repeated measures ANOVA (side of body × speed) were carried out on each pedometer brand, but because the results showed no effects of placement site (L vs R), the two sides were averaged. Intraclass correlation coefficients were used to report comparison between right and left side measures of the same electronic pedometer. Subsequently, two-way ANOVA (speed × pedometer brand) were used to compare mean difference scores (pedometer minus actual) for steps taken, distance traveled, and net and gross kilocalories. An alpha of P < 0.05 was used to denote statistical significance. Although mean difference scores were used for statistical analysis, they do not give a good representation of how accurate the pedometer is when presented in a graph, because the total amount of steps are not known. Therefore, all graphs are presented with percent difference scores, which allow for easier illustration of how accurate the pedometers were.

RESULTS

All trials were completed without problems, except that one of the NL pedometers had to be replaced by a new device because of a broken mechanism. Correlation coefficients between the right and left sides exceeded 0.81 for all pedometers except OR (0.76) and SL345 (0.57) (Table 2).

T2-30
TABLE 2:
Intraclass correlation coefficients for pedometers worn on the right and left sides of the body.

Table 3 shows significant differences from actual steps, and Figure 1 shows percentage of actual steps at each speed. In general, pedometers tended to underestimate actual steps at 54 and 67 m·min−1. Several pedometers were accurate at speeds of 80 m·min−1 and above, with six models (SK, OM, DW, NL, KZ, and WL) providing mean values that were within ± 1% of actual steps. Only one pedometer (DW) did not significantly differ from actual steps at any speed (P > 0.05), whereas the OR was significantly different from actual steps at all speeds (P < 0.05).

T3-30
TABLE 3:
Pedometer accuracy for measuring steps during horizontal treadmill walking at five different speeds.
F1-30
FIGURE 1:
Effect of speed on pedometer accuracy (percentage of actual steps) during treadmill walking.

Six pedometers displayed the distance traveled (OM, DW, OR, SL345, FR, and WL). Table 4 shows significant differences from actual steps, and Figure 2 shows percentage of actual distance traveled at each speed. In general, the pedometers tended to overestimate distance traveled at slower speeds and underestimate distance traveled at higher speeds, with 80 m·min−1 being the most accurate speed for most pedometers. All electronic pedometers were significantly different (P < 0.05) for at least two speeds, except for FR, which was significantly different (P < 0.05) at only one speed (107 m·min−1).

T4-30
TABLE 4:
Pedometer accuracy for measuring distance traveled during horizontal treadmill walking at five different speeds.
F2-30
FIGURE 2:
Effect of speed on pedometer estimates of percentage of actual distance traveled during treadmill walking.

Eight pedometers displayed estimates of energy expenditure (OM, DW, NL, KZ, OR, SL345, FR, and WL). With the exception of NL and KZ, it is unclear whether they are displaying net or gross kilocalories. New Lifestyles NL-2000 and KZ estimate gross kilocalories by taking into account the subject’s RMR (based on input of age, gender, weight, and height). Table 5 shows significant differences from actual gross and net kilocalories. Figure 3 shows the percent difference from actual gross kilocalories at all speeds, and Figure 4 shows the percent differences from actual net kilocalories at all speeds. Only one electronic pedometer (FR) was not significantly different (P > 0.05) from gross kilocalories at any speed. For net kilocalories, all electronic pedometers were significantly different (P < 0.05) for at least four speeds, except for KZ, which was significantly different (P < 0.05) at only one speed (94 m·min−1).

T5-30
TABLE 5:
Pedometer accuracy for measuring gross and net kilocalories during horizontal treadmill walking at five different speeds.
F3-30
FIGURE 3:
Effects of speed on pedometer estimates of percent of actual gross kilocalories during treadmill walking.
F4-30
FIGURE 4:
Effects of walking speed on pedometer estimates of percentage of actual net kilocalories during treadmill walking.

DISCUSSION

The use of pedometers in both research and practice is rapidly growing, as these devices provide an inexpensive, objective means of assessing physical activity, and they are generally believed to be accurate and reliable. Researchers usually prefer to express pedometer data as “steps,” because that is the most direct expression of what the pedometer measures (11,14,15). Six pedometers (SK, OM, DW, NL, KZ, and WL) out of the 10 gave mean values that were within ± 1% of actual values at speeds of 80 m·min−1 and above. The Japanese industrial standards have set the maximum permissible error of miscounting steps at 3%, or 3 steps out of 100 (7). It is interesting that all five of the pedometers made by Japanese companies met this recommendation, whereas only one of the non-Japanese pedometers (WL, made in Taiwan) was as accurate.

At slower speeds, the pedometers were not as accurate in step counting. This results from the fact that vertical accelerations of the waist are less pronounced at slow walking speeds, so it is less likely that the threshold value to record a step (e.g., 0.35 g for DW) will be exceeded. Four pedometers (WL, KZ, NL, and DW) showed acceptable accuracy at speeds 54 m·min−1 (or 2 mph), indicating that these pedometers are a good choice for use in research studies. However, it should be noted that in the frail elderly or others with a slow, shuffling gait, even these brands of pedometers are probably inadequate to obtain a true assessment of walking (4,13,18).

Most pedometers were fairly accurate for measuring distance at a speed of 80 m·min−1, providing mean estimates that were within ± 10% of the actual values. The stride length that was programmed into the pedometer was determined at self-selected walking speeds, which approximate 84 m·min−1 in healthy adults (12). At slower speeds, the actual stride length was shorter than the value programmed into the pedometer, causing an overestimation of distance. At faster speeds, the actual stride length was longer than the programmed value, causing the distance to be underestimated.

The distance traveled was not only affected by stride length but also by the sensitivity of the pedometers (and accuracy in counting steps). Two of the pedometers FR and SL345 appeared to be the most accurate for measuring distance at slower speeds (<80 m·min−1), but when other factors are taken into consideration, it can be seen that they grossly undercounted steps. This is a case of “compensating errors” where overestimation of stride length and underestimation of steps offset each other and make these two models appear accurate for assessing distance.

In most cases, it is not clear whether pedometers measure gross or net kilocalories. Previous investigators have reached different conclusions on what the measured kilocalories value given by the pedometer actually represents. Nelson et al. (9) assumed that the values displayed by the Yamax Digiwalker 500 were gross kilocalories and found that at normal walking speeds (80–107 m·min−1) it gave a close estimate of gross kilocalories. Bassett et al. (2), in a study of lifestyle activities (yard work, housework, childcare, occupational tasks, and recreation) assumed that they displayed net kilocalories (above RMR) and found that at walking speeds between 78 and 100 m·min−1 the Yamax SW-701 overestimates net kilocalories. During most other lifestyle activities, however, they saw an underestimation of net kilocalories. In looking at the kilocalories data from the present study, it appears that it should be assumed that electronic pedometers are estimating gross kilocalories if the activity mode is walking. This invariably means that pedometers will underestimate the cost of most other types of “lifestyle” activities, especially those involving arm activity, pushing or carrying objects, walking uphill, or stair climbing. This is a limitation when attempting to use pedometers to quantify daily physical activity energy expenditure (2). Nevertheless, pedometers are useful in that they provide a valid, reliable measure of ambulatory activity, which is one of the most prevalent forms of activity in today’s society (5,14). We believe that expressing pedometer data as “steps·d−1” provides an extremely useful index of an individual’s overall ambulatory activity level. Expressing the data in this manner eliminates the need to make adjustments for height or body weight when comparing individuals, which is advantageous.

The NL and KZ provide estimates of both net and gross kilocalories, made possible because they predict the user’s RMR based on age, height, weight, and gender. It should be noted that while although devices can be called “pedometers” because they measure steps, they are actually accelerometers in terms of principles of operation. Thus, activity energy expenditure is computed by integrating the acceleration versus time curve, and activities like jogging (where there is a greater amplitude of the acceleration curve) will be credited with more kilocaloriess per step than activities like walking. These two models are also unique in that they have internal memory chips that allow them to store data. The NL can store up to 7 d of data, whereas the KZ can store up to 42 d of data in 1-d epochs. This data storage feature may be useful for researchers who do not wish to rely on subjects “logging” their own steps.

Overall, it appears that DW is the most accurate at predicting steps, distance, and gross kilocalories for walking. The WL is close in terms of accuracy, although the reliability coefficient was only 0.84. The NL and KZ do not have the ability to measure distance, but they were among the most accurate at measuring steps. In addition, they have the ability to: (a) store multiple days of data, (b) distinguish between the kilocalories expended per step in walking and running, and (c) provide rough estimates of net and gross energy expenditure. The KZ can store 42 d of data, which can be downloaded to a computer for subsequent analysis. The drawback to KZ is that it has a higher cost, around $200, plus $250 for the computer interface and software.

In conclusion, it is not our intention to endorse any one pedometer for all purposes. Our objective is to make researchers aware of the validity of these devices and allow them to make the judgment of which pedometer to use. Whether the objective outcome is steps, distance, or kilocalories, consideration should be given as to which variable is the most important when determining which electronic pedometer to use.

The authors would like to thank Cary Springer (UTK Statistical Consulting Services) for performing the statistical analyses.

No financial support was received from any of the pedometer companies, importers, or retailers. The results of the present study do not constitute endorsement of the products by the authors or ACSM.

REFERENCES

1. Bassett, D. R., B. E. Ainsworth, S. R. Leggett, et al. Accuracy of five electronic pedometers for measuring distance walked. Med. Sci. Sports Exerc. 28: 1071–1077, 1996.
2. Bassett, D. R., B. E. Ainsworth, A. M. Swartz, S. J. Strath, W. L. O’Brien, and G. A. King. Validity of four motion sensors in measuring moderate intensity physical activity. Med. Sci. Sports Exerc. 32: S471–S480, 2000.
3. Bassett, D. R., E. T. Howley, D. L. Thompson, G. A. King, S. J. Strath, J. E. Mclaughlin, and B. B. Parr. Validity of inspiratory and expiratory methods of measuring gas exchange with a computerized system. J. Appl. Physiol. 91: 218–224, 2001.
4. Bassett, D. R., and S. J. Strath. Use of pedometers to assess physical activity. In: Physical Activity Assessments for Health-Related Research, G. J. Welk (Ed.). Champaign, IL: Human Kinetics, 2002, pp.163–177.
5. Crespro, C. J., S. J. Keteyian, G. W. Heath, and C. T. Sempos. Leisure-time physical activity among US adults. Arch. Intern. Med. 156: 93–98, 1996.
6. Hatano, Y. Use of the pedometer for promoting daily waking exercise. International Council for Health, Physical Education, and Recreation 29: 4–8, 1993.
7. Hatano, Y. Prevalence and use of pedometer. Res. J. Walking 1: 45–54, 1997.
8. Hellmich, N. Get with the 2,000-step program: walk an extra mile, shoo away weight gain. USA Today, Oct. 24, 8D, 2002.
9. Nelson, T. E., N. Y. J. M. Leenders, and W. M. Sherman. Comparison of activity monitors worn during treadmill walking (Abstract). Med. Sci. Sports Exerc. 30: S11, 1998.
10. Pate, R. R., M. Pratt, S. N. Blair, et al. Physical activity and public health: a recommendation from the Centers for Disease Control and Prevention and the American College of Sports Medicine. JAMA 273: 402–407, 1995.
11. Rowlands, A. V., R. G. Eston, and E. K. Ingledew. Measurement of physical activity in children with particular reference to the use of heart rate and pedometry. Sports Med. 24: 258–272, 1997.
12. Temes, W. C. Cardiac rehabilitation. In: Essentials of Cardiopulmonary Physical Therapy, E. A. Hillegass and H. S. Sadowsky (Eds.). Philadelphia: W.B. Saunders, 1994, pp. 633–676.
13. Tudor-Locke, C., R. Jones, A. M. Myers, D. H. Paterson, and N. A. Ecclestone. Contribution of structured exercise class participation and informal walking for exercise to daily physical activity in community-dwelling older adults. Res. Q. Exerc. Sport 73: 350–356, 2002.
14. Tudor-Locke, C. E., and A. M. Myers. Challenges and opportunities for measuring physical activity in sedentary adults. Sports Med. 31: 91–100, 2001.
15. Tudor-Locke, C. E., and A. M. Myers. Methodological considerations for researchers and practitioners using pedometers to measure physical (ambulatory) activity. Res. Q. Exerc. Sport 72: 1–12, 2001.
16. U.S. Department of Health and Human Services. Physical Activity and Health: A Report of the Surgeon General. Atlanta, GA: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, 1996.
17. Welk, G. J., J. A. Differding, R. W. Thompson, S. N. Blair, J. Dziura, and P. Hart. The utility of the Digi-Walker step counter to assess daily physical activity patterns. Med. Sci. Sports Exerc. 32: S481–488, 2000.
18. Wilcox, S., C. E. Tudor-Locke, and B. E. Ainsworth. Physical activity patterns, assessment, and motivation in older adults. In: Gender, Physical Activity and Aging, R. J. Shephard (Ed.). Boca Raton, FL: CRC Press, 2002, pp. 13–39.
19. Wilde, B. E., C. L. Sidman, and C. B. Corbin. A 10,000 step count as a physical activity target for sedentary women. Res. Q. Exerc. Sport 72: 411–414, 2001.
Keywords:

ENERGY EXPENDITURE; PHYSICAL ACTIVITY; LOCOMOTION; AND EXERCISE

©2003The American College of Sports Medicine