Nevala, Nina
Finnish Institute of Occupational Health / Topeliuksenkatu 41 a A
/ FIN-00250 Helsinki, Finland / Nina.Nevala@ttl.fi Juhola, Tiina
Finnish Institute of Occupational Health / Topeliuksenkatu 41 a A
/ FIN-00250 Helsinki, Finland Alaranta, Hannu
Käpylä Rehabilitation Centre, National Association of the Disabled
in Finland / Nordensköldinkatu 18 B / FI-00251 Helsinki, Finland
ABSTRACT
ABSTRACT
The aim of this study was to investigate the intra-observer reliability and usability of the Accessible Workplace Method (AWM) among workers with physical disabilities. The electrical checklist includes background factors and 31 items with assessing criteria. The method considers the employees' opinions about the problems related to the work and the means to solve them. The intra-rater reliability of the method was calculated as the percentage of agreement between two assessments made by 37 disabled workers. The accessible workplace method can be used as a part of the occupational health care services or rehabilitation process when design or redesign measures of workplaces are planned or work ability is assessed for employees with physical disabilities.
Keywords
Accessibility, disability, ergonomics, rehabilitation, design for all.
INTRODUCTION
Integration and reintegration of disabled people into ordinary employment is one of the main objectives of the rehabilitation [13]. Persons with permanent physical disabilities should have possibilities to continue working by means of ergonomic redesign measures and the use of aids [2,11,16]. However, only few redesign measures have been carried out at work of physically disabled employees in Finland [12].
Every fifth of the physically disabled workers (n=249) reported that they regularly need help of other persons at work [12]. This help was needed especially for materials handling, performing tasks requiring fine motor movements or force of the upper limbs, ”running affairs”, taking materials from high levels, and performing tasks requiring climbing. The study showed that the employees themselves recognize what kind of redesign measures they will need to increase their work ability. There are several possibilities to adjust the workstation e.g., in computerized work [8].
There is a need for a simple and reliable method for making ergonomic and accessibility assessments of work environments. To be interpretable, the method must be reliable. Wiktorin et al. [19] and Barriera-Viruet et al. [1] reported that the reliability of the self-report approach is too low in relation to the needs for ergonomic intervention. Accordingly, posture observation methods are often used for this purpose [3,5,6]. If the aim of the intervention is to optimise the physical work load and, at the same time, implement possible changes at workplaces, a more comprehensive method for ergonomic analyses is needed.
The Accessible Workplace Method (AWM) is an electrical checklist for evaluating accessibility and ergonomics of workplaces for employees with permanent physical disabilities. The AWM is based on a telephone interview [12], which was led to the development of the checklist [10]. The internal validity of the method was established through the collaboration of experts and users of the method. The AWM is available on the Internet. The AWM is a general checklist with criteria for accessibility evaluation. It is used to specify working conditions that need development or improvement and to help find optimal solutions to any problems. The AWM also applies the participatory approach [15,18], which has been successfully used in several studies to reduce physical work demands and improve ergonomics at workplaces [4,14].
There are few methods for evaluating ergonomics of workplaces for employees with permanent physical disabilities and no results are available concerning the reliability of the AWM. The aim of this study was to investigate the intra-observer reliability and usability of the AWM among workers with physical disabilities in openlabour market.
MATERIALS AND METHODS
Accessible Workplace Method
The AWM includes background factors and 31 accessibility items with special criteria: journey to work, parking the car, enclosure, the entrance to the building, use of doors, moving on passages, use of lifts, use of stairs, rescue facilities, kitchen/coffee room facilities, accessible toilet facilities, meeting rooms, space, design of the workstation, use of computer, use of work tools and machines, lighting, noise, temperature, safety, work posture, fine motor movements, reaching, manual materials handling, work tasks, amount of work and work pace, flexibility of work time, use of personal helper, equality, getting help of others, accessibility of occupational health care services.
Each item is assessed according to a three-level scale (Table 1). In addition, the employees' opinions about the problems related to the item and the means to solve them can be written. An electrical report of workplace accessibility will be printed after fulfilling the checklist. The report tells the items which are in order, partly in order and not in order and the most important redesign measures that are needed.
Table 1. Meaning of the three level scale of the Accessible Workplace Method
Level |
Value |
Meaning |
1 |
In order |
The criteria is fulfilled, the person can work as independently as possible |
2 |
Partly in order |
The criteria is partly fulfilled, the person has difficulties to work as independently as possible |
3 |
Not in order |
The criteria is not fulfilled, the person cannot work as independently as possible |
Subjects
The selection criteria for this study were that the person be employed, use some mobility aid (a lower limb prosthesis, cane, crutches, walking frame, wheelchair) due to a physical disability, be 18 - 65 years old, and be volunteer for this study (Figure 1). Twenty-four men and 13 women with the mean age of 44 years participated. Several different diagnoses were represented among the subjects (Table 2).
Figure 1. Also wheelchair users assessed the reliability and usability of the Accessible Workplace Method.
Table 2. The disabilities of the subjects (n=37) who assessed the reliability and usability of the Accessible Workplace Method (AWM)
Disability |
n |
% |
Paraplegics |
15 |
40 |
Cerebral palsy |
9 |
24 |
Tetraplegics |
3 |
8 |
Amputation of lower leg |
3 |
8 |
Muscle dystrofia |
2 |
5 |
Others |
5 |
15 |
Assessment of the reliability and usability
The reliability and usability of the AWM were assessed from the intra-observer reliability, and the observers’ experience with the usability of the method. The interval between the two assessments was two weeks. After the two weeks, the assessment of the workplace was repeated in the same way as earlier.
The intra-observer consistency of the assessments was determined as the percentages of agreement using the Intra-class correlation coefficient, ICC and the Kappa coefficient. The Kappa coefficient was classified according to criteria presented by Landis and Koch [7]: < 0.20 slight, 0.21–0.40 fair, 0.41–0.60 moderate, 0.61–0.80 substantial, and 0.81–1.00 almost perfect.
The usability of the AWM was analysed on the basis of the time used for the assessment, the structure of the method, and clearness of the criteria [9].
RESULTS
The intra-rater reliability according to the Kappa coefficient was very good (k= 0.81-1.00) in eight items, good (k= 0.61-0.80) in 12 items, moderate (k= 0.41-0.60) in four items, moderate (k= 0.21-0.40) in five items, and poor (k< 0.20) in one item (Table 3).
The mean time used for the AWM was 32±17 minutes (range 5-75 minutes). Most subjects (97%) considered the length of the checklist to be good. Most subjects (83%) said that the criteria of the items were clear. However 17% of the subjects considered the criteria to be unclear. According to the subjects the structure of the AWM was either good (70%) or moderate (30%). The most important items of the AWM were parking facilities, entrance, rescue facilities and accessible toilet facilities.
Table 3. The intra-rater reliability according to the Kappa coefficient in two assessments when the Accessible Workplace Method (AWM) was used among physically disabled workers (n=37)
Item |
Kappa coefficient1 |
Journey to work with own car |
0.8397 |
Journey to work with public vehicle |
0.6944 |
Parking facilities |
0.2653 |
Enclosure |
0.6659 |
Entrance |
0.9342 |
Guides |
-0.0357 |
Use of inner doors |
0.9157 |
Moving on passages |
0.8688 |
Use of stairs |
0.6514 |
Rescue facilities |
0.6778 |
Kitchen and coffee room facilities |
0.5789 |
Toilet facilities |
- |
Meeting rooms |
0.7470 |
Space |
0.7899 |
Ergonomics of the workstations |
- |
Use of computer |
0.3438 |
Use of work tools and machines |
0.7857 |
Lighting |
0.3459 |
Noise |
0.6500 |
Temperature |
0.4891 |
Work posture |
0.7461 |
Fine motor movements |
- |
Reaching |
0.4248 |
Handling of materials |
0.7429 |
Suitability of work tasks |
0.2584 |
Amount of work, work pace |
0,8363 |
Flexibility of work time |
0.4452 |
Use of personal helper |
1.0000 |
Equality |
0.3607 |
Getting help of others |
0.6282 |
Accessibility of occupational health care services |
0.6929 |
Landis and Koch [7]: < 0.20 slight, 0.21–0.40 fair, 0.41–0.60 moderate, 0.61–0.80 substantial,and 0.81–1.00 almost perfect.
DISCUSSION
The AWM is a simple electrical checklist for accessibility assessments and redesign measures among workers with physical disabilities. We found the intra- observer reliability of the AWM to be good for most items. This finding is in line with results of previous studies analysing other ergonomic methods [14].
Accessibility at work increases work ability and equality between the workers in various tasks. The employees themselves recognize what kind of redesign measures they will need to increase their work ability. They are not only the best experts concerning their disability, but also concerning their work. A simple electrical method was needed for the assessment of work conditions among disabled workers. The traditional methods, developed for able-bodied workers, take not into account the specific needs of disabled [3,5,6].
Improving the planning process for workplace adaptations may result in more successful rehabilitation. The work ability of disabled persons should be better taken into account in the tertiary preventive actions implemented in occupational health services and in occupational rehabilitation. Ergonomic measures at work can also be protective factors that prevent physical disability from turning into a social handicap. The method can be used as a part of the occupational health services or rehabilitation process when design or redesign measures of workplaces are planned or work ability is assessed for employees with physical disabilities.
According to our results, the AWM is suitable for assessing the accessibility of workplaces among physically disabled workers. However, the method should be developed also for workers with visually or hearing impairments. Different occupational groups can use the method after receiving training and basic knowledge in accessibility.
The authors thank the subjects who made this work possible. Financial support was provided by the Finnish Work Environment Fund.
REFERENCES
- 1. BarrieraViruet, H.; Sobeih, T.M.; Daraiseh, N.; Salem S. (2006). Questionnaires vs observational and direct measurements: a systematic review. Theoretical Issues in Ergonomics Science 7:261–284.
- 2. Casali, S.P.; Chase, J.D. (1995). Computerbased system access by persons with disabilities: Differences in the effects of interface design on novice and experienced performance. International Journal of Industrial Ergonomics 15:237245.
- 3. David, G.; Woods, V.; Li, G.; Buckle, P. (2007). The development of the Quick Exposure Check (QEC) for assessing exposure to risk factors for workrelated musculoskeletal disorders. Applied Ergonomics 39:5769.
- 4. Haukka, E.; LeinoArjas, P.; ViikariJuntura, E.; Takala, E.; Malmivaara, A.; Hopsu, L.; Mutanen, P.; Ketola, R.; Virtanen, T.; Pehkonen, I.; HoltariLeino, M.; Nykänen, J.; Stenholm, S.; Nykyri, E.; Riihimäki, H. (2008). A randomized controlled trial on whether a participatory ergonomics intervention could prevent musculoskeletal disorders. Occupational and Environmental Medicine 65:849856.
- 5. Hignett, S.; McAtamney, L. (2000). Rapid entire body assessment (REBA). Applied Ergonomics 31:2015.
- 6. Ketola, R.; Toivonen, R.; ViikariJuntura, E. (2001). Interobserver repeatability and validity of an observation method to assess physical loads imposed on the upper extremities. Ergonomics 44:119131.
- 7. Landis, J.R.; Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics 33:159174.
- 8. Mauri, C.; Cranollers, T.; Cores, J.; Garcia, M. (2006) Computer vision interaction for people with severe movement restrictions. Human Technology 2:3854.
- 9. Nevala, N.; Juhola, T; Alaranta, H. (2006). Accessible workplace: a method for evaluating accessibility of workplaces for employees with physical disabilities. In: K.L. Saarela, CH. Nygård and S. Lusa, eds. Promotion of wellbeing in modern society, 38th annual congress “NES2006” of the Nordic Ergonomics Society, 2427 September 2006 Hämeenlinna. pp. 200202.
- 10. NevalaPuranen, N.; Louhevaara, V.; Itäkannas, E.; Alaranta, H. (2000). ERGODIS: A Method for Evaluating Ergonomics of Workplaces for Employees with Physical Disabilities. In: D. Koradecka, W. Karwowski and B. Das (eds.) Ergonomics and Safety for Global Business Quality and Productivity. The Central Institute for Labour Protection, Warsaw. pp. 237239.
- 11. NevalaPuranen, N.; Sörensen, L. (1997). Physical strain and work ergonomics in farmers with disabilities. International Journal of Occupational Safety and Ergonomics 3:7788.
- 12. NevalaPuranen, N.; Seuri, M.; Simola, A.; Elo, J. (1999). Physically disabled at work: Need for ergonomic interventions. Journal of Occupational Rehabilitation 9:215 225.
- 13. OECD (2008). Sickness, disability and work. Breaking the barriers. Denmark, Finland, Ireland and the Netherlands.
- 14. Pehkonen, I.; Takala, EP.; Ketola, R.; ViikariJuntura, E.; LeinoArjas, P.; Hopsu, L.; Virtanen T.; Haukka, E.; HoltariLeino, M.; Nykyri, E.; Riihimäki, H. (2009). Evaluation of a participatory ergonomic intervention process in kitchen work. Applied ergonomics 40:115123.
- 15. Rivilis, I.; Van Eerd, D.; Cullen, K.; Cole, D.C.; Irvin, E.; Tyson, J.; Mahood, Q. (2008). Effectiveness of participatory ergonomic interventions on health outcomes: a systematic review. Applied Ergonomics 39:342358.
- 16. Springer, J.; Siebes, C. (1996). Position controlled input device for handicapped: Experimental studies with a footmouse. International Journal of Industrial Ergonomics 17:135152.
- 17. Tortosa, L.; Ferreras, A.; GarciaMolina, C.; Chirivella, C.; Diez, R.; Lazaro, A.; Cerezo, C.; Page, A. (1999). ErgoworkIBV: Method for ergonomic adaptation of workplaces for disabled people. Proceedings of CAES'99. International Conference on ComputerAided Ergonomics and Safety, May 1921, Barcelona.
- 18. Vink, P.; Koningsveld, E.A.P.; Molenbroek, J.F. (2006). Positive outcomes of participatory ergonomics in terms of greater comfort and high productivity. Applied Ergonomics 37:537546.
- 19. Wiktorin, C.; Karlqvist, L.; Winkel, J.; the Stockholm Music 1 Study Group. (1993). Validity of selfreported exposures to work postures and manual materials handling. Scandinavian Journal of Work, Environment & Health 19:208214.