Mohamad Abou Haidar,1 Khalife Khalife,2 Linda Abou Abbas,3 Zeina Nasser,3 Jessy C. Tannous 4 and Joseph Yammine 4
1Unité de Formation et de Recherche en Sciences et Techniques des Activités Physiques et Sportives, University Claude Bernard, Lyon, France (Correspondence to: Mohamad Abou Haidar:
Abstract
Background: Lebanon still lacks a unified platform upon which private physiotherapy practitioners can base and apply their knowledge and practice. Accreditation of physiotherapy centres would promote collaboration, boost consistency and enhance quality of services. The Order of Physiotherapists in Lebanon is called on to provide a high quality of service by focusing on standards.
Aims: The aim of this study was to assess the feasibility and applicability of a standard for the quality assessment of physiotherapy centres, and to assess the current status of a sample of centres in Lebanon.
Methods: A questionnaire was developed by a panel of experts based on a review of international and national requirements in physiotherapy centres. A set of 14 items was generated covering 3 categories: qualifications of the team, facility and environmental status, and data collection and analysis. A pilot study was conducted from December 2013 to February 2014 in 6 Lebanese physiotherapy centres. Descriptive statistics are reported.
Results: The highest median score and compliance score for the 6 centres were reported for the “Facility and environmental status” category (median = 8.0) and the lowest were reported in the “Data collection and analysis” category (median = 5.0).
Conclusions: Further studies are needed to validate the quality assessment in physiotherapy centres questionnaire, and to implement it as a primary tool for assessing quality standards and for accreditation of physiotherapy centres.
Keywords: quality assurance; physiotherapy; Lebanon; questionnaire, acreditation
Citation: Abou Haidar M; Khalife K; Abou Abbas L; Nasser Z; Tannous JC; Yammine J. National quality assessment questionnaire for physiotherapy centres: a pilot study in Lebanon. East Mediterr Health J. 2019;25(1):12-17. https://doi.org/10.26719/emhj.18.008
Received: 19/07/16; accepted: 17/10/17
Copyright © World Health Organization (WHO) 2019. Some rights reserved. This work is available under the CC BY-NC-SA 3.0 IGO license (https://creativecommons.org/licenses/by-nc-sa/3.0/igo).
Introduction
Physiotherapists operate as independent practitioners as well as members of health care service provider teams and are subject to the ethical principles of the World Confederation for Physical Therapy and the code of ethics of the country in which they practice. The World Confederation for Physical Therapy encourages its member organizations to support and work towards unified education and practice guidelines (1). Physiotherapists should implement quality monitoring tools such as clinical indicators that would enable individual practitioners to evaluate their performance against that of their peers (2). While international bodies have common programmes or policies such as in the European, American and Australian regions of the World Confederation for Physical Therapy, Lebanon still lacks a unified platform upon which private physiotherapy practitioners can base and apply their knowledge and practice.
Evaluation of health care is scrutinized by both the government and consumers, more precisely the patients (3). Consequently, plans to tackle health quality have gained momentum over the past few years, and the need for accreditation has become more prominent to match the high standards of performance and to avoid inconsistencies between different private centres. Hence, accreditation of physiotherapy centres would promote collaboration, boost consistency for more standardized practice and enhance quality of services.
According to data from the Order of Physiotherapists in Lebanon (OPTL), Lebanon has more than 100 private physiotherapy centres, but unlike academic institutions (e.g. hospitals or medical centres), they are not under the control of any international or local assessment body. Consequently, a collaboration was initiated between the OPTL and Quality Systems International to prepare a standardized platform for quality in physiotherapy.
Quality Systems International is a consultancy company working on the development and improvement of the quality infrastructure of health care companies, institutions and organizations. It was assigned by the OPTL to work with its research and quality committee, the Research Center for Quality in Physiotherapy. The committee included 5 expert physiotherapists and members of the OPTL having extensive experience in quality of physiotherapy centres or postgraduate degrees in quality management.
The rationale behind this standardized platform was to build a quality management system (part of an accreditation plan) for private sector physiotherapy centres in Lebanon based on the primary requirements promulgated by OPTL experts and the Lebanese Ministry of Public Health as well as on available international guidelines. This programme will enable the private centres to upgrade their systems and secure safe and professional treatment to patients/clients. In this setting, a tool for the quality assessment of physiotherapy centres was developed.
The aim of this study was to pilot and test the assessment tool in a sample of 6 private physiotherapy centres to evaluate its feasibility and applicability for auditing the quality of services audit setting. The study also aimed at assessing the current situation of physiotherapy centres in Lebanon.
Methods
Development of the quality assessment in physiotherapy centres questionnaire
A set of 47 items were originally generated by Quality Systems International based on the requirements of the Ministry of Public Health and the Order of Physical Therapy in Lebanon. The items covered “Qualifications of the team” (15 items), “Facility and environmental status” (19 items) and “Data collection and analysis” (13 items). The 47 items were answered on a 3-point Likert scale based on criteria fulfilment (0 = no/not fulfilled, 1= partially/partially fulfilled, and 2 - yes/completely fulfilled).
The questionnaire was translated and adapted into Arabic by 3 independent professional translators. Backward translation was applied to all items. Translation inconsistencies were resolved by consensus in collaboration with Quality Systems International. The content validity of the resulting version was assessed by members of the Research Center for Quality in Physiotherapy who were not involved in the initial development.
Lebanese physical therapist experts were asked to rate the relevance of each item on a 4-point Likert scale from 1 (not relevant) to 4 (very relevant). The content validity index for each item was calculated as the proportion of experts giving a rating of 3 or 4 (quite relevant and very relevant) divided by the total number of experts. All items with a content validity index of 0.8 or above were retained (4). Consequently, 33 items were discarded and the final questionnaire used for the assessment of the physiotherapy centres consisted of 14 items (Table 1).
Pilot testing of the assessment tool
The pilot study was conducted from December 2013 to February 2014 to assess the feasibility and applicability of the 14-item questionnaire for the audit of quality of services at physiotherapy centres. Out of the 100 physiotherapy centres in Lebanon, Quality Systems International agreed with the OPTL to select 6 centres from different Lebanese districts based on the following criteria: average number of employees, ranging from 1 (owner of the centre) to 10, and the centre’s extent of experience, ranging from a few months to more than 2 years. The centres were selected from 4 of the 5 districts in Lebanon: 2 from Beirut, 2 from South, 1 from North and 1 from Bekaa (i.e. the regions where the majority of centres are located). Two independent, trained investigators from Quality Systems International audited the 6 centres and completed the questionnaire.
Statistical analysis
Statistical analyses were descriptive in nature and generated by SPSS, version 22.0. The median score was calculated for each item, for each category and for the total. The category score was calculated by summing all individual item scores in the category, while the total score was calculated by summing all 3 category scores.
Results
The questionnaire was usually completed within approximately 2 hours, including inspection of the premises. The investigators did not report any difficulties or ambiguity in responding to the items. Data were complete for all 6 centres.
The median score for the “Qualifications of the team” category for the 6 selected centres was 4.0 (Table 2). None of the physiotherapy centres was compliant with the “Availability of an orientation manual/checklist for new staff” standard (median score = 0.0). The highest score was for the “Management of the physiotherapy centre by a qualified individual” standard (median score = 2.0).
Regarding the “Facility and environmental status” category, the median score was 8.0 (Table 2). The physiotherapy centres were compliant with most of the requirements in this category, with a median score of 1–2 on the different items.
For the “Data collection and analysis” category, the median score was 5 for the 6 centres (Table 2). The median score for each item ranged between 0 and 1 reflecting average compliance. The majority of the physiotherapy centres were not compliant with the “Data collected used for research purposes” standard (median = 0.0).
Discussion
Accreditation is a system through which an institution is evaluated based on a set of predetermined standards (5). It aims at advocating progress in quality and it is usually authorized by either independent specialized agencies or by governmental bodies. It is increasingly being used as an assessment tool by governments to regulate the quality of health care services. Accreditation programmes appear to enhance patient care and improve clinical outcomes. Unfortunately, a study performed by the World Health Organization in 2000 highlighted the lack of accreditation in the Middle East (6).
This pilot study verified the feasibility of the quality assessment questionnaire based on the ease of its completion and the relevance of the items included in assessing the centres’ conformity with quality standards. The ease of completion was not dependent on the region or area where the centre was located; thus, the tool is likely to be applicable on a national level. In addition, the questionnaire was based on national and international requirements, which ensured the exhaustiveness of the functional areas it covers.
Compliance was highest in the second category “Facility and environmental status” with a median score of 8.0. However, we identified a lower score on the “Availability of a schedule for equipment validation and checking” standard, which reflects the lack of maintenance and calibration of the equipment and machines in most of the centres in this pilot study.
Regarding the “Qualification of the team” category, a relatively low compliance was observed, mainly driven by the low score on the “Availability of an orientation manual/checklist” standard in the majority of the centres.
“Data collection and analysis” was the lowest scoring category. Centres were only partly engaged in using the collected data for research purposes. Moreover, there was a lack of information on patient satisfaction; this could help the centres to improve their performance by enhancing the patients’ experience.
In this setting, clinical physiotherapy research can play an important role in ensuring continuing growth of the profession. Indeed, previous research has advocated the need to base the physiotherapy practice on scientific evidence (7). Physiotherapists are expected to evaluate published studies, to assess data related to new and established techniques and technology, relate the results to patient or consumer care and engage in scholarly activities.
One of the limitations of this study was related to the scoring method owing to the presence of dichotomous items (e.g. the “Availability of a patient/client satisfaction survey” standard can only be scored with 0 or 2). In addition, the results reported above cannot be generalized to all Lebanese physiotherapy centres because we used a small sample size of only 6 centres. Further studies should be conducted in order to validate the quality assessment tool and to involve a greater number of physiotherapy centres throughout Lebanon.
Conclusion
The quality assessment questionnaire we developed was easy to use and is relevant in terms of the functional areas it covers when assessing the quality of services in physiotherapy centres in Lebanon. Further studies are needed to validate the tool and to get a better insight into the current situation of physiotherapy centres in Lebanon in order to tailor plans for improving the quality of services.
Acknowledgments
Authors wish to thank all participants whose cooperation made the completion of this study possible.
Funding: None.
Competing interests: None declared.
Questionnaire d’une évaluation nationale de la qualité des centres de physiothérapie : étude pilote au Liban
Résumé
Contexte : Le Liban n’a toujours pas de plateforme unifiée permettant aux physiothérapeutes privés de baser et d’appliquer leurs connaissances et leurs pratiques. L’accréditation des centres de physiothérapie permettrait de promouvoir la collaboration, d’améliorer la cohérence et de renforcer la qualité des services. Il est demandé à l’ordre des physiothérapeutes libanais de fournir un service de haute qualité en se concentrant sur les normes.
Objectifs : La présente étude vise à évaluer la faisabilité et l’applicabilité d’une norme pour l’évaluation de la qualité des centres de physiothérapie, et d’évaluer la situation actuelle d’un échantillon de centres au Liban.
Méthodes : Un questionnaire a été mis au point par un groupe d’experts sur la base d’une analyse des exigences nationales et internationales pour les centres de physiothérapie. Un ensemble de 14 items a été établi pour couvrir trois catégories : les qualifications des équipes, l’établissement et son milieu, et la collecte et l’analyse des données. Une étude pilote a été réalisée de décembre 2013 à février 2014 dans six centres de physiothérapie libanais. Des statistiques descriptives ont été notifiées.
Résultats : Les notes médianes et les scores de conformité les plus élevés (en fonction du respect des critères d’exigence) pour les six centres ont été signalés pour la catégorie « Établissement et son milieu » (médiane = 8,0) et les plus faibles pour la catégorie « Collecte et analyse des données » (médiane = 5,0).
Conclusions : Des études complémentaires sont requises pour valider le questionnaire sur l’évaluation de la qualité des centres de physiothérapie, et l’appliquer en tant qu’outil principal dans l’évaluation des normes de qualité et l’accréditation des centres de physiothérapie.
الاستبيان الوطني لتقييم جودة مراكز العلاج الطبيعي في لبنان: دراسة أولية
محمد أبو حيدر، خليفة خليفة، ليندا أبو عباس، زينة ناصر، جسي شرابية طنوس، جوزيف يمين
الخلاصة
الخلفية: لا يزال لبنان يفتقر إلى منصة موحدة يمكن أن يعتمد عليها ممارسي العلاج الطبيعي في القطاع الخاص في تأسيس معرفتهم وتطبيق ممارساتهم. وسيساعد اعتماد مراكز العلاج الطبيعي في تعزيز التعاون والتوافق ويحسّن من جودة الخدمات. ويُدعى إلى إصدار مرسوم أخصائيي العلاج الطبيعي في لبنان لتقديم خدمة عالية الجودة من خلال التركيز على المعايير.
الأهداف: هدفت هذه الدراسة إلى تقييم جدوى وضع معيار لتقييم الجودة في مراكز العلاج الطبيعي وإمكانية تطبيق هذا المعيار، وتقييم الحالة الحالية لعينة من المراكز في لبنان.
طرق البحث: وضعت لجنة من الخبراء استبيانًا قائمًا على استعراض للشروط الدولية والوطنية المطلوب توافرها في مراكز العلاج الطبيعي. ونتج عن ذلك مجموعة من 14 بندًا تغطي ثلاث مجموعات هي: مؤهلات الفريق، وحالة المنشأة والبيئة، وجمع البيانات وتحليلها. وأُجريت دراسة أولية في الفترة ما بين ديسمبر/كانون الأول 2013 وحتى فبراير/شباط 2014 في 6 مراكز لبنانية للعلاج الطبيعي. ونبلغ ها هنا عن الإحصائيات الوصفية
النتائج: لقد كانت أعلى نقاط الوسيط ونقاط الامتثال بالنسبة للمراكز الستة في فئة "حالة المنشأة والبيئة" (الوسيط = 8.0) وأقلها في فئة "جمع البيانات وتحليلها" (الوسيط = 5.0).
الاستنتاجات: من الضروري إجراء المزيد من الدراسات لتقييم صلاحية استبيان تقييم الجودة في مراكز العلاج الطبيعي، ولتطبيقه كأداة أساسية في تقييم معايير الجودة واعتماد مراكز العلاج الطبيعي.
References
- WCPT guideline for physical therapist professional entry level education. London: World Confederation for Physical Therapy; 2011 (http://www.wcpt.org/guidelines/entry-level-education, accessed 7 January 2019).
- Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003;15(6):523–30. http://dx.doi.org/10.1093/intqhc/mzg081
- Zeribi KA, Marquez L. Approaches to healthcare quality regulation in Latin America and the Caribbean: regional experiences and challenges. Bethesda, Maryland: University Research Company, Quality Assurance Project; 2005 (Latin American and Caribbean Regional Health Sector Reform Initiative, Report No. 63).
- Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–67. http://dx.doi.org/10.1002/nur.20199
- Montagu D. Accreditation and other external quality assessment systems for healthcare: Review of experience and lessons learned. London: Department for International Development, Health Systems Resource Centre; 2003 (http://www.heart-resources.org/wp-content/uploads/2012/10/Accreditation-and-other-external-quality-assessments.pdf, accessed 7 January 2019).
- Quality and accreditation in health care services: a global review. Geneva: World Health Organization, 2003 (WHO/EIP/OSD/2003.1; http://whqlibdoc.who.int/hq/2003/WHO_EIP_OSD_2003.1.pdf, accessed 7 January 2019).
- Tracy JE. The role of research in the entry-level physical therapy curriculum. J Phys Ther Educ. 1992;6(1):28–32.
