Methodological Challenges with Conducting Applied Health Services Research on the National Level

• In Event: 2481 - Sociology in Practice Settings Symposium Roundtable Session
  In Informal Discussion Roundtable: Table 04. Methods for Surveys and Administrative Data

Abstract

Research in practice settings presents methodological challenges. The methodology must be sound as it influences all other research activities. This presentation focuses on challenges within applied health services research conducted on the national level and will cover survey design and psychometrics, mode of survey administration, benchmarking, and mapping of client organizations.

In national healthcare research, survey design presents unique challenges. On one hand, sound research and benchmarking demand psychometrically valid instruments applied in a standardized manner. On the other hand, clients have specific needs requiring customization. Our approach balances these needs. A standard set of items is required for benchmarking purposes. While allowing customization, the structure of the survey is maintained in-as-much-as possible and follows guidelines to minimize its impact.

Different modes of administration are attractive depending on the survey target—employee or patient. Employee surveying is typically conducted via email. Therefore, no adjustments are needed to standardize outcomes. However, patient surveying utilizes multiple modes to satisfy client preferences: phone, email, and mail. Adjustments for email and phone make them comparable to mail and allow benchmarking.

Mapping of client organizations is important for quality improvement as well as for analytics across different surveys. However, it is also a complex activity. Development of a standardized organizational structure allows clients to benchmark across similar types of individuals, units, facilities, etc. However, providing the means to examine data by a more customized view of their organization provides for their unique needs. Thus, a computerized system that provides both greatly aids in this activity.

Methodological challenges present themselves similarly in different practice settings; however, they may require different solutions. This presentation will provide the forum for exploring similarities and differences in both challenges and solutions. This exploration will provide participants with new insights with the potential to improve their research in their practice settings.

Authors

• Elizabeth Anne Sternke, Press Ganey Associates, Inc.

• Bradley R. Fulton, Press Ganey Associates, Inc.

• Kristopher H. Morgan, Press Ganey Associates, Inc.