Saturday, March 10, 2012

Human factors research and practice - Part 2: bridging the gap


This article by Steve Shorrock and Amy Chung was published in The Ergonomist (newsletter of the Institute of Ergonomics and Human Factors), March 2010. It is reproduced here to give more open access and to encourage further conversation on this issue.  Part 1 is here. The full article in the journal Ergonomics is at http://www.tandfonline.com/doi/abs/10.1080/00140139.2011.568636 (ask me for a preprint).

In the last article we outlined some of the quantitative findings from our survey of 587 practitioners regarding the application of ergonomics and human factors (E/HF) research. We concluded that the research practice gaps could be reduced by addressing a number of factors associated with the research, the organisation, and individual practitioners and researchers. In this Part 2, we report on the respondents’ top suggestions for how practitioners and researchers could improve research application. Respondents made 733 suggestions for practitioners and 781 suggestions for researchers. Below, we identify the top 5 suggestions for practitioners and researchers.

How practitioners can improve research application
  1. Increase collaboration and communication between E/HF researchers and/or practitioners and increase contact, conferences, networking and association. Many of the suggestions concerned the relevance of the research focus to the ‘real world’. Typical comments included: “need to communicate real-world problems to researchers so that solutions can be researched”, “communicate the voids in research (as applied to the real world), perhaps in Letters to the Editors”. Other suggestions concerned a more collaborative working relationship, with suggestions such as “practitioners in research laboratories” and “researchers on the project team to provide strategic oversight”. One suggested “links with a research group that share your basic approach and philosophies”, while another suggested that practitioners “consult researchers using helpdesks”. Finally in this category were suggestions for more crossover workshops, dissemination clubs, and forums for discussion of current research.
  2. Read more and be more aware of the research, including more time to read research at work. Many respondents suggested that time to search literature should be built into projects. But several commercial conflicts were noted: “it’s hard to find the time if you work in consultancy; time is money and so if you commit to searching out and then reading papers they had better be good and useful (and a lot are not)!” Some respondents suggested seeking articles for a specific task/ job, but others hinted that this did not meet their needs (e.g. “figure out an easier way to monitor and filter research as it is published instead of searching for it when specifically required”). Some respondents suggested linking reading to personal development planning. 
  3. Promote or obtain better awareness, support, cooperation, permission and authority for research application from decision makers, stakeholders, colleagues, organisation, Societies, other disciplines/ professions and public. One respondent suggested that “practitioners need to educate their customers and ‘translate’ research into everyday English for their customers to aid buy-in of its application”. Another noted that “more industry applications should be based on specific literature; clients should start looking for more than just a guru that says he knows what to do and should insist on evidence”. Other suggestions concerned allied professions (“feed HF into the tools and techniques other technical specialists use and own; translate our discipline into their language!”), and users (“make sure you have a strong link with operational people”). 
  4. Provide more appropriate application of research findings to real problems. Several respondents argued for an evidence based approach (“seek evidence for their interventions – don’t just follow fads”). Another set of suggestions promoted more publishing of application (“provide real world application results in published work”). Other respondents suggested more collaborative application, such as “a mentor coaching relationship with researchers to help find solutions and test ideas”, or “researchers involved in the application environment.” However, several comments indicated that the horse should come before the cart. One respondent warned that practitioners should “address real world problems rather than invented abstractions.” Another stated they should “identify the problem, then identify the solution. Don’t go looking for places to make the research fit.” 
  5. Carry out more research and publication, including replicating or extending research, addressing conflicting results and methodologies and specific themes or topics of research. Several of these emphasised relevance (“write more about ‘real/applied’ problems in practitioner/professional literature, so that researchers can keep up to date with current applied challenges.”) Many of the respondents suggested that practitioners publish case studies showing successful application. However, several highlighted the lack of outlets to do this (“this is a huge problem as practitioners don’t have a venue to do this”).
How researchers can improve research application
  1. Ensure the research focus and methodology is more applied, real-world, relevant, germane, practical and generalisable to organisational environment. Many comments concerned the research focus: “focus research efforts on immediate HF problems relevant to industry”; “understand the needs of practitioners in real industrial environments and aim research at solving real problems”. Respondents frequently mentioned the external validity of methodology, especially the need for more field studies and more representative participants (“more in-situ studies; there is a difference in how people behave at work and in a laboratory”; “stop using simulators as the only means of data gathering”). 
  2. Increase collaboration and communication between E/HF researchers and/or practitioners; increased contact, conferences, networking and association. Many of these had a dual focus on realism (“listen to industry about what research is required instead of deciding what is interesting!”; “by asking practitioners where they think the gaps are in research to back up their practice”). Others focussed on the need to collaborate with regard to outputs (“engage with industry working groups to tailor publications that educate without patronising, i.e. understand that the applied world is not the research world”; “researchers should work together with practitioners on ergonomics projects and stop sitting in their offices publishing loads of theoretical papers”). 
  3. Form more definitive conclusions, and clearer implications, recommendations or applications when reporting. These suggestions were more focussed on the need to provide implications (“describe the outcomes in terms of tangible implications for practitioners”; “provide pragmatic recommendations, guidelines or applications when summarising their research findings”). One focused on the need for “better abstracts” and “clear articulation of ‘so what’ in human language”. Other respondents lamented “silly one-paragraph impact statements” and conclusions indicating that “further research is necessary”. 
  4. Report text and statistical analyses in a different format (e.g. web, magazines, practitioner journals, society publications, summaries, database, email alerts) or in native language. These respondents suggested such alternative non-journal media should be used for “snippets” or “practitioner-friendly versions”. Coupled with the barrier that many practitioners don’t have time to read academic articles, such alterative formats may help uptake of research application if presented “in a form that industry can use”. 
  5. Report text and statistical analyses in a more understandable, clear and readable manner in journal articles. Respondents emphasised the need for writing “in plain English that can be understood outside of their industry” and “dropping the academic jargon”. One responded starkly that academics should “get out of their ivory towers and speak a language that HF people and non-HF people can understand instead of psychobabble”. Another advised researchers to practise what they preach: “Write to your audience, apply the principles of HF to the writing of the article.”

Research and practice are sometimes painted as cosier bedfellows than appears to be the reality in E/HF. This work has highlighted the gaps and bridges between research and practice, but it is up to us to build and cross the bridges. We hope that the data derived from this study may spur motivation for more applicable research and more research application.
This article reported just the top suggestions for improved research application. What more can researchers do to improve application? What can practitioners do to turn theory or research findings into real world application? 

No comments:

Post a Comment