Co-designing a framework for evaluation of assistive technology: learning from people with acquired brain injury and the assistive technology advisors they engage

Libby Callaway; Grahame Simpson; Reem Rendell; Josh Taylor; Em Bould

doi:10.1071/IB25028

RESEARCH ARTICLE (Open Access)

Previous Contents Vol 26(4)

Co-designing a framework for evaluation of assistive technology: learning from people with acquired brain injury and the assistive technology advisors they engage

Libby Callaway

^A ^B ^* , Grahame Simpson ^C ^D ^E , Reem Rendell

^E ^F ^G ^H , Josh Taylor ^I and Em Bould

^A ^B

+ Author Affiliations

- Author Affiliations

^A Occupational Therapy Department, Faculty of Medicine, Nursing and Health Sciences, Monash University, Frankston, Vic., Australia.

^B Rehabilitation, Ageing and Independent Living (RAIL) Research Centre, Faculty of Medicine, Nursing and Health Sciences, Monash University, Frankston, Vic., Australia.

^C John Walsh Centre for Rehabilitation Research, Kolling Institute, Northern Sydney Local Health District, St Leonards, NSW, Australia.

^D School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia.

^E Brain Injury Rehabilitation Research Group, Ingham Institute for Applied Medical Research, Sydney, NSW, Australia.

^F School of Health Sciences, Western Sydney University, Campbelltown, NSW, Australia.

^G Sydney School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia.

^H Institute for Musculoskeletal Health, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia.

^I Lived Experience Advisor and Assistive Technology User, Melbourne, Vic., Australia.

^* Correspondence to: libby.callaway@monash.edu

Handling Editor: Melissa Brunner

Brain Impairment 26, IB25028 https://doi.org/10.1071/IB25028

Submitted: 11 March 2025 Accepted: 19 August 2025 Published: 10 October 2025

© 2025 The Author(s) (or their employer(s)). Published by CSIRO Publishing on behalf of the Australasian Society for the Study of Brain Impairment. This is an open access article distributed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND)

Abstract

Background

Assistive technology can change the way executive function support is provided to people with acquired brain injury (ABI). However, tools to guide consideration and selection of technology for cognitive support are lacking. The aim of this study was to co-design and co-produce a tool that can be used by assistive technology advisors collaborating with people with ABI to evaluate assistive products used for cognitive support.

Methods

McKercher’s six-phase co-design process was used. A small circle co-design group was purposively constructed including people with ABI lived experience, practicing health professional and researchers, and injury and disability insurers. The small circle co-design work was coupled with large circle stakeholder engagement across three online health professional workshops and one in-person workshop.

Results

A Framework for the Evaluation of Assistive Technology was drafted, tested and refined using detailed co-design and co-production processes across six phases. Workshop feedback was iteratively incorporated to finalise the framework. The Framework for the Evaluation of Assistive Technology is now available for use via a free website, called My Technology Space.

Conclusion

Co-design of the Framework for the Evaluation of Assistive Technology across multiple phases of work enhanced its utility and drew on perspectives of people with ABI who use assistive technology, as well as health professionals and funders of assistive products and services.

Keywords: assessment, assistive technology, co-creation, co-design, co-production, cognition, community, health professionals.

References

Andelic N, Løvstad M, Norup A, Ponsford J, Røe C (2019) Editorial: Impact of Traumatic Brain Injuries on participation in daily life and work: Recent research and future directions. Frontiers in Neurology 10, 1153.
| Crossref | Google Scholar | PubMed |

Benz C, Scott-Jeffs W, McKercher KA, Welsh M, Norman R, Hendrie D, Locantro M, Robinson S (2024) Community-based participatory-research through co-design: supporting collaboration from all sides of disability. Research Involvement and Engagement 10, 47.
| Crossref | Google Scholar | PubMed |

Bridge C, Zmudzki F, Huang T, Owen C, Faulkner D (2021) Impacts of new and emerging assistive technologies for ageing and disabled housing: AHURI Final Report No. 372. Melbourne, Australia: Australian Housing and Urban Research Institute Limited. doi:10.18408/ahuri7122501

Brunner M, McGregor D, Keep M, Janssen A, Spallek H, Quinn D, Jones A, Tseris E, Yeung W, Togher L, Solman A, Shaw T (2018) An eHealth capabilities framework for graduates and health professionals: Mixed-methods study. Journal of Medical Internet Research 20(5), e10229.
| Crossref | Google Scholar | PubMed |

Chuah SL, Whiting DL, Gates TM, Simpson GK (2024) Factors associated with device, Internet and videoconferencing use amongst individuals with moderate-to-severe traumatic brain injury. Healthcare 12(14), 1371.
| Crossref | Google Scholar | PubMed |

International Standards Organization (2023) AS/NZS ISO 9999:2023 Australian/New Zealand Standard Assistive products – classification and terminology. (International Standards Organization: Australia and New Zealand)

Jamieson M, Jack R, O’Neill B, Cullen B, Lennon M, Brewster S, Evans J (2020) Technology to encourage meaningful activities following brain injury. Disability and Rehabilitation: Assistive Technology 15(4), 453-466.
| Crossref | Google Scholar | PubMed |

Jeffay E, Ponsford J, Harnett A, Janzen S, Patsakos E, Douglas J, Kennedy M, Kua A, Teasell R, Welch-West P, Bayley M, Green R (2023) INCOG 2.0 Guidelines for Cognitive Rehabilitation Following Traumatic Brain Injury, Part III: Executive Functions. Journal of Head Trauma Rehabilitation 38(1), 52-64.
| Crossref | Google Scholar | PubMed |

Layton N, Callaway L (2020) Person-centred approaches to evaluation of assistive technology products and outcomes: An Australian policy and practice perspective. Presentation at the Rehabilitation Engineering Society of North America Annual Conference (online event). Available at https://www.resna.org/sites/default/files/conference/2020/GAATO/144Layton.html

Layton N, Bould E, Buchanan R, Bredin J, Callaway L (2022) Inclusive research in health, rehabilitation and assistive technology: Beyond the binary of the ‘Researcher’ and the ‘Researched’. Social Science 11, 233.
| Crossref | Google Scholar |

Leopold A, Lourie A, Petras H, Elias E (2015) The use of assistive technology for cognition to support the performance of daily activities for individuals with cognitive disabilities due to traumatic brain injury: The current state of the research. NeuroRehabilitation 37(3), 359-378.
| Crossref | Google Scholar | PubMed |

Liddle J, Callaway L, Simpson G (2021) Occupational Therapy Australia, 29th National Conference and Exhibition, “Inspired Insights for Brighter Futures”, 23–25 June 2021, Virtual Conference and Engagement Hubs. Australian Occupational Therapy Journal 68(S1), 7-91.
| Crossref | Google Scholar | PubMed |

Malterud K (2001) The art and science of clinical knowledge: Evidence beyond measures and numbers. Lancet 358(9279), 397-400.
| Crossref | Google Scholar | PubMed |

McKercher KA (2020). ‘Beyond Sticky Notes Co-Design for Real: Mindsets, Methods and Movements.’ (Beyond sticky notes: Sydney, Australia)

Nam JH, Kim H (2018) How assistive devices affect activities of daily living and cognitive functions of people with brain injury: a meta-analysis. Disability and Rehabilitation: Assistive Technology 13(3), 305-311.
| Crossref | Google Scholar | PubMed |

Pilli K, Worne B, Simpson GK (2023) Clinician experiences with using assistive technology in brain injury rehabilitation: a survey of clinician capability, attitudes, and barriers. Brain Impairment 24(2), 185-203.
| Crossref | Google Scholar | PubMed |

Smith EM, Graham D, Morgan C, MacLachlan M (2023) Artificial intelligence and assistive technology: risks, rewards, challenges, and opportunities. Assistive Technology 35(5), 375-377.
| Crossref | Google Scholar | PubMed |

Social Care Institute for Excellence (n.d.) Co-production: what it is and how to do it. Available at https://www.scie.org.uk/co-production/what-how/

Tate R, Kennedy M, Ponsford J, Douglas J, Velikonja D, Bayley M, Stergiou-Kita M (2014) INCOG recommendations for management of cognition following traumatic brain injury, part III: executive function and self-awareness. The Journal of Head Trauma Rehabilitation 29(4), 338-352.
| Crossref | Google Scholar | PubMed |

Togher L, Douglas J, Turkstra LS, Welch-West P, Janzen S, Harnett A, Kennedy M, Kua A, Patsakos E, Ponsford J, Teasell R, Bayley MT, Wiseman-Hakes C (2023) INCOG 2.0 Guidelines for Cognitive Rehabilitation Following Traumatic Brain Injury, Part IV: Cognitive-Communication and Social Cognition Disorders. The Journal of Head Trauma Rehabilitation 38(1), 65-82.
| Crossref | Google Scholar | PubMed |

Vargas C, Whelan J, Brimblecombe J, Allender S (2022) Co-creation, co-design and co-production for public health: A perspective on definitions and distinctions. Public Health Research & Practice 32(2), e3222211.
| Crossref | Google Scholar | PubMed |

Vears DF, Gillam L (2022) Inductive content analysis: A guide for beginning qualitative researchers. Focus on Health Professional Education: A Multi-Professional Journal 23(1), 111-127.
| Crossref | Google Scholar |

Wong D, Sinclair K, Seabrook E, McKay A, Ponsford J (2017) Smartphones as assistive technology following traumatic brain injury: a preliminary study of what helps and what hinders. Disability and Rehabilitation 39(23), 2387-2394.
| Crossref | Google Scholar | PubMed |

World Health Organization (2024) Fact sheets: assistive technology. World Health Organization: Geneva, CH. Available at https://www.who.int/news-room/fact-sheets/detail/assistive-technology