VRFCAT
The Virtual Reality Functional Capacity Assessment Tool (VRFCAT) is a computerized measure that was developed to be a reliable, valid, and sensitive measure of functional capacity, with the potential to demonstrate real-world functional improvements associated with cognitive change. The VRFCAT presents participants with a realistic simulated environment to recreate routine activities of daily living.[1] The VRFCAT was developed by VeraSci under National Institute of Mental Health (NIMH) Small Business Innovation Research (SBIR) phase 1 and phase 2 grants.
History
[edit]In an effort to address the unmet need for standard methods in the development of treatments of cognitive impairment associated with schizophrenia, representatives from the US Food and Drug Administration (FDA), NIMH, the pharmaceutical industry, and academia, formed the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) project.[2][3] The MATRICS group and FDA representatives concluded that cognitive improvements alone, as measured by standardized neuropsychological assessments, were not a sufficient demonstration of drug efficacy to enable an indication for cognitive impairments associated with schizophrenia. The approval of new treatments for cognitive impairments would also require evidence that the cognitive improvements are clinically meaningful. Thus, clinical trials of cognitive enhancing compounds in schizophrenia must demonstrate improvement on a standard cognitive measure and improvement on a co-primary measure indicating that those cognitive improvements have a meaningful impact on skills used in real-world functioning. There are many indicators of real-world functioning in schizophrenia, such as the patient’s ability to hold employment, live independently, and maintain social relationships, but detecting changes may take longer to emerge than the duration of a typical clinical trial. Furthermore, real-world functional change is dependent upon a variety of circumstances unrelated to treatment, such as changes in the patient’s broader milieu. The MATRICS group thus recommended that clinical meaningfulness could be demonstrated through the use of tools measuring the potential to demonstrate real-world functional improvements associated with cognitive change rather than having to demonstrate actual functional change.[2] The MATRICS group made no firm recommendations regarding which measure or measures should be used to provide evidence of a clinically meaningful effect as none of the existing instruments were viewed as sufficiently reliable, valid, and sensitive to treatment interventions during a clinical trial. To meet this need, the VRFCAT was designed to reliably assess functional capacity within the context of a simulated real-world environment.[1]
Description
[edit]The VRFCAT uses the Unreal Engine to create a realistic, interactive, and immersive environment consisting of 4 mini-scenarios that follow a story, including: (1) exploring a kitchen, (2) catching a bus to a grocery store, (3) finding/purchasing food in a grocery store, and (4) returning home on a bus. To permit repeated testing while avoiding learning effects, 6 alternate forms were created that vary the ingredients stored in the cabinets, items on the recipe and grocery list, cost of the bus rides, cost of groceries, and money available in a wallet.[1] Subjects complete each scenario through a progressive storyboard design[1]
VRFCAT no longer runs in Unreal Engine and is now a proprietary engine developed with HTML5 and BabylonJS
Validation
[edit]In 2014, a validation study was conducted with three aims:[4]
- To assess the validity, sensitivity, and reliability of the VRFCAT as a primary measure of functional capacity in schizophrenia
- To examine the VRFCAT’s ability to quantify changes in functional capacity by comparing it to the UCSD Performance-based Skills Assessment (UPSA-2-VIM)
- To determine the association between performance on the VRFCAT and performance on the MATRICS Consensus Cognitive Battery (MCCB), which is the gold standard measure of cognition in pharmaceutical clinical trials regulated by the FDA
Participants for the study included 158 subjects with schizophrenia, and 166 healthy controls. The VRFCAT demonstrated both good test-retest reliability (ICC = .81), minimal practice effects, and high, positive correlations with cognitive performance (r = .58 with the MCCB). In particular, the VRFCAT Total Time demonstrated good test-retest reliability (ICC = .80 in young adults; ICC = .64 in older adults) and insignificant practice effects; the Total Time variable also had high correlations with cognitive performance across age groups (r = .79 in young adult, r = .66 in older adults). Overall, the VRFCAT was shown to be a measure of functional capacity with good psychometric properties permitting repeated assessment in clinical trials.[4][5][6]
References
[edit]- ^ a b c d Ruse, S.A.; Davis, V.G.; Atkins, A.S.; Krishnan, K.R.R.; Fox, K.H.; Harvey, P.D.; Keefe, R.S. (2014). "Development of a Virtual Reality Assessment of Everyday Living Skills". Journal of Visualized Experiments (86, 51405). doi:10.3791/51405. PMC 4174921. PMID 24798174.
- ^ a b Buchanan, R.W.; Davis, M; Goff, D.; Keefe, R.S.E.; Leon, A.C.; Nuechterlein, K.H.; Laughren, T.; Levin, T.; Stover, E.; Fenton, W.; Marder, S.R. (2005). "A summary of the FDA-NIMH-MATRICS workshop on clinical trial designs for neurocognitive drugs for schizophrenia". Schizophrenia Bulletin. 31 (1): 5–19. doi:10.1093/schbul/sbi020. PMID 15888422.
- ^ Buchanan, R.W.; Kreyenbuhl, J.; Kelly, D.L.; Noel, J.M.; Boggs, D.L.; Fischer, B.A.; Himelhoch, S.; Fang, B.; Peterson, E.; Aquino, P.R.; Keller, W.; Schizophrenia Patient Outcomes Research Team, (PORT) (2010). "The 2009 schizophrenia PORT psychopharmacological treatment recommendations and summary statements". Schizophrenia Bulletin. 36 (1): 71–93. doi:10.1093/schbul/sbp116. PMC 2800144. PMID 19955390.
- ^ a b Ruse, S.A.; Davis, V.G.; Atkins, A.S.; Spagnola, N.; Patterson, T.D.; Harvey, P.D.; Narasimhan, M.; Keefe, R.S.E (2014). "Validation of a Computerized Assessment of Functional Capacity: Poster presented at the annual meeting of the American College of Neuropsychopharmocology, Phoenix, Arizona" (PDF). NeuroCog Trials.
{{cite web}}: CS1 maint: numeric names: authors list (link) - ^ Atkins, A.S.; Stroescu, I.; Spagnola, N.B.; Davis, V.G.; Patterson, T.D.; Narasimhan, M.; Harvey, P.D.; Keefe, R.S.E. (2014) (2015). "Assessment of Age-Related Differences in Functional Capacity Using the Virtual Reality Functional Capacity Assessment Tool (VRFCAT)". The Journal of Prevention of Alzheimer's Disease. 2 (2): 121–127. doi:10.14283/jpad.2015.61. PMC 4657736. PMID 26618145.
{{cite journal}}: CS1 maint: numeric names: authors list (link) - ^ Ruse, S.A.; Harvey, P.D.; Davis, V.G.; Atkins, A.S.; Fox, K.H.; Keefe, R.S.E. (2014). "Virtual Reality Functional Capacity Assessment in schizophrenia: Preliminary data regarding feasibility and correlations with cognitive and functional capacity performance". Schizophrenia Research: Cognition. 1 (1): e21–e26. doi:10.1016/j.scog.2014.01.004. PMC 4113005. PMID 25083416.
Other Cognitive Assessment Tools
[edit]SCoRS - Schizophrenia Cognition Rating Scale