Award Abstract # 2033413
B1: Inclusion AI for Neurodiverse Employment

NSF Org: ITE
Innovation and Technology Ecosystems
Recipient: VANDERBILT UNIVERSITY
Initial Amendment Date: August 20, 2020
Latest Amendment Date: March 9, 2022
Award Number: 2033413
Award Instrument: Cooperative Agreement
Program Manager: Linda Molnar
lmolnar@nsf.gov
 (703)292-8316
ITE
 Innovation and Technology Ecosystems
TIP
 Dir for Tech, Innovation, & Partnerships
Start Date: September 1, 2020
End Date: August 31, 2022 (Estimated)
Total Intended Award Amount: $5,000,000.00
Total Awarded Amount to Date: $2,065,532.00
Funds Obligated to Date: FY 2020 = $2,065,531.00
FY 2021 = $0.00
History of Investigator:
  • Keivan Stassun (Principal Investigator)
    keivan.stassun@vanderbilt.edu
  • Brian Scassellati (Co-Principal Investigator)
  • James Rehg (Co-Principal Investigator)
  • Susanne Bruyere (Co-Principal Investigator)
  • Zachary Warren (Co-Principal Investigator)
  • Nilanjan Sarkar (Former Principal Investigator)
Recipient Sponsored Research Office: Vanderbilt University
110 21ST AVE S
NASHVILLE
TN  US  37203-2416
(615)322-2631
Sponsor Congressional District: 05
Primary Place of Performance: Vanderbilt University
TN  US  37203-2417
Primary Place of Performance
Congressional District:
05
Unique Entity Identifier (UEI): GTNBNWXJ12D5
Parent UEI:
NSF Program(s): CA-FW-HTF: Convergence Acceler
Primary Program Source: 01002021DB NSF RESEARCH & RELATED ACTIVIT
01002122DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 075Z
Program Element Code(s): 096Y00
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.083, 47.084

ABSTRACT

The NSF Convergence Accelerator supports use-inspired, team-based, multidisciplinary efforts that address challenges of national importance and will produce deliverables of value to society in the near future.

Neurodiversity is an emerging concept through which certain neurological differences?Autism, Attention Deficit Hyperactivity Disorder, Dyslexia, and others?are considered a natural part of human neurocognitive variation, associated not only with impairments but also with unique strengths. Indeed, many neurodiverse people have capabilities that are in high demand across many sectors. Yet, while some 70,000 Americans with autism enter adulthood every year, currently 85% of them will be unemployed or underemployed relative to their skill levels, representing a cost to the United States of $175 billion annually. Thus, optimizing workforce engagement for individuals with autism holds the potential to transform great cost into great value. This National Science Foundation Convergence Accelerator (C-Accel) award to Vanderbilt University will address this grand challenge by bringing together cutting-edge Artificial Intelligence (AI) innovations with transdisciplinary expertise?spanning engineering and computer science to organizational psychology, clinical translation, and implementation science?to create a suite of commercially viable technologies that integrate AI within virtual environments, robotic systems, human-human interactions, and novel assessment tools. These technologies will be created using input from stakeholders, including employers of individuals with autism, companies that develop technological products to help employment, state vocational and rehabilitation services that provide job training, and advocacy groups that provide guidance regarding community needs. The technologies will be transitioned to practice through deployment with private- and public-sector partners, together with analysis using implementation science to ensure long-term sustainability and the broadest impact.

This C-Accel Phase II program will advance the scientific and technological methodologies of the projects initiated in Phase I that are designed to create a pipeline to employment for people with autism. Specifically, the suite of tools to be developed include: (1) Visual and Cognitive AI Tools to Assess Autistic Talent; (2) Virtual Reality (VR)-based Simulator for Improving Job-Interview Skills; (3) Collaborative Virtual Environments with Embedded Intelligent Agent for Social Interaction Assessment and Support; (4) Social Robotic System to Assess and Train Tolerance to Interruption; and (5) Computer Vision Tools to Measure and Improve Non-verbal Communication. Across these projects, we will make fundamental scientific and technological advancements in: (i) data-driven visual AI for innovative assessment tools to identify strengths, talents, and job-relevant skills, as well as employer-identified work needs; (ii) novel VR-based platform for job interview training that utilizes real-time closed-loop multimodal affective computing for stress and attention recognition; (iii) a collaborative virtual environment that create new skill estimation algorithms and a peer-based learning paradigm mediated by an AI agent; (iv) a home-based skill assessment and training systems using socially assistive robotics; and (v) novel computer-vision and deep learning methods and algorithms to assess real-world generalization of nonverbal social communication. The project?s intellectual property plan includes advancing each of these technologies from prototype to minimum viable product (MVP) stage and into commercial use through licensing agreements within the two-year project period. Through Vanderbilt University?s Frist Center for Autism & Innovation, graduate students and neurodiverse interns will participate in all aspects of the C-Accel research and development efforts.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Stojanov, Stefan and Thai, Anh and Rehg, James M. "Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Bias" IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 2021 Citation Details
Breen, M and McClarty, J and Langley, C and Farzidayeri, J and Trevethan, K and Swenson, B and Sarkar, M and Wade, J and Sarkar, N. "2D and 3D Visualization of Eye Gaze Patterns in a VR-Based Job Interview Simulator: Application in Educating Employers on the Gaze Patterns of Autistic Candidates" International Conference on Human-Computer Interaction (HCII) , v.12768 , 2021 https://doi.org/10.1007/978-3-030-78092-0_36 Citation Details
Migovich, M and Korman, A and Wade, J and Sarkar, N. "Design and Validation of a Stress Detection Model for Use with a VR Based Interview Simulator for Autistic Young Adults" International Conference on Human-Computer Interaction (HCII) , v.12768 , 2021 https://doi.org/10.1007/978-3-030-78092-0_40 Citation Details
Ramnauth, Rebecca and Adeniran, Emmanuel and Adamson, Timothy and Lewkowicz, Michal and Giridharan, Rohit and Reiner, Caroline and Scassellati, Brian "A Social Robot for Improving Interruptions Tolerance and Employability in Adults with ASD" ACM/IEEE International Conference on Human-Robot Interaction (HRI 2022) , 2022 https://doi.org/10.1109/HRI53351.2022.9889383 Citation Details
Amat, A and Breen, M and Hunt, S and Wilson, D and Khaliq, Y and Byrnes, N and Cox, D and Czarnecki, S and Justice, C and Kennedy, D and Lotivio, T and McGee, H and Reckers, D and Wade, J and Sarkar, M and Sarkar, N. "Collaborative Virtual Environment to Encourage Teamwork in Autistic Adults in Workplace Settings" International Conference on Human-Computer Interaction (HCII) , v.12768 , 2021 https://doi.org/10.1007/978-3-030-78092-0_22 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The ultimate goal of the overall project was intended to bring together cutting-edge AI scientific innovation with transdisciplinary expertise—spanning engineering and computer science to organizational psychology, clinical translation, and implementation science—to address the emerging, critical problem of meaningfully including individuals with autism spectrum disorder (ASD) in the 21st century American workforce. We had hoped to advance the scientific and technological methodologies in the following projects that were intended to create a pipeline to employment for people with ASD: (1) Visual and Cognitive AI Tools to Assess Autistic Talent; (2) Virtual Reality (VR)-based Simulator for Improving Job-Interview Skills; (3) Collaborative Virtual Environments with Embedded Intelligent Agent for Social Interaction Assessment and Support; (4) Social Robotic System to Assess and Train Reslience to Interruption; and (5) Computer Vision Tools to Measure and Improve Non-verbal Communication. These scientific and technological advancements were to be created using iterative stakeholders’ input within organizational and clinical science framework. The technologies were to be transitioned to practice through deployment with private- and public-sector partners, together with analysis using implementation science to ensure long-term sustainability and the broadest impact. Unfortunately, the project was terminated prior to completion of the planned technologies, deployment with partners, transition to practice, commercialization at scale, or other intended outcomes.

 


Last Modified: 12/15/2022
Modified by: Keivan G Stassun

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page