Summative Evaluation of MTTs

Overview

Purpose:

  • To use both qualitative and quantitative measures of MTT performance and development to create a summative evaluation for each ITS-supported MTT
  • Data is to be used for developmental interventions, deployment of ITS resources, and reporting to the UTMB-CTSA Executive Leadership Team, the UTMB-CTSA External Advisory Board, and to the National Institutes of Health National Center for Advancing Translational Sciences.

Evaluation Model:

  • Model involves both more traditional research progress and scientific output, as well as the development of the team.
  • Model is used to visually display the relative position of each MTT, ranging from low to high on both research/scientific progress as well as team development. The result is a 2 x 2 matrix of team types.
Team Evaluation Matrix

The team types are:

Exemplary Teams = High production of published translational research and research products, new funding sources, and evolved and evident team processes.

Process Teams = Low production of published translational research and research products, no new funding sources, and evolved and evident team processes

Traditional Teams = High production of published translational research and research products, and little evidence of evolved and evident team processes

Early in Development Teams = Low production of published translational research and research products, and no evidence of evolved and evident team processes

Team Evaluation Factors/Criteria

A total of eight factors are used, with four criteria used for Research/Scientific Progress and four criteria used for Team Development. These factors are:

Team Development Factors

  • Team Vision, Charter, and Goals
    • Well-established identity, future that is shared by all, resulting from team deliberations
  • Transformative and Empowered Leadership
    • Leader solicits input, integrates perspectives, and facilitates consensus
  • Meeting Management and Coordination
    • Team members meet regularly and explore new opportunities, challenges, and synergies
  • External Communication and Collaboration
    • Facilitated communication with collaborators that enhances research productivity

Research/Scientific Factors

  • Research Plan
    • Novel and sophisticated plan, conceptually and/or technically innovative
  • Research Generation
    • Productivity, data collection, analysis, and appropriate use of key resources
  • Research Communication/Program Growth
    • Progress in differentiation, publication, and grant success
  • Progress Across Translational Domains
    • Clinical and community impact