STAMINA

STAMINA 

Science & Technology Innovation for Homeland Security

Project Summary

Science and Technology Analysis and Management of Innovation Activity (STAMINA), a multi-phase project at CREATE, has developed a framework and tools to evaluate the transition of research and development outputs and products into practice to improve the Homeland Security Enterprise (HSE). Our focus is integrated Benefit-Cost-Risk Analysis across the R&D lifecycle, through implementation, uptake and full adoption.

Lifecycle Transition Process

STAMINA evaluates R&D projects for the 3-phase DHS BPF framework of lifecycle transition, beginning with understanding needs, next addressing needs, and third, execution. These three phases are followed by post-transition implementation and uptake, during which indicators of success are tracked along with costs in accordance with the National Defense Authorization Act of 2017.

STAMINA Project Timeline

Sep 2023

Phase 1 Begins

Project kickoff: CREATE begins building transition evaluation tools for DHS.

Feb 2024

Frameworks Delivered

Initial logic model, toolkit, and value-case templates shared with DHS program managers.

Fall 2024

Quantitative Studies Begin

Case studies measuring cost savings, operational improvements, and impact launched.

Sep 2025

Project Completion

Final report delivered with insights, tools, and recommendations for long-term use.

Defining and Tracking Transition Outcomes

CREATE is enhancing the DHS Transition Branch’s capabilities by:

  • Defining clear categories of knowledge and technology products to better document and track how research outputs, such as decision-support tools, data systems, and operational models, are transitioned for use by DHS and partner agencies.
  • Developing methods for identifying and measuring Indicators of Success (IoS), which help evaluate whether transitioned products are generating operational, strategic, or economic value across the Homeland Security Enterprise.
  • Evaluating benefits from R&D transitions using a structured, multi-stage logic model that connects early outputs (such as prototypes or analyses) with long-term impacts like full operational adoption or national security improvement.
Turning R&D into Measurable Outcomes

Monetizing Benefits

STAMINA uses real-world estimates—such as analyst time saved or mission hours avoided—to translate research outcomes into economic impact.

Applied Logic Model

Value is tracked across four phases:

  1. Output (what was built)
  2. Outcome (who used it)
  3. Operational Impact (what changed)
  4. Value (economic or mission gain)

Flexible Tools for Evaluation

STAMINA supports program managers with practical templates, coaching, and success metrics to help evaluate and plan transitions.

  • Templates for logic models & value cases
  • Transition readiness checklists
  • Dashboards for reporting impact

 

Evaluating R&D Impact

To evaluate whether research transitions produce lasting impact, CREATE developed an Indicators of Success (IoS) framework. This framework links Knowledge Products and Technology Products to real-world outcomes, such as operational adoption and mission value.

The framework incorporates a multi-stage model that moves from:

Output

Research tools, reports, or datasets produced by R&D

Outcome

Transitioned into DHS component use or partner adoption

Operational Impact

Improved speed, accuracy, or cost efficiency in field use

HSE Value

Broad mission impact: increased safety, savings, or security

Direct Measurements of R&D Success

Each transitioned R&D product is evaluated using targeted metrics based on its function and expected value. These Indicators of Success (IoS) fall into three main categories:

Cost Savings

  • Reduced manual processing
  • Minimized redundancy in workflows
  • Lower resource consumption

Operational Improvements

  • Faster response times
  • Increased automation
  • Enhanced decision accuracy

Security Impact

  • Improved threat detection
  • Increased coordination between agencies
  • Strengthened national resilience
Benefit-Cost Analysis

Our methodology accounts for full life cycle benefits and costs of R&D projects, from inception to retirement, along with the time value of money. Costs include R&D, acquisition, operation, and maintenance, while benefits include full societal benefits, including those internal and external to DHS.

Risk Analysis

Risks are the uncertainties of adverse outcomes, including R&D projects that fail to meet design expectations, failure to transition into practice, and fail to fulfill cost and benefit intentions once implemented. STAMINA’s risk assessment methodology incorporates uncertainty and estimates both expected outcomes and probability distributions for these outcomes.

Risk Analysis

Risks are the uncertainties of adverse outcomes, including R&D projects that fail to meet design expectations, failure to transition into practice, and fail to fulfill cost and benefit intentions once implemented. STAMINA’s risk assessment methodology incorporates uncertainty and estimates
both expected outcomes and probability distributions for these outcomes.

Analysis Tools

STAMINA’s integrated Benefit-Cost-Risk-Analysis (BCRA) tool has been programmed within EXCEL to support east user-friendly implementation. The tool will be available on this website in the 3 rd Quarter of 2025.

Project Reports