STAMINA
Science and Technology Analysis and Management of Innovation Activity
Project Summary
Science and Technology Analysis and Management of Innovation Activity (STAMINA), a multi-phase project at CREATE has developed a framework and tools to evaluate the benefits and value of the transition of research and development (R&D) outputs and products into practice to improve mission operations and success for the Homeland Security Enterprise (HSE). Our focus is on the application of an integrated Benefit-Cost-Risk Analysis (BCRA) across the R&D lifecycle, from conception through implementation, uptake, and full operational adoption.
Lifecycle Transition Process
STAMINA evaluates R&D projects for the 4-phase DHS science and technology R&D lifecycle, known as the Business Process Framework (BPF) of lifecycle transition, beginning with understanding the operational needs, next addressing needs, third, execution, and fourth, Closeout.
STAMINA-Enhanced Lifecycle Transition with Post-Transition Products
These four phases are followed by post-transition implementation and uptake, during which indicators of success are tracked along with costs in accordance with the Congressional requirements outlined in the National Defense Authorization Act of 2017.
Project Timeline for Current Phase of STAMINA (STAMINA IV)
Defining and Tracking Transition Outcomes
CREATE is enhancing the Department of Homeland Security (DHS) Science and Technology (S&T) Directorate – Transition Branch’s capabilities for its program managers and other R&D stakeholders by:
- Defining clear categories of knowledge and technology products to better identify, document, and track how research outputs, such as decision-support tools, data systems, and operational models, are transitioned for use by DHS and partner agencies.
- Developing methods for identifying and measuring Indicators of Success (IoS), which help evaluate whether transitioned R&D products are generating operational, strategic, or economic value across the Homeland Security Enterprise.
- Evaluating benefits from R&D transitions using a structured, multi-stage logic model that connects early outputs (such as prototypes or analyses) with long-term impacts like full operational adoption or national security improvement.
Turning Transitioned R&D into Measurable Outcomes
Monetizing Benefits
STAMINA uses real-world estimates—such as analyst time saved or mission hours avoided—to translate research outcomes into economic impact.
Applied Logic Model
Value of the R&D is tracked across four phases:
- Output (what was built)
- Outcome (who used it)
- Operational Impact (what changed)
- Value (economic or mission gain)
Flexible Tools for Evaluation
STAMINA supports program managers with practical templates, frameworks, and success metrics to help evaluate and plan transitions.
- Templates for logic models & value cases
- Transition readiness checklists
- Dashboards for reporting impact
Evaluating R&D Impact
To evaluate whether research transitions produce measurable impact, CREATE developed an Indicators of Success (IoS) framework. This framework links Knowledge Products and Technology Products to real-world outcomes, such as operational adoption and mission value.
Output
Research tools, reports, or datasets produced by R&D
Outcome
Transitioned into DHS security mission operations or partner adoption
Operational Impact
Improved speed, accuracy, or cost efficiency in field use
HSE Value
Broad mission impact: increased safety, savings, or security
Direct Measurements of R&D Success
Each transitioned R&D product is evaluated using targeted metrics based on its function and expected value. These Indicators of Success (IoS) fall into three main categories:
Cost Savings
- Reduced manual processing
- Minimized redundancy in workflows
- Lower resource consumption
Operational Improvements
- Faster response times
- Increased automation
- Enhanced decision accuracy
Security Impact
- Improved threat detection
- Increased coordination between agencies
- Strengthened national resilience
Benefit-Cost Analysis
Our methodology accounts for full life cycle benefits and costs of R&D projects, from conception to retirement, along with the time value of money. The cost model includes R&D, acquisition, operation, and maintenance, while benefits include full societal benefits, including those internal and external to DHS.
Risk Analysis
Risks are the uncertainties of adverse outcomes of technology transition, including R&D projects that fail to meet design expectations, failure to transition into practice, and failure to fulfill cost and benefit intentions once implemented. STAMINA’s risk assessment methodology incorporates uncertainty and estimates both expected outcomes and probability distributions for these outcomes.
Analysis Tools
STAMINA’s integrated Benefit-Cost-Risk-Analysis (BCRA) tool has been programmed within EXCEL to support the east user-friendly implementation. The tool will be available on this website in the 4th Quarter of 2025.
Project Reports for All Phases of STAMINA (I to IV)
Federal Regulations
CREATE’s work complies with three key federal regulations: the Homeland Security Act of 2002, the Evidence Act of 2018, and the U.S. Code Domestic Security requirements for transparency in research and development. More information can be found here.
STAMINA Team
STAMINA is led by CREATE Senior Fellow Detlof von Winterfeldt (principal investigator) along with CREATE Senior Scientist Isaac Maya. Senior Fellow Richard John contributes to the project as co-Principal Investigator. Senior Fellow Randolph Hall also contributes systems research to the project. Jeff Countryman provides staff support.
CREATE’s Research Transition Program
More information on CREATE’s research transition program can be found on our Transition Projects Webpage. CREATE Director, Randolph Hall, recently published the book: Managing Innovation Inside Universities. His co-edited book, University-Industry Collaboration, Innovation at the Interface, will be published in late 2025.