« David Satter's Op-Ed on Russia in the WSJ | Main | Screening of Hamilton's America Last Night at the JHU Center »
Wednesday
Mar222017

How IARPA Judges the Success of Investments in Research and Innovation

The Government Analytics Breakfast (GAB) Forum was pleased to welcome Dr. Jason Matheny, Director of the Intelligence Advanced Research Projects Activity (IARPA), and learn about the methods used to evaluate IARPA's research investments.

IARPA is a U.S. Government organization that invests in high-risk, high-payoff research in support of national intelligence.  Approximately one quarter of IARPA's budget is devoted to measuring and evaluating the quality of the research it funds, a very difficult task.  For example, Dr. Matheny noted that scientists often learn a lot from what doesn't work.  IARPA devotes time and resources to recording failures so future scholars can learn from them (and thereby avoid the "file drawer problem").

Two metrics commonly used to measure research success are (1) the number or impact of publications and (2) the transfer of technologies that result from the research undertaken.  Dr. Matheny, explained, however, that these are certainly not the only measures of success available, but it's not clear which measures are "best", particularly when determinig future funding.

Increasingly IARPA is using prize money (instead of traditional contracts) to entice a wider breadth of researchers to investigate solutions that can be applied in the intelligence field.  Under this compensation structure, teams of researchers need not submit proposals to receive funding -- they simply submit their solutions and IARPA then judges which solution(s) is best.

Dr. Matheny concluded by noting the importance of scientists learning how to communicate complex findings to wide audiences.  He suggested the researchers leverage tools like videos and podcasts as means to convey the importance of their work to nontechnical audiences, including high-level policymakers.

You can view the entire talk here.

PrintView Printer Friendly Version

EmailEmail Article to Friend

References (4)

References allow you to track sources for this article, as well as articles that were written in response to this article.

Reader Comments (21)

very gooood
http://shahreabi.com/

July 22, 2017 | Unregistered Commentershahreabi

PostPost a New Comment

Enter your information below to add a new comment.

My response is on my own website »
Author Email (optional):
Author URL (optional):
Post:
 
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>