« David Satter's Op-Ed on Russia in the WSJ | Main | Screening of Hamilton's America Last Night at the JHU Center »

How IARPA Judges the Success of Investments in Research and Innovation

The Government Analytics Breakfast (GAB) Forum was pleased to welcome Dr. Jason Matheny, Director of the Intelligence Advanced Research Projects Activity (IARPA), and learn about the methods used to evaluate IARPA's research investments.

IARPA is a U.S. Government organization that invests in high-risk, high-payoff research in support of national intelligence.  Approximately one quarter of IARPA's budget is devoted to measuring and evaluating the quality of the research it funds, a very difficult task.  For example, Dr. Matheny noted that scientists often learn a lot from what doesn't work.  IARPA devotes time and resources to recording failures so future scholars can learn from them (and thereby avoid the "file drawer problem").

Two metrics commonly used to measure research success are (1) the number or impact of publications and (2) the transfer of technologies that result from the research undertaken.  Dr. Matheny, explained, however, that these are certainly not the only measures of success available, but it's not clear which measures are "best", particularly when determinig future funding.

Increasingly IARPA is using prize money (instead of traditional contracts) to entice a wider breadth of researchers to investigate solutions that can be applied in the intelligence field.  Under this compensation structure, teams of researchers need not submit proposals to receive funding -- they simply submit their solutions and IARPA then judges which solution(s) is best.

Dr. Matheny concluded by noting the importance of scientists learning how to communicate complex findings to wide audiences.  He suggested the researchers leverage tools like videos and podcasts as means to convey the importance of their work to nontechnical audiences, including high-level policymakers.

You can view the entire talk here.

PrintView Printer Friendly Version

EmailEmail Article to Friend

References (4)

References allow you to track sources for this article, as well as articles that were written in response to this article.

Reader Comments (31)

very gooood

July 22, 2017 | Unregistered Commentershahreabi

Hey, this is informative article. These are really nice tips to follow. Thanks for sharing such a impressive article with us. - chennai to shirdi flight package, chennai to shirdi tour package


August 24, 2017 | Unregistered CommenterMy Shirdi Trip

Thanks for sharing this such a great and knowledgable information.

August 28, 2017 | Unregistered CommenterLeah Wilmot

Really this information was helpful. I Got some good idea by reading this topic. Great information thanks for sharing this post. - spoken hindi classes in chennai, hindi speaking course.
سئو سایت

September 5, 2017 | Unregistered Commentertabnakidea
October 23, 2017 | Unregistered Commenterfirmware
October 23, 2017 | Unregistered Commenterfirmware

Prarthna Packers and Movers Ernakulam is a transporting company in Ernakulam.we provide quality services to my customer and this is the best Packers and Movers in Kochi.

good post

March 14, 2018 | Unregistered CommenterIndian free Jobs


March 24, 2018 | Unregistered CommenterPlanmycareers

This is an awesome post.Really very informative and creative contents. These concept is a good way to enhance the knowledge.I like it and help me to development very well.Thank you for this brief explanation and very nice information.Well, got a good knowledge. Contact for the packers and movers in Ernakulam

PostPost a New Comment

Enter your information below to add a new comment.

My response is on my own website »
Author Email (optional):
Author URL (optional):
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>