Skip to content

active learning + reusable workflows + likelihood free inference

Notifications You must be signed in to change notification settings

cranmer/active_sciencing

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

"Active Sciencing" with Reusable Workflows

By Kyle Cranmer, Lukas Heinrich, Tim Head, Gilles Louppe

flowchart

yadage workflow | Notebook Server | Physics simulator workflow

Based on earlier work with NYU CDS masters students Manoj Kumar, Phil Yeres, and Michele Ceru and discussions with Brenden Lake and Gilles Louppe.

The point of this notebook is to explore the synergy of three powerful techniques:

  1. generic likelihood-free inference engines (eg. ABC, carl, etc.) that enable statistical inference on the parameters of a theory that are implicitly defined by a simulator

  2. workflows that encapsulate scientific pipelines and extend the scope from reproducibility to reusability

  3. active learning and sequential design algorithms (eg. Bayesian optimization) that balance exploration and exploitation to efficiently optimize an expensive black box objective function

Together, these three ideas can be combined to enable an efficient and automated loop of the scientific method -- at least, for a sufficiently well posed problem. The scientist's input to the system are:

  • an external workflow that implements some experimental protocol (orange Exp component)
  • an external workflow that implements a simulator for those experiments, which depends on some theoretical parameters that we would like to infer (orange Sim component).

Interesingly, we will use the simulator not only to perform inference on the parameters, but also to design the next experiment (this is where active learning comes in).

Examples

About

active learning + reusable workflows + likelihood free inference

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published