Skip to content

Latest commit

 

History

History
40 lines (18 loc) · 3 KB

README.md

File metadata and controls

40 lines (18 loc) · 3 KB

"Active Sciencing" with Reusable Workflows

By Kyle Cranmer, Lukas Heinrich, Tim Head, Gilles Louppe

flowchart

yadage workflow | Notebook Server | Physics simulator workflow

Based on earlier work with NYU CDS masters students Manoj Kumar, Phil Yeres, and Michele Ceru and discussions with Brenden Lake and Gilles Louppe.

The point of this notebook is to explore the synergy of three powerful techniques:

  1. generic likelihood-free inference engines (eg. ABC, carl, etc.) that enable statistical inference on the parameters of a theory that are implicitly defined by a simulator

  2. workflows that encapsulate scientific pipelines and extend the scope from reproducibility to reusability

  3. active learning and sequential design algorithms (eg. Bayesian optimization) that balance exploration and exploitation to efficiently optimize an expensive black box objective function

Together, these three ideas can be combined to enable an efficient and automated loop of the scientific method -- at least, for a sufficiently well posed problem. The scientist's input to the system are:

  • an external workflow that implements some experimental protocol (orange Exp component)
  • an external workflow that implements a simulator for those experiments, which depends on some theoretical parameters that we would like to infer (orange Sim component).

Interesingly, we will use the simulator not only to perform inference on the parameters, but also to design the next experiment (this is where active learning comes in).

Examples