Skip to content

Commit

Permalink
updates glossary
Browse files Browse the repository at this point in the history
  • Loading branch information
billbrod committed Jul 12, 2024
1 parent 6743972 commit 20fc8dd
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/source/glossary.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ The attached notebook uses some jargon that might be new to you. Hopefully this
- Eigendistortions: image distortions that produce the most and least noticeable change in model response. They are the eigenvectors of the model's Fisher information matrix, which provides a quadratic approximation of the discriminability of distortions on a given image. In the cases we consider, all models have a deterministic and differentiable mapping from images to representations, and thus the Fisher information matrix is equal to $J^T J$, where $J$ is the model's Jacobian matrix with respect to the target image.
- Gain control: also known as divisive normalization, gain control is ubiquitous in the central nervous system and has been proposed as a [canonical neural computation](https://www.nature.com/articles/nrn3136) which allows the brain to maximize sensitivity to relevant stimuli in changing contexts. An example is the way that the human eye adapts to different light levels: when entering a dark room from a bright environment, we are initially unable to make out any details, but adaptation allows the eye to change the range of intensities that it is sensitive to. Physical processes (e.g., change in pupil size) account for some of this, but gain control is another way this can be implemented.
- Highpass: a filter or model that is most sensitive to high frequencies and is less sensitive or insensitive to middle and low frequencies. Compare to bandpass and lowpass.
- Invariances / invariant: if a model is invariant to an image feature, the presence of the feature will not affect the model output. Even stronger, that feature can be randomized and it will have no effect on the model output. These features are called the model's *invariances*.
- Lowpass: a filter or model that is most sensitive to low frequencies and is less sensitive or insensitive to middle and high frequencies. The classic example is a Gaussian. Compare to bandpass and lowpass.
- Metamers: visual input that are physically distinct but perceptually identical, such as a scene and an RGB image of that scene. In plenoptic, we synthesize *model metamers*, which are images with different pixel values that produce identical model outputs.
- Model: a computational model maps some input stimulus to a representation, based on some parameters. Neural networks, Gaussian filters, and the energy model of V1 complex cells are all examples of models. In vision science, we typically use these models to better understand some aspect of a biological visual system, by trying to map the model representation to some aspect of the system being modeled, such as neuronal firing rate, behavioral responses, or fMRI BOLD. The goal of plenoptic is to facilitate understanding and improvement of these models.
Expand Down

0 comments on commit 20fc8dd

Please sign in to comment.