Code

Malania 2007 benchmark#365

Code

Merged

mschrimpf merged 92 commits intobrain-score:masterbrain-score/vision:masterfrom benlonnqvist:malania2007benlonnqvist/brain-score:malania2007Copy head branch name to clipboardJul 6, 2024

+1,417

Commits

Commits on Apr 11, 2023

• Initial Malania 2007 commit with preliminary threshold metric, the benchmark, packaging and a few tests.

  benlonnqvist

  committed
  f553711

  Copy full SHA for f553711

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  88e087d

  Copy full SHA for 88e087d

Commits on Apr 12, 2023

• Add correct visual angle

  benlonnqvist

  committed
  661a3aa

  Copy full SHA for 661a3aa

• Merge branch 'malania2007' of https://github.com/benlonnqvist/brain-score into malania2007

  benlonnqvist

  committed
  2f00c62

  Copy full SHA for 2f00c62

• clean up threshold metric file

  benlonnqvist

  committed
  d2aaf52

  Copy full SHA for d2aaf52

• Further threshold cleanup and ceiling compute verification

  benlonnqvist

  committed
  0598170

  Copy full SHA for 0598170

• Remove python 3.8 requirement that came from typing.Literal

  benlonnqvist

  committed
  9a66485

  Copy full SHA for 9a66485

• clean up benchmark file

  benlonnqvist

  committed
  d77642a

  Copy full SHA for d77642a

• add assembly, stimulus, and benchmark general tests

  benlonnqvist

  committed
  2113d2e

  Copy full SHA for 2113d2e

Commits on Apr 13, 2023

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  fdfe857

  Copy full SHA for fdfe857

Commits on Apr 20, 2023

• resolve Islam2021 conflict

  benlonnqvist

  committed
  63b4b16

  Copy full SHA for 63b4b16

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  79e8fc1

  Copy full SHA for 79e8fc1

Commits on May 31, 2023

• Add grid search, correct psychometric function, and pooled score

  benlonnqvist

  committed
  15a897b

  Copy full SHA for 15a897b

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  7c65a5c

  Copy full SHA for 7c65a5c

• Standardized vernier train and test set sizes

  benlonnqvist

  committed
  161eb67

  Copy full SHA for 161eb67

• Merge branch 'malania2007' of https://github.com/benlonnqvist/brain-score into malania2007

  benlonnqvist

  committed
  04429c8

  Copy full SHA for 04429c8

Commits on Jun 8, 2023

• add goodness of fit check to discard fits to random responses

  benlonnqvist

  committed
  2e0fc3c

  Copy full SHA for 2e0fc3c

• update ceilings to pooled expectations

  benlonnqvist

  committed
  ebfc04a

  Copy full SHA for ebfc04a

Commits on Jun 9, 2023

• packaged commit

  benlonnqvist

  committed
  52b55e5

  Copy full SHA for 52b55e5

• add Malania2007 entries to lookup.csv

  benlonnqvist

  committed
  2dff67d

  Copy full SHA for 2dff67d

• add Malania2007 to benchmark init

  benlonnqvist

  committed
  f62017c

  Copy full SHA for f62017c

• fix indexing error in test___init__

  benlonnqvist

  committed
  87b0b71

  Copy full SHA for 87b0b71

• add missing year(s) in identifiers where they were missing

  benlonnqvist

  committed
  d938c3a

  Copy full SHA for d938c3a

• add S3-related tests to private access, as Travis throws a NoCredentialsError on trying to access them

  benlonnqvist

  committed
  a71737f

  Copy full SHA for a71737f

• minor cleanup of threshold

  benlonnqvist

  committed
  32bfbe3

  Copy full SHA for 32bfbe3

Commits on Jun 16, 2023

• add a few comments to threshold functions

  benlonnqvist

  committed
  8ba609a

  Copy full SHA for 8ba609a

Commits on Jun 20, 2023

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  306d4cb

  Copy full SHA for 306d4cb

Commits on Jun 21, 2023

• fix typo in precomputed feature test

  benlonnqvist

  committed
  53a3ea7

  Copy full SHA for 53a3ea7

• Merge branch 'malania2007' of https://github.com/benlonnqvist/brain-score into malania2007

  benlonnqvist

  committed
  5997bb1

  Copy full SHA for 5997bb1

• fix typos in dataset and assembly call functions

  benlonnqvist

  committed
  29bebe4

  Copy full SHA for 29bebe4

Commits on Nov 3, 2023

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  e9070d0

  Copy full SHA for e9070d0

• Update Assembly type and name

  benlonnqvist

  committed
  8320491

  Copy full SHA for 8320491

• update scoring method with comment and update ceilings

  benlonnqvist

  committed
  f6dab05

  Copy full SHA for f6dab05

Commits on Jan 12, 2024

• 2.0 update for Malania2007

  benlonnqvist

  committed
  06e5d72

  Copy full SHA for 06e5d72

Commits on Jan 23, 2024

• Merge branch 'brain-score:master' into malania2007

  benlonnqvist

  authored
  5dc216f

  Copy full SHA for 5dc216f

• update benchmark to 2.0 format w/ local test

  benlonnqvist

  committed
  dffa729

  Copy full SHA for dffa729

• update data registry format

  benlonnqvist

  committed
  30184dd

  Copy full SHA for 30184dd

• remove BIBTEX from threshold __init__

  benlonnqvist

  committed
  75f40f5

  Copy full SHA for 75f40f5

• update metric imports to 2.0

  benlonnqvist

  committed
  bc054d0

  Copy full SHA for bc054d0

• re-add test_stimuli.py deleted by accident

  benlonnqvist

  committed
  a96aa52

  Copy full SHA for a96aa52

Commits on Jan 24, 2024

• change nan filtering to subject_unique_id filtering

  benlonnqvist

  committed
  bde98eb

  Copy full SHA for bde98eb

Commits on Mar 18, 2024

• Merge branch 'brain-score:master' into malania2007

  benlonnqvist

  authored
  d01863f

  Copy full SHA for d01863f

• add require_variance to model call

  benlonnqvist

  committed
  b445b5c

  Copy full SHA for b445b5c

• Merge branch 'malania2007' of https://github.com/benlonnqvist/brain-score into malania2007

  benlonnqvist

  committed
  296aacb

  Copy full SHA for 296aacb

Commits on Mar 20, 2024

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  953c482

  Copy full SHA for 953c482

Commits on Mar 26, 2024

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  d24777d

  Copy full SHA for d24777d

Commits on Jun 7, 2024

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  d81e83d

  Copy full SHA for d81e83d

Commits on Jun 12, 2024

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  ae03aaf

  Copy full SHA for ae03aaf

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  421e613

  Copy full SHA for 421e613

Commits on Jun 13, 2024

• update stimulus and data assembly related information with arcane knowledge collected from years of hard work

  benlonnqvist

  committed
  824ffd5

  Copy full SHA for 824ffd5

• more arcane knowledge, it's endless

  benlonnqvist

  committed
  199b993

  Copy full SHA for 199b993

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  7ad67c4

  Copy full SHA for 7ad67c4

• move packaging files

  benlonnqvist

  committed
  c955c34

  Copy full SHA for c955c34

• add packaging files

  benlonnqvist

  committed
  d444e27

  Copy full SHA for d444e27

• modify packaging paths

  benlonnqvist

  committed
  f29ebe8

  Copy full SHA for f29ebe8

• remove redundant files

  benlonnqvist

  committed
  44451e5

  Copy full SHA for 44451e5

• remove redundant import

  benlonnqvist

  committed
  6e56cf6

  Copy full SHA for 6e56cf6

• fix stimulus set / assembly link

  benlonnqvist

  committed
  48f007a

  Copy full SHA for 48f007a

• fix stimulus set / assembly indexing

  benlonnqvist

  committed
  a7b500c

  Copy full SHA for a7b500c

• add image label to threshold elevation calculation

  benlonnqvist

  committed
  871974a

  Copy full SHA for 871974a

Commits on Jun 14, 2024

• change stimulus numbers in the test to be what they should be

  benlonnqvist

  committed
  9ee6bd5

  Copy full SHA for 9ee6bd5

• add calls to require_variance

  benlonnqvist

  committed
  6136b5f

  Copy full SHA for 6136b5f

Commits on Jun 24, 2024

• Merge branch 'brain-score:master' into malania2007

  benlonnqvist

  authored
  837b540

  Copy full SHA for 837b540

• fix test errors

  benlonnqvist

  committed
  b390216

  Copy full SHA for b390216

Commits on Jun 26, 2024

• fix bug with ceiling access

  benlonnqvist

  committed
  246ce43

  Copy full SHA for 246ce43

• correct test with incorrect nan droppign

  benlonnqvist

  committed
  4adbbb2

  Copy full SHA for 4adbbb2

• fix wrong number of stimuli in the vernier only test

  benlonnqvist

  committed
  3042ddf

  Copy full SHA for 3042ddf

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  26e1804

  Copy full SHA for 26e1804

• Merge branch 'malania2007' of https://github.com/benlonnqvist/brain-score into malania2007

  benlonnqvist

  committed
  5af6fa8

  Copy full SHA for 5af6fa8

• add comment to explain the logic behind the scoring function

  benlonnqvist

  committed
  786a166

  Copy full SHA for 786a166

• remove redundant comment

  benlonnqvist

  committed
  cd3eefc

  Copy full SHA for cd3eefc

• remove pool score

  benlonnqvist

  committed
  5b68dd4

  Copy full SHA for 5b68dd4

• add metric tests

  benlonnqvist

  committed
  58253b7

  Copy full SHA for 58253b7

• fix benchmark filtering issue and recompute ceilings to accommodate removal of pool_score

  benlonnqvist

  committed
  10447e2

  Copy full SHA for 10447e2

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  83c7643

  Copy full SHA for 83c7643

Commits on Jun 27, 2024

• fix superfluous test by switching it for another

  benlonnqvist

  committed
  6966bbf

  Copy full SHA for 6966bbf

• add vernier acuity benchmark

  benlonnqvist

  committed
  98540d2

  Copy full SHA for 98540d2

Commits on Jun 28, 2024

• update vernier acuity benchmark, ceilings, and mean ceiling

  benlonnqvist

  committed
  faa1194

  Copy full SHA for faa1194

• clean up benchmark file

  benlonnqvist

  committed
  63fc009

  Copy full SHA for 63fc009

• fix a few bugs with loading benchmarks and such

  benlonnqvist

  committed
  108ab9b

  Copy full SHA for 108ab9b

• fix some happy little bugs

  benlonnqvist

  committed
  f49c32c

  Copy full SHA for f49c32c

Commits on Jul 2, 2024

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  aaf49c1

  Copy full SHA for aaf49c1

• add alexnet test

  benlonnqvist

  committed
  3e9b1ff

  Copy full SHA for 3e9b1ff

Commits on Jul 3, 2024

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  cdae143

  Copy full SHA for cdae143

Commits on Jul 4, 2024

• fix dataset argument error

  benlonnqvist

  committed
  d1948d3

  Copy full SHA for d1948d3

• Merge branch 'master' into malania2007

  benlonnqvist

  authored
  2756069

  Copy full SHA for 2756069

• Merge branch 'malania2007' of https://github.com/benlonnqvist/brain-score into malania2007

  benlonnqvist

  committed
  f363fd0

  Copy full SHA for f363fd0

Commits on Jul 5, 2024

• Apply suggestions from code review

  Show description for f06b683
  

  benlonnqvist

  and

  mschrimpf

  authored
  f06b683

  Copy full SHA for f06b683

• add renaming suggestions

  benlonnqvist

  committed
  6e322e3

  Copy full SHA for 6e322e3

• fix naming issues

  benlonnqvist

  committed
  c20bb5b

  Copy full SHA for c20bb5b

Commits on Jul 6, 2024

• remove out-dated aggregation dim in test

  mschrimpf

  authored
  faa1c7d

  Copy full SHA for faa1c7d

• fix identifier testing

  mschrimpf

  authored
  d10930f

  Copy full SHA for d10930f