Issues

• Futrell2018 GPT-Neo score changes at context overflow with HF sliding KV cache

  brain-score/language#415 · Filter by author hxu129 opened on Sep 28, 2026
  

• build status not showing

  brain-score/language#324 · Filter by author mschrimpf opened on Jan 30, 2026

• Severe slowdown in scipy.stats.pearsonr calls when using Dask (via result_caching)

  brain-score/language#241 · Filter by author BKHMSI opened on Jan 26, 2025

• add EWOK benchmark

  benchmark-request
  brain-score/language#239 · Filter by author mschrimpf opened on Jun 23, 2024

• bug in Futrell2018 corpus?

  brain-score/language#237 · Filter by author mschrimpf opened on May 13, 2024

• add generic unit tests for all models

  brain-score/language#234 · Filter by author kvfairchild opened on Mar 7, 2024

• add word length baseline model

  model-request
  brain-score/language#233 · Filter by author mschrimpf opened on Mar 3, 2024

• BS Core utility hooks refactor

  brain-score/language#231 · Filter by author deirdre-k opened on Jan 16, 2024
  2

  

• add Mistral and Mixtral

  model-request
  brain-score/language#228 · Filter by author mschrimpf opened on Dec 11, 2023

• add "Narratives" fMRI recording

  benchmark-request
  brain-score/language#223 · Filter by author mschrimpf opened on Nov 24, 2023

• syntax gym single benchmark parent should be syntax gym

  brain-score/language#185 · Filter by author mschrimpf opened on May 23, 2023

• SyntaxGym redundant suites?

  question
  brain-score/language#184 · Filter by author mschrimpf opened on May 23, 2023
  8

  

• add mosaic's MPT models

  model-request
  brain-score/language#180 · Filter by author mschrimpf opened on May 13, 2023

• add generic unit tests for all benchmarks

  brain-score/language#177 · Filter by author mschrimpf opened on May 1, 2023

• Ensure that new model & new benchmark get scored together when added simultaneously

  bug
  brain-score/language#175 · Filter by author kvfairchild opened on Apr 29, 2023
  

• Run memory-intense / slow / GPU-only tests on Jenkins

  enhancement
  brain-score/language#172 · Filter by author kvfairchild opened on Apr 28, 2023

• add python 3.7 to build matrix again

  brain-score/language#171 · Filter by author mschrimpf opened on Apr 28, 2023

• add behavioral benchmarks from Huang et al. 2023

  benchmark-request
  brain-score/language#169 · Filter by author mschrimpf opened on Apr 22, 2023

• add StableLM

  model-request
  brain-score/language#168 · Filter by author mschrimpf opened on Apr 20, 2023

• add Pythia

  model-request
  brain-score/language#167 · Filter by author mschrimpf opened on Apr 13, 2023

• add ScLM

  model-request
  brain-score/language#150 · Filter by author mschrimpf opened on Apr 3, 2023
  1

• Routine cleanup for automerge-web PRs

  enhancement
  brain-score/language#149 · Filter by author kvfairchild opened on Apr 2, 2023

• separate test status display for library and plugins

  enhancement
  brain-score/language#141 · Filter by author mschrimpf opened on Mar 26, 2023
  

• add Alpaca

  model-request
  brain-score/language#138 · Filter by author mschrimpf opened on Mar 17, 2023

• add LLAMA

  model-request
  brain-score/language#137 · Filter by author mschrimpf opened on Mar 7, 2023