Repositories list

• clembench

  Public
  A Framework for the Systematic Evaluation of Chat-Optimized Language Models as Conversational Agents and an Extensible Benchmark

  Python

  •

  MIT License

  •32•24•22•4•Updated Oct 8, 2024Oct 8, 2024

• slurk-bots

  Public
  Bots for the Slurk project

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •14•2•1•2•Updated Oct 4, 2024Oct 4, 2024

• situatedactiongen-coderep

  Public
  0•0•0•0•Updated Oct 2, 2024Oct 2, 2024

• different-follower-behaviors

  Public
  Source code and documentation for the ACL'24 SpLU-RoboNLP workshop paper "Learning Communication Policies for Different Follower Behaviors in a Collaborative Reference Game"

  MIT License

  •0•0•0•0•Updated Jun 26, 2024Jun 26, 2024

• komodis-dataset

  Public
  A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Models

  Python

  •

  MIT License

  •2•0•0•0•Updated Apr 3, 2024Apr 3, 2024

• cost-sharing-reference-game

  Public
  Source code and documentation for the LREC-COLING'24 paper "Sharing the Cost of Success: A Game for Evaluating and Learning Collaborative Multi-Agent Instruction Giving and Following Policies"

  reinforcement-learningmulti-agentvision-and-language

  Python

  •

  MIT License

  •0•0•0•0•Updated Mar 27, 2024Mar 27, 2024

• pentoref

  Public
  A collection of Pentomino puzzle playing dialogue corpora annotated for reference to objects and disfluency.

  Jupyter Notebook

  •

  GNU General Public License v3.0

  •1•6•0•0•Updated Mar 25, 2024Mar 25, 2024

• modular_form_filling_with_llm

  Public
  This is the repository for the paper with the title "Evaluating Modular Dialogue System for Form Filling Using Large Language Models"

  Python

  •

  Apache License 2.0

  •1•2•0•0•Updated Feb 28, 2024Feb 28, 2024

• slurk

  Public
  Slurk (think “slack for mechanical turk”…) is a lightweight and easily extensible chat server built especially for conducting multimodal dialogue experiments or data collections.

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •21•15•9•2•Updated Dec 8, 2023Dec 8, 2023

• golmi

  Public
  Python

  •3•3•5•1•Updated Aug 11, 2023Aug 11, 2023

• language-models-multimodal-tasks

  Public
  Official Git repository for "Hakimov, S., and Schlangen, D., (2023). Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks. Findings of the Association for Computational Linguistics (ACL 2023 Findings)"

  language-modelmultimodal-learningmultimodal-sentiment-analysis+ 1multimodal-datasets

  Python

  •

  MIT License

  •1•3•0•0•Updated Aug 1, 2023Aug 1, 2023

• intra-episodic-feedback

  Public
  Source code and documentation for the ACL 2023 Findings paper "Yes, this Way! Learning to Ground Referring Expressions into Actions with Inter-episodic Feedback from Supportive Teachers"

  reinforcement-learningreferring-expressionsvision-language-navigation

  Python

  •

  MIT License

  •1•3•0•0•Updated Jul 5, 2023Jul 5, 2023

• pento-diaref

  Public
  Source code and documentation for the EACL 2023 paper "Pento-DIARef: A Diagnostic Dataset for Learning the Incremental Algorithm for Referring Expression Generation from Examples"

  generationreferring-expressionsdeep-learning

  Python

  •

  MIT License

  •0•0•0•0•Updated Apr 25, 2023Apr 25, 2023

• clp-vision

  Public
  Our code for working with language and vision corpora.

  Jupyter Notebook

  •5•3•5•7•Updated Mar 25, 2023Mar 25, 2023

• sempix

  Public
  Semantics with Pictures: Image Corpora as Semantic Annotation of Natural Language Expressions

  Jupyter Notebook

  •6•5•1•5•Updated Mar 25, 2023Mar 25, 2023

• image-description-sequences

  Public
  A corpus of 5 turn image descriptions

  Shell

  •2•5•0•0•Updated Mar 14, 2023Mar 14, 2023

• new-old-discourse-entities

  Public
  Code for the COLING22 paper about probing pre_trained LMs with discourse status entity knowledge.

  Python

  •0•1•0•0•Updated Sep 5, 2022Sep 5, 2022

• Venice

  Public
  Logger/Replayer for sensor data and bridge between network protocols

  HTML

  •

  MIT License

  •0•0•1•0•Updated Jul 11, 2022Jul 11, 2022

• diff-att-transformer

  Public
  Code for the INLG paper "Generating Landmark-based Manipulation Instructions from Image Pairs"

  Jupyter Notebook

  •

  MIT License

  •0•0•0•0•Updated Jun 29, 2022Jun 29, 2022

• golmi-matthew

  Public
  Python

  •1•0•0•0•Updated Oct 19, 2021Oct 19, 2021

• space-efficient-context-encoding-acl21

  Public
  to be done.

  Python

  •

  MIT License

  •3•0•0•0•Updated Jun 6, 2021Jun 6, 2021

• pentomino-js

  Public
  A pentomino framework with jQuery and HTML5 canvas

  JavaScript

  •1•1•0•1•Updated Mar 6, 2021Mar 6, 2021

• pytorch-expresso

  Public
  High-level framework for PyTorch to quickly setup training using configurable experiments

  Python

  •

  MIT License

  •1•0•0•0•Updated Feb 16, 2021Feb 16, 2021

• DUEL

  Public
  Derived data from the DUEL project experiments annotated with disfluency and laughter

  1•5•0•0•Updated Jul 22, 2020Jul 22, 2020

• slurk-audio-pilot

  Public archive
  Pilot experiment on audio recording based on slurk

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •1•0•0•0•Updated May 13, 2020May 13, 2020

• meetup

  Public
  Data for the Language & Vision / Visual Dialogue task "MeetUp!"

  Jupyter Notebook

  •

  BSD 3-Clause "New" or "Revised" License

  •2•4•0•0•Updated Jul 5, 2019Jul 5, 2019

• mouse-tracking-experiment

  Public
  mouse tracking experiment with Slurk

  Jupyter Notebook

  •1•0•0•0•Updated Apr 10, 2019Apr 10, 2019

• deep_disfluency

  Public
  Deep Learning systems for training and testing disfluency detection and related tasks on speech data.

  Python

  •

  MIT License

  •22•57•7•2•Updated Mar 8, 2019Mar 8, 2019

• installments

  Public
  Jupyter Notebook

  •2•1•0•0•Updated Oct 20, 2017Oct 20, 2017

• wac_object_naming

  Public
  Python

  •1•0•0•0•Updated Oct 20, 2017Oct 20, 2017