Hi, I'm Kayo
Bonjour, je suis Kayo
今日は、綺妤です 

[kajo iɴ]
she/her
kayoyin🥸berkeley.edu
VitaeBioFun


Anonymous feedback
Hello! I'm a PhD student at UC Berkeley advised by Jacob Steinhardt and Dan Klein, and affiliated with Berkeley AI Research and Berkeley NLP. I'm interested in better understanding LLMs to make them safe and robust, and in NLP for signed languages. I am grateful to be supported by a Future of Life PhD fellowship.

I did my master's at Carnegie Mellon University where I was fortunate to be advised by Graham Neubig, and I did my undergrad at École Polytechnique. I also interned at Microsoft Research and DeepMind. In a previous life, I wanted to become a classical musician and I have a CEM from Conservatoire Frédéric Chopin.

I come from Akashi, Japan and grew up in Paris, France. I like to play music, practice martial arts, backcountry snowboard, and paint memes.

  • 2023-10-27 Gave an invited talk at Université Laval.
  • 2023-07-10 Extremely thrilled to receive the Best Resource Paper award at ACL 2023!
  • 2023-05-15 I started my internship at Microsoft Research! Ping me if you want to meet up in NYC :)
  • 2023-04-28 Gave an invited talk at KUNGFU.AI.
  • 2023-04-26 Gave an invited talk at Sony CSL.
  • 2023-02-10 Gave an invited talk at the University of Chicago and Toyota Technological Institute at Chicago.
  • 2022-12-19 Gave an invited talk at the University of Melbourne.
  • 2022-12-11 Extremely honored to receive the Best Paper Honorable Mention award at EMNLP 2022!
  • 2022-08-19 Gave an invited talk at the Workshop on Pronouns and Machine Translation.
  • 2022-07-27 Gave an invited presentation at IJCAI on Including Signed Languages in NLP. My first in-person conference yay!
  • 2022-07-09 Gave a keynote talk at the Queer in AI Workshop @NAACL.
  • 2022-06-06 I started my internship at DeepMind! If you're in London this summer, let's meet up :)
  • 2022-05-19 Guested on the NLP Highlights Podcast.
  • 2022-04-15 I will join UC Berkeley for my PhD next Fall!
  • 2021-11-05 Gave an invited talk at DeepMind on Natural Language Processing for Signed Languages
  • 2021-10-07 Gave an invited talk at University of Pittsburgh on Extending Neural Machine Translation to Dialogue and Signed Languages
  • 2021-09-23 Extremely honored to be selected as a Siebel Scholar Class of 2022!
  • 2021-09-17 Gave an invited talk at SIGTYP on Understanding, Improving and Evaluating Context Usage in Context-aware Machine Translation
  • 2021-07-05 Extremely thrilled to receive the Best Theme Paper award at ACL 2021!
  • 2021-03-01 Gave an invited talk at Unbabel on Do Context-Aware Translation Models Pay the Right Attention?
  • 2020-10-18 Gave an invited talk at Computer Vision Talks on Sign Language Translation with Transformers
  • 2020-09-21 Extremely honored to be awarded Global Winner in Computer Science at The Global Undergraduate Awards 2020!
  • 2020-08-31 Started my Master's degree at CMU LTI!
  • Research

    My current research interests are as difficult to pin down as my music taste.
    I am generally motivated by ideas that
    1. improve our understanding of how things work (e.g. black box models, natural languages, artificial/human intelligence, the universe...),
    2. promote safety, inclusivity, and fairness,
    3. become elegant solutions for really hard problems that will work well in the long run.
    Here are some topics that I have worked on:

  • Model Interpretability: I am interested in explaining how large language models make decisions (EMNLP'22) and understanding their capabilities and limitations. I am also interested in how neural networks process language on a fundamental level and how machine intelligence compares with human cognition.

  • Sign Language Processing: I am interested in modeling signed languages from a linguistic perspective and extending existing language technologies to signed languages (ACL'21, ECCV'20, COLING'20, MTSummit21, EMNLP'21). I am also interested in using computational models to help us better understand how signed languages work.

  • Context-aware Machine Translation: I am interested in when context, either on an intra-sentential (within the current sentence), inter-sentential (across multiple sentences), or extra-linguistic (e.g. social, temporal, cultural) level, is required during translation, and how to model these features in machine translation (ACL'21, ACL'21, ACL'23).


  • Please reach out if you'd like to chat or collaborate! I am generally responsive to emails and Twitter messages, I do not check LinkedIn very often, and I prefer that people do not contact me on social media that I have not listed on this website.

    Publications

    * = equal contribution

    • 🏆 Best Resource Paper
      When Does Translation Require Context? A Data-driven, Multilingual Exploration
      Patrick Fernandes*, Kayo Yin*, Emmy Liu, André F. T. Martins and Graham Neubig.
      Conference of the Annual Meeting of the Association for Computational Linguistics (ACL). July 2023.
      PDF Code

    • 🏆 Best Paper Runner-Up
      Interpreting Language Models with Contrastive Explanations
      Kayo Yin and Graham Neubig.
      Conference on Empirical Methods in Natural Language Processing (EMNLP). December 2022.
      PDF Code

    • Signed Coreference Resolution
      Kayo Yin, Kenneth DeHaan and Malihe Alikhani.
      Conference on Empirical Methods in Natural Language Processing (EMNLP). November 2021.
      PDF Code Video

    • When is Wall a Pared and when a Muro?: Extracting Rules Governing Lexical Selection
      Aditi Chaudhary, Kayo Yin, Antonios Anastasopoulos and Graham Neubig.
      Conference on Empirical Methods in Natural Language Processing (EMNLP). November 2021.
      PDF Code

    • 🏆 Best Theme Paper
      Including Signed Languages in Natural Language Processing
      Kayo Yin, Amit Moryossef, Julie Hochgesang, Yoav Goldberg and Malihe Alikhani.
      Conference of the Annual Meeting of the Association for Computational Linguistics (ACL). August 2021.
      PDF Video

    • Do Context-Aware Translation Models Pay the Right Attention?
      Kayo Yin, Patrick Fernandes, Danish Pruthi, Aditi Chaudhary, André F. T. Martins and Graham Neubig.
      Conference of the Annual Meeting of the Association for Computational Linguistics (ACL). August 2021.
      PDF Code Video

    • Measuring and Increasing Context Usage in Context-Aware Machine Translation
      Patrick Fernandes, Kayo Yin, Graham Neubig and André F. T. Martins.
      Conference of the Annual Meeting of the Association for Computational Linguistics (ACL). August 2021.
      PDF Code

    • Data Augmentation for Sign Language Gloss Translation
      Amit Moryossef*, Kayo Yin*, Graham Neubig and Yoav Goldberg.
      Machine Translation Summit (MTSummit) International Workshop on Automatic Translation for Signed and Spoken Languages (AT4SSL). August 2021.
      PDF

    • 🏆 Global Undergraduate Award
      Better Sign Language Translation with STMC-Transformer
      Kayo Yin and Jesse Read.
      International Conference on Computational Linguistics (COLING). November 2020.
      PDF Code

    • Sign Language Translation with Transformers
      Kayo Yin and Jesse Read.
      European Conference on Computer Vision (ECCV) Workshop on Sign Language Recognition, Translation and Production (SLRTP). August 2020.
      PDF Code Video

    Talks


    2023

    2022

    2021

    2020

    2017-2019

    Selected Awards



    Copyright © Kayo Yin 2021-2023
    Last updated July 15 2023