| A theory of emergent in-context learning as implicit structure induction Michael Hahn, Navin Goyal arXiv Preprint, In Preparation.
[bibtex] [pdf] |
| A Formal Framework for Understanding Length Generalization in Transformers Xinting Huang, Andy Yang, Satwik Bhattamishra, Yash Sarrof, Andreas Krebs, Hattie Zhou, Preetum Nakkiran, Michael Hahn arXiv Preprint, In Preparation.
[bibtex] [pdf] |
| Linguistic Structure from a Bottleneck on Sequential Information Processing Richard Futrell, Michael Hahn arXiv Preprint, In Preparation.
[bibtex] [pdf] |
| A unifying theory explains seemingly contradicting biases in perceptual estimation Michael Hahn, Xue-Xin Wei Nature Neuroscience, 2024.
[bibtex] [pdf] [preprint] [code] [supplement] |
| More frequent verbs are associated with more diverse valency frames: Efficient language design at the lexicon-grammar interface Siyu Tao, Lucia Donatelli, Michael Hahn Proceedings of the 2024 Annual Conference of the Association for Computational Linguistics (ACL 2024), 2024.
[bibtex] |
| The Expressive Capacity of State Space Models: A Formal Language Perspective Yash Sarrof, Yana Veitsman, Michael Hahn The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024), 2024.
[bibtex] [pdf] [preprint] |
| InversionView: A General-Purpose Method for Reading Information from Neural Activations Xinting Huang, Madhur Panwar, Navin Goyal, Michael Hahn The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024), 2024.
[bibtex] [pdf] |
| Why are Sensitive Functions Hard for Transformers? Michael Hahn, Mark Rofin Proceedings of the 2024 Annual Conference of the Association for Computational Linguistics (ACL 2024) 🏆 Best Paper Award, 2024.
[bibtex] [pdf] [preprint] |
| Separations in the Representational Capabilities of Transformers and Recurrent Architectures Satwik Bhattamishra, Michael Hahn, Phil Blunsom, Varun Kanade The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024), 2024.
[bibtex] [pdf] |
| Modeling task effects in human reading with neural network-based attention Michael Hahn, Frank Keller Cognition, 2023.
[bibtex] [pdf] [preprint] [code] |
| A Cross-Linguistic Pressure for Uniform Information Density in Word Order Thomas Hikaru Clark, Clara Meister, Tiago Pimentel, Michael Hahn, Ryan Cotterell, Richard Futrell, Roger Levy Transactions of the Association for Computational Linguistics, 2023.
[bibtex] [pdf] [doi] |
| A resource-rational model of human processing of recursive linguistic structure Michael Hahn, Richard Futrell, Roger Levy, Edward Gibson Proceedings of the National Academy of Sciences of the United States of America, 2022.
[bibtex] [pdf] [doi] [code] [supplement] |
| Crosslinguistic word order variation reflects evolutionary pressures of dependency and information locality Michael Hahn, Yang Xu Proceedings of the National Academy of Sciences of the United States of America, 2022.
[bibtex] [pdf] [preprint] [doi] [code] [supplement] |
| Morpheme ordering across languages reflects optimization for processing efficiency Michael Hahn, Rebecca Mathew, Judith Degen Open Mind: Discoveries in Cognitive Science, 2022.
[bibtex] [pdf] [doi] [code] [supplement] |
| Explaining patterns of fusion in morphological paradigms using the memory--surprisal tradeoff Neil Rathi, Michael Hahn, Richard Futrell Proceedings of the 44th Annual Meeting of the Cognitive Science Society (CogSci), 2022.
[bibtex] [pdf] |
| Modeling fixation behavior in reading with character-level neural attention Songpeng Yan, Michael Hahn, Frank Keller Proceedings of the 44th Annual Meeting of the Cognitive Science Society (CogSci), 2022.
[bibtex] [pdf] |
| Information theory as a bridge between language function and language form Richard Futrell, Michael Hahn Frontiers in Communication, 2022.
[bibtex] [pdf] [doi] |
| Modeling word and morpheme order in natural language as an efficient tradeoff of memory and surprisal Michael Hahn, Judith Degen, Richard Futrell Psychological Review, 2021.
[bibtex] [pdf] [preprint] [doi] [code] [supplement] [slides] |
| Sensitivity as a complexity measure for sequence classification tasks Michael Hahn, Dan Jurafsky, Richard Futrell Transactions of the Association for Computational Linguistics, 2021.
[bibtex] [pdf] [preprint] [code] [slides] |
| An Information-Theoretic Characterization of Morphological Fusion Neil Rathi, Michael Hahn, Richard Futrell Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021.
[bibtex] [pdf] [code] |
| Universals of word order reflect optimization of grammars for efficient communication Michael Hahn, Dan Jurafsky, Richard Futrell Proceedings of the National Academy of Sciences of the United States of America, 2020.
[bibtex] [pdf] [code] [supplement] |
| Theoretical limitations of self-attention in neural sequence models Michael Hahn Transactions of the Association for Computational Linguistics, 2020.
[bibtex] [pdf] [preprint] [doi] [supplement] [slides] |
| RNNs can generate bounded hierarchical languages with optimal memory John Hewitt, Michael Hahn, Surya Ganguli, Percy Liang, Christopher Manning Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), 2020.
[bibtex] [pdf] [preprint] [code] |
| Tabula nearly rasa: Probing the linguistic knowledge of character-level neural language models trained on unsegmented text Michael Hahn, Marco Baroni Transactions of the Association for Computational Linguistics, 2019.
[bibtex] [pdf] [preprint] [code] |
| Estimating predictive rate-distortion curves via neural variational inference Michael Hahn, Richard Futrell Entropy, 2019.
[bibtex] [pdf] [code] [reviews] |
| Character-based surprisal as a model of human reading in the presence of errors Michael Hahn, Frank Keller, Yonatan Bisk, Yonatan Belinkov Proceedings of the 41st Annual Meeting of the Cognitive Science Society (CogSci), 2019.
[bibtex] [pdf] [preprint] [code] |
| An information-theoretic explanation of adjective ordering preferences Michael Hahn, Judith Degen, Noah Goodman, Dan Jurafsky, Richard Futrell Proceedings of the 40th Annual Meeting of the Cognitive Science Society (CogSci), 2018.
[bibtex] [pdf] [code] [slides] |
| Wreath Products of Distributive Forest Algebras Michael Hahn, Andreas Krebs, Howard Straubing Logic in Computer Science (LICS), 2018.
[bibtex] [pdf] [preprint] [code] [slides] |
| Modeling human reading with neural attention Michael Hahn, Frank Keller Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016.
[bibtex] [pdf] [code] |
| Visibly Counter Languages and the Structure of NC1 Michael Hahn, Andreas Krebs, Klaus-Jörn Lange, Michael Ludwig Proceedings of Mathematical Foundations of Computer Science (MFCS) 2015, 2015.
[bibtex] [pdf] |
| Henkin Semantics for Reasoning with Natural Language Michael Hahn, Frank Richter Journal of Language Modeling, 2015.
[bibtex] [pdf] [code] |
| Predication and NP Structure in an Omnipredicative Language: The Case of Khoekhoe Michael Hahn Proceedings of the 21st International Conference on Head-Driven Phrase Structure Grammar (Stefan Müller, ed.)CSLI Publications, 2014.
[bibtex] [pdf] |
| On deriving semantic representations from dependencies: A practical approach for evaluating meaning in learner corpora Michael Hahn, Detmar Meurers Dependency Theory (Kim Gerdes, Eva Hajicová, Leo Wanner, eds.)IOS Press, 2014.
[bibtex] |
| CoMeT: Integrating different levels of linguistic modeling for meaning assessment Niels Ott, Ramon Ziai, Michael Hahn, Detmar Meurers Proceedings of the 7th International Workshop on Semantic Evaluation (SemEval), 2013.
[bibtex] [pdf] |
| Word Order Variation in Khoekhoe Michael Hahn Proceedings of the 20th International Conference on Head-Driven Phrase Structure Grammar (Stefan Müller, ed.), 2013.
[bibtex] [pdf] |
| Evaluating the Meaning of Answers to Reading Comprehension Questions: A Semantics-Based Approach Michael Hahn, Detmar Meurers Proceedings of the 7th Workshop on Innovative Use of NLP for Building Educational Applications (BEA7)Association for Computational Linguistics, 2012.
[bibtex] [pdf] |
| Arabic Relativization Patterns: A Unified HPSG Analysis Michael Hahn Proceedings of the 19th International Conference on Head-Driven Phrase Structure Grammar, 2012.
[bibtex] [pdf] |
| Null Conjuncts and Bound Pronouns in Arabic Michael Hahn The Proceedings of the 18th International Conference on Head-Driven Phrase Structure Grammar, 2011.
[bibtex] |
| On deriving semantic representations from dependencies: A practical approach for evaluating meaning in learner corpora Michael Hahn, Detmar Meurers Proceedings of the Int. Conference on Dependency Linguistics (Depling 2011), 2011.
[bibtex] [pdf] |