Selected Publications For a full list of publications, please refer to my Google Scholar page. OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data Shubham Toshniwal, Wei Du, Ivan Moshkov, Branislav Kisacanin, Alexan Ayrapetyan, Igor Gitman ICLR 2025 Code Dataset & Models bib Chess as a Testbed for Language Model State Tracking Shubham Toshniwal, Sam Wiseman, Karen Livescu, Kevin Gimpel AAAI 2022 Code Colab — Play against LM Slides Talk bib On Generalization in Coreference Resolution Shubham Toshniwal, Patrick Xia, Sam Wiseman, Karen Livescu, Kevin Gimpel CRAC@EMNLP 2021 — Best Short Paper Code Colab Slides bib Learning to Ignore: Long Document Coreference with Bounded Memory Neural Networks Shubham Toshniwal, Sam Wiseman, Allyson Ettinger, Karen Livescu, Kevin Gimpel EMNLP 2020 (short) Code Colab Slides Video LitBank Data bib Parsing Speech: A Neural Approach to Integrating Lexical and Acoustic-Prosodic Information Trang Tran*, Shubham Toshniwal*, Mohit Bansal, Kevin Gimpel, Karen Livescu, Mari Ostendorf NAACL HLT 2018 (Oral) Code Slides bib Multitask Learning with Low-Level Auxiliary Tasks for Encoder-Decoder Based Speech Recognition Shubham Toshniwal, Hao Tang, Liang Lu, Karen Livescu Interspeech 2017 (Oral) Slides Summary bib