Limitations in Language Models

I’ve identified key limitations in today’s language models:

• Language models produce worse multidocument summaries when provided retrieved documents (EMNLP Findings 2023),
• Standard prompting strategies result in coherence errors when summarizing novels (arXiv 2023),
• Layout-infused language models can be worse than text-only language models at visual layout parsing (ACL Findings 2023),
• Language models can decontextualize snippets from Wikipedia but not scientific articles (EMNLP 2023).