Efficient Algorithms for Recognizing Weighted Tree-Adjoining Languages

Abstract

The class of tree-adjoining languages can be characterized by various two-level formalisms, consisting of a context-free grammar (CFG) or pushdown automaton (PDA) controlling another CFG or PDA. These four formalisms are equivalent to tree-adjoining grammars (TAG), linear indexed grammars (LIG), pushdown-adjoining automata (PAA), and embedded pushdown automata (EPDA). We define semiring-weighted versions of the above two-level formalisms, and we design new algorithms for computing their stringsums (the weight of all derivations of a string) and allsums (the weight of all derivations). From these, we also immediately obtain stringsum and allsum algorithms for TAG, LIG, PAA, and EPDA. For LIG, our algorithm is more time-efficient by a factor of π’ͺ(n|𝒩|) (where n is the string length and |𝒩| is the size of the nonterminal set) and more space-efficient by a factor of π’ͺ(|𝛀|) (where 𝛀 is the size of the stack alphabet) than the algorithm of Vijay-Shanker and Weir (1989). For EPDA, our algorithm is both more space-efficient and time-efficient than the algorithm of Alonso et al. (2001) by factors of π’ͺ(|𝛀|2) and π’ͺ(|𝛀|3), respectively. Finally, we give the first PAA stringsum and allsum algorithms.

Publication
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

Add the full text or supplementary notes for the publication here using Markdown formatting.