Philosophy of Language and Computation, Autumn 2022

ETH Zürich: Course catalog

Course Description

This graduate class, taught like a seminar, is designed to help you understand the philosophical underpinnings of modern work in natural language processing (NLP), most of which is centered around deep learning applied to natural language data. The course is a year-long journey, but the second half (Spring 2023) does not depend on the first (Fall 2022) and thus either half may be taken independently. In each semester, we divide the class time into three modules. Each module focuses on a philosophical topic. In the first semester we will discuss logic and language, structuralism, and recursive structure. And, in the second semester we will focus on language games, information theory, and pragmatics. The modules will be four weeks long. During the first two weeks of a module, we will read and discuss original texts and supplementary criticism. During the second two weeks, we will read recent NLP papers and discuss how the authors of those works are building on philosophical insights into our conception of language—perhaps implicitly or unwittingly.

The course will require a weekly reading of around 20 pages (with relatively high variance at times) and a weekly free-form responses to the reading, which is to be completed online. The mandatory readings for every week are bolded in the syllabus below. The weekly tasks are short and not graded, but, in order to pass the class, at least 70% of the tasks must be completed. See this document for the guidelines on the free-form responses. The final grade will be based, in equal parts, on one class presentation and two term papers (each around 5-10 pages) which are to be turned in at the latest one week before the start of the exam period, that is, on Sunday, January 15th, at midnight. Students must write term papers on the modules other than the one for which they have made a presentation. They will be expected to explore the relation of the topics discussed in class to work not presented in the class, focusing on the connection between the philosophy of language and NLP. For example, discussing how three recent NLP papers implicitly assumed a structuralist perspective on language would be a good topic.

Grading

Marks for the course will be determined by the following formula:

  • 1 / 3 Class presentation
  • 1 / 3 Term paper 1
  • 1 / 3 Term paper 2

More detailed instructions about the paper and presentation requirements can be found here:

Organization

Lectures:
Tue 16-18, HG E 1.1. The lectures will be given in person. This recurring Zoom meeting will be used throughout the semester for people who want to tune in remotely. The password can be found on the course Moodle page. The recordings of the lectures can be found on the course Polybox and the password can be found on the course Moodle page as well.

Discussion Sections: Tue 18-19 HG E 1.1.

Course Live Chat: To provide an easier way to communicate with the teaching team and your colleagues, we have set up a course chat server. We use RocketChat and the server is hosted on ETH servers. We encourage you to sign up and participate in the discussions there.

Important: There are three important points you should keep in mind about the course live chat:

  1. RocketChat will be the main communications hub for the course. You are responsible for receiving all messages broadcast in the RocketChat.
  2. Your username should be firstname.lastname. This is required as we will only allow enrolled students to participate in the chat and we will remove users which we cannot validate.
  3. We highly recommend you download the desktop app here.

Class Materials

News

07.08   Class website is online!
28.09Presentation assignments have been published.
29.09   The course Polybox has been published. You can find the password on the course Moodle page.

Syllabus and Schedule

Week Date Module Topic Material Reading
1 20.09.22 Introduction Introduction Slides Borges (1940a), Borges (1940a) in Spanish, Borges (1940b), Borges (1940b) in Spanish, Borges (1942) Borges (1942) in Spanish
2 27.09.22 Language and Logic: Formal Representations of Meaning Meaning: Between Sense and Denotation Frege Presentation Slides, Russell Presentation Slides Frege (1892), Frege (1892) in German, Russell (1905)
3 04.10.22 Formal and Natural Language Ajdukiewicz Presentation Slides, Montague Presentation Slides Ajdukiewicz (1936), Carnap (1947), Lambek (1958), Davidson (1967), Lewis (1970), Montague (1970)
4 11.10.22 Artificial Language Learning Modelling Artificial and Natural Languages Presentation Slides Wang and Eisner (2016), Ravfogel et al. (2019), White and Cotterell (2021), Delétang et al. (2022)
5 18.10.22 Compositionality and Combinatory Categorial Grammar CCG Presentation Slides Steedman (1996), Zettlemoyer and Collins (2005), Lake and Baroni (2018), Andreas (2019)
6 25.10.22 Structuralism: The Search for the Right Units Structural Dualities Saussure Presentation Slides, Origin of Speech Presentation Slides Saussure (1916), Saussure (1916) in French, Harris (1951), Hocket (1960)
7 01.11.22 Linguistic Units Linguistic Units Presentation Slides, Greimas (1966) Presentation Slides Hjelmslev (1943), Harris (1954), Firth (1957), Greimas (1966), Greimas (1966) in French
8 08.11.22 Meaning and Form Goldsmith Presentation Slides, Pimentel et al. (2021) Presentation Slides Goldsmith (2001), Gutiérrez et al. (2016), Pimentel et al. (2019), Mielke and Eisner (2019), Pimentel et al. (2021), Nikkarinen et al. (2021)
9 15.11.22 Words, Characters, or Something In Between Neural Machine Translation Presentation Slides, Character-Based Modeling Presentation Slides Kim et al. (2015), Sennrich et al. (2016), Vania et al. (2018), Mielke et al. (2021)
10 22.11.22 Recursive Structure: The Escherian Nature of Language Syntax and Computation Chomsky (1953) Presentation Slides, Chomsky (1955) Presentation Slides Chomsky (1953), Chomsky (1955)
11 29.11.22 Syntax and Cognition Chomsky (1957) Presentation Slides, Chomsky (1959) Presentation Slides Chomsky (1957), Chomsky (1956), Chomsky (1959)
12 06.12.22 Parsing—NLP’s Original Leaderboard Grammar in NLP Presentation Slides, Charniak (2000, Klein and Manning (2003) Presentation Slides Charniak (2000), Klein and Manning (2003), Hall et al. (2014), Vinyals et al. (2014), Dyer et al. (2016), Kitaev et al. (2022)
13 13.12.22 Computational Approaches to Human Syntactic Processing Computational Approaches to Human Syntactic Processing Presentation Slides Hale (2001), Levy and Jaeger (2007), Hale (2016), Meister et al. (2021)

Contact

You can ask questions on the course chat server. Please post questions there, so others can see them and join the discussion. If you have questions which are not of general interest, please don’t hesitate to contact us directly, i.e., email the lecturers with the TAs cc-ed.

Philosophy of Language and Computation Lecturers

Avatar

Ryan Cotterell

Assistant Professor of Computer Science

ETH Zürich

Philosophy of Language and Computation Teaching Assistants