LING 130: Quantified Noun Phrases

Similar documents
Semantics and Pragmatics of NLP Propositional Logic, Predicates and Functions

Proseminar on Semantic Theory Fall 2013 Ling 720 An Algebraic Perspective on the Syntax of First Order Logic (Without Quantification) 1

Lexicografie computationala Feb., 2012

Lecture 7. Introduction to Function-Argument Structure and Lambdas. 1. Function-argument structure in natural language

Logic and Natural Language Semantics: Formal Semantics

Semantics and Pragmatics of NLP

Syntax-semantics interface and the non-trivial computation of meaning

Computational Linguistics: Syntax-Semantics

Logic as a framework for NL semantics. Outline. Syntax of FOL [1] Semantic Theory Type Theory

Less naive type theory

F15: Formalizing definiteness

II. Judgements and -polymorphism

The discussion of Chapter 1 will be split into two sessions; the first will cover 1.1 and 1.2; the second will cover 1.3, 1.4, and 1.5.

6.863J Natural Language Processing Lecture 16: The meaning of it all, #2. (or #42) Instructor: Robert C. Berwick

Computational Linguistics: Syntax-Semantics Interface

Class Intro & Compositional Semantics & Others

INTENSIONAL LOGIC TRANSLATION FOR QUANTITATIVE NATURAL LANGUAGE SENTENCES

Delimited Continuations, Applicative Functors and Natural Language Semantics

CSCI.6962/4962 Software Verification Fundamental Proof Methods in Computer Science (Arkoudas and Musser) Chapter p. 1/27

Lecture 9. Fragment 3 of English including Possessives, using Lambdas.

Overview. CS389L: Automated Logical Reasoning. Lecture 6: First Order Logic Syntax and Semantics. Constants in First-Order Logic.

An Inverse Lambda Calculus Algorithm. For Natural Language Processing. Marcos Alvarez Gonzalez

Research Seminar The syntax and semantics of questions Spring 1999 February 16, 1999 Week 3: Introduction to the semantics of questions

Going beyond propositional logic

Conceptual and Logical Design

Lecture 5. Logic I. Statement Logic

F08: Intro to Composition

More Theories, Formal semantics

Lecture 13: Natural Language Semantics I

Type raising, continuations, and classical logic

Linking Semantics for Modification

λ -Calculus in Prolog

Fundamentals of Software Engineering

A Brief Incomplete Introduction to NLTK

Note that in this definition, n + m denotes the syntactic expression with three symbols n, +, and m, not to the number that is the sum of n and m.

Discourse Representation Theory Building Discourse Representations

L322 Syntax. Chapter 3: Structural Relations. Linguistics 322 D E F G H. Another representation is in the form of labelled brackets:

Chapter 1.3 Quantifiers, Predicates, and Validity. Reading: 1.3 Next Class: 1.4. Motivation

Context and the Composition of Meaning

6.001 Notes: Section 6.1

Introduction to Logic Programming

Do we really understand SQL?

Denotational Semantics of a Simple Imperative Language Using Intensional Logic

Last class. CS Principles of Programming Languages. Introduction. Outline

Computational Syntax & Compositional Semantics for Natural Language

Individuals, equivalences and quotients. in type theoretical semantics.

1 Introduction. 2 Set-Theory Formalisms. Formal Semantics -W2: Limitations of a Set-Theoretic Model SWU LI713 Meagan Louie August 2015

Computation Club: Gödel s theorem

Context-free Grammars

Formal Methods in Software Engineering 1

Lecture 5: Predicate Calculus. ffl Predicate Logic ffl The Language ffl Semantics: Structures

arxiv: v2 [cs.ai] 18 Sep 2013

Yi-Hsun Chen Feb 11, Compositional semantics of interrogative clauses

Typed Lambda Calculus for Syntacticians

(Refer Slide Time: 4:00)

CITS2211 Discrete Structures Logic

CSC 501 Semantics of Programming Languages

Lecture 4: January 12, 2015

Module 8. Other representation formalisms. Version 2 CSE IIT, Kharagpur

Where Can We Draw The Line?

The University of Nottingham SCHOOL OF COMPUTER SCIENCE A LEVEL 4 MODULE, SPRING SEMESTER MATHEMATICAL FOUNDATIONS OF PROGRAMMING ANSWERS

Propositional Logic. Part I

Assignment 4 CSE 517: Natural Language Processing

6.1 Basics of functional type theory, semantics of serial verbs via function composition.

COMPUTATIONAL SEMANTICS WITH FUNCTIONAL PROGRAMMING JAN VAN EIJCK AND CHRISTINA UNGER. lg Cambridge UNIVERSITY PRESS

3.7 Denotational Semantics

Solving Natural Language Math Problems

Lecture 5 - Axiomatic semantics

Introduction to Semantics. Expanding Our Formalism, Part 2 1

X-KIF New Knowledge Modeling Language

Calculus of Inductive Constructions

Indefinites and Sluicing. A type logical approach

Chapter 2 & 3: Representations & Reasoning Systems (2.2)

6.001 Notes: Section 8.1

Semantics Bootcamp Part I: Fundamentals

For next Tuesday. Read chapter 8 No written homework Initial posts due Thursday 1pm and responses due by class time Tuesday

The Verb. From Probabilities to Internal Categories. Cem Bozşahin. Cognitive Science Department, The Informatics Institute, ODTÜ

What is a Logic Program. Introduction to Logic Programming. Introductory Examples. Introductory Examples. Foundations, First-Order Language

Notes. Notes. Introduction. Notes. Propositional Functions. Slides by Christopher M. Bourke Instructor: Berthe Y. Choueiry.

Coreference without Discourse Referents

Introduction to Logic Programming

CS 6110 S14 Lecture 1 Introduction 24 January 2014

Syntax 380L December 4, Wh-Movement 2. For notational convenience, I have used traces (t i,t j etc.) to indicate copies throughout this handout.

SOFTWARE ENGINEERING Prof.N.L.Sarda Computer Science & Engineering IIT Bombay. Lecture #10 Process Modelling DFD, Function Decomp (Part 2)

F. Brief review of classical predicate logic (PC)

CS 512, Spring 2017: Take-Home End-of-Term Examination

LING 510, Lab 3 September 23, 2013

Introduction to Scheme

Semantics of programming languages

Types, Expressions, and States

Typed Lambda Calculus

Introduction & Review

Denotational semantics

Semantics 1. Gerhard Jäger. April 26, (April 26, 2012) Semantics 1 Gerhard Jäger 1 / 28

A Substructural Type System for Delimited Continuations

Propositional Logic Formal Syntax and Semantics. Computability and Logic

This is already grossly inconvenient in present formalisms. Why do we want to make this convenient? GENERAL GOALS

The anatomy of a syntax paper

564 Lecture 21 Nov. 4, 1999

Lexical entries & clauses

Transcription:

LING 130: Quantified Noun Phrases James Pustejovsky March 15, 2010 1 Syntax for Typed λ-calculus We will now present a language which uses specific types of entities, where the entities are combined with the λ-calculus. From two basic types, where e is the type of individuals and t is the type of propositions, the set T of types is generated as follows: (1) (a) e T (b) t T (c) If σ, τ T, then σ τ T. In order to demonstrate the application and abstraction of typed expressions, let us consider some examples from linguistic expressions. Given the basic types of e and t, we can construct recursively other types, which in fact correspond quite nicely to notions that we are familiar with from first order logic or semantics. Consider the following. If an expression such as John, denoting the individual John in the world, is an entity and hence of type e, and an expression such as John fell is a proposition that is either true or false (and hence of type t), then what is the predicate fell in this expression typed as? Well, if the mode of construction is functional, then, it will be a function, typed as e t. t e e t The types here are acting functionally, according to the rule of application, given below: (2) Function Application: If α is of type a, and β is of type a b, then β(α) is of type b. Hence, the type for an intransitive verb is e t. In fact, this is the type for any predicate in general. (3) (i) walk: e t (ii) walk slowly: e t (iii) eat fish: e t (iv) tell Mary where to buy her house: e t 1

The rule for abstraction allows us to substitute a predicate constant for a λ-expression of the appropriate type: (4) (a) walk = λx[walk(x)] (b) love = λxλy[love(y, x)] Notice that a binary relation is yet another function, built out of the simpler function of an intransitive predicate. 1.1 Determining the Type of an Expression For any expression φ, of type τ, the functional abstraction of φ with variable x of type σ has the type σ τ. This is visualized below: σ τ {}}{ σ τ {}}{{}}{ λ x φ So, it might be clear how to make unary, binary, and ternary relations using functional abstraction and types, but what do we do for cases that appear to be higher order in nature? For example, consider the behavior of adverbs. (5) (a) John fell slowly. (b) Mary talked quickly. (c) Bill ate noisily. What we will do is treat adverbial phrases as functions over predicates, returning predicates. As such, the type for an adverbial is (e t) (e t)). The type tree for such a modification is shown below: e t e t ((e t) (e t) This will be the general strategy in most typed λ-calculi for treating higher order modification relations. An example of the syntactic structure and type tree for a simple binary relation taking proper names is illustrated below. (a) John loves Mary. S:t. love(j, m) John:e. j VP: e t. λx[love(x, m)] John V:e (e t) NP:e. m love. λxλy[love(y, x)] Mary 2

2 Semantics for Typed λ-calculus We define the domain of interpretation for a domain D to be D D, and for a type σ, the domain of interpretation is D σ. Together, we get the domain of interpretation for a type σ for a domain D, written as D D,σ. Since we have three type statements, there will be three interpretation statements: (6) (a) D D,e = D (b) D D,t = {0, 1} (c) D D,σ τ = D D D,σ D,τ The interpretation domain of intransitive verbs, for example, is the set of functions Dt De. That is, {0, 1} D. And a two-place relation such as love is the set of functions mapping entities onto sets of entities, (Dt De ) De, in other words, ({0, 1} D ) D. A model for a type language consists of D and an interpretation function I. As with our model of first order logic, we will use I as the interpretation function, and instead of the assignment function U we will use g to indicate assignments. The interpretation function [ ]] M,g is a function which maps a well formed expression into D D,σ. So, for an expression α, we can define the interpretations as follows: (7) (a) If α CON L σ, then [α] M,g = I(α) If α VAR σ, then [α] M,g = g(α) (b) If α WE L σ τ, and β WE L σ, then [α(β)] M,g = [α] M,g ([β ] M,g ). (c) If φ, ψ WE L t, then [ φ] M,g = 1 iff [φ] M,g = 0 [φ ψ ] M,g = 1 iff [φ] M,g = 1 and [ψ ] M,g = 1 [φ ψ ] M,g = 1 iff [φ] M,g = 1 or [ψ ] M,g = 1 [φ ψ ] M,g = 0 iff [φ] M,g = 1 and [ψ ] M,g = 0 [φ ψ ] M,g = 1 iff [φ] M,g = [ψ ] M,g (d) If φ WE L t, v VAR σ, then [ vφ] M,g = 1 iff for all d D D,σ : [φ] M,g[v/d] = 1 [ vφ] M,g = 1 iff there is at least one d D D,σ : [φ] M,g[v/d] = 1 (e) If φ WE L t, v VAR σ, then λvφ WE L σ τ ; and if β WE L σ, then [λvφ(β)] M,g = [λvφ] M,g ([β ] M,g ). (f) If α, β WE L σ, then [α = β ] M,g = 1 iff [α] M,g = [β ] M,g 3

3 The Type of a Quantified Expression In Section 1.0, we only considered NPs that were proper names, hence interpreted as constants in our model. But we need to be able to refer to individuals by description, and not by name. For example, we need some way to talk about the following NPs: a man, every course, some professor. We sort of know what we want the formula to look like when they re combined with predicates: (8) a. a man walked. x[man(x) walk(x)]. So, a man contains x[man(x)? ] b. every course is full. x[course(x) f ull(x)]. So, every course contains x[course(x)? ] c. some professor taught. x[prof essor(x) taught(x)]. So, some professor contains x[professor(x)? ] Now, what is the type for a quantified NP such as a man? Well, look at (a) above. If the predicate walk is typed e t, then we could say that this quantified NP is looking for a predicate to make a proposition: i.e., it s looking for e t to make a t. Hence, it s type is (e t) t. So, now let s return to the examples above, and complete the semantic expression for each quantified NP. If we let P and Q stand for predicate variables, that is, variables of type e t, then we can finish the picture. (9) a. a man: λp x[man(x) P (x)] b. every course: λp x[course(x) P (x)] c. some professor: λp x[prof essor(x) P (x)] Now, let us imagine what the semantics of the quantifier all by itself is. Again, take away the predicative meaning of the noun that is the head of the NP, which is typed as e t. Then we can represent some, every, and the as follows. We are essentially following the definitions from Montague (1970). (10) (i) a: λp λq x[p (x) Q(x)] (ii) every: λp λq x[p (x) Q(x)] (iii) the: λp λq x y[[p (y) x = y] Q(x)] An example of the definite NP is shown below: (11) (a) the teacher: λp x y[[teacher(y) x = y] P (x)] The type tree for a quantifier, such as every, combining with a common noun such as woman is illustrated below: (e t) t (e t) ((e t) t) (e t) every woman 4

The resulting functional expressions are called generalized quantifiers. Now let us look at how quantifiers show up in transitive verbs, such as love, buy, and eat. First, consider the QNP in subject position, as with the sentence below. a. Every child loves Big Bird. y[child(y) love(y, bb)] y[child(y) λx[love(x, bb)](y)] S:t. λp y[child(y) P (y)](λx[love(x, bb)]) λp y[child(y) P (y)] VP: e t. λx[love(x, bb)] every child V:e (e t) NP:e. bb love. λxλy[love(y, x)] Big Bird 4 Quantifier Substitution It would be nice to think that compositional mechanisms do not change that much depending on the nature of the argument. But they do, and this is nowhere more apparent than when a quantified expression appears anywhere other than in subject position of the sentence, as illustrated below. a. Big Bird loves every child. b. S NP:e. bb VP: Type Error: NP is wrong type for FA Big Bird V:e (e t) NP:(e t) t. λp x[child(x) P (x)] love. λxλy[love(y, x)] every child To solve this kind of type mismatch, we re going to rework a very clever algorithm that Robin Cooper came up with, usually referred to as Cooper Storage (Cooper, 1975). We will attempt to maintain the functional behavior for a predicate that we see in the syntax, as well as that which we saw above for constants in all argument positions. In other words, if a verb selects an argument that is typed as e, then it will take an argument of that type, even if the argument is a QNP such as every woman. I will refer to this as a Quantifier Substitution(QS), and informally it looks like the following. (12) a. Big Bird loves every child. = b. Big Bird loves C. {[C/every child] σ }. 5

This says that there is a substitution, σ, where the semantics for every child is replace by the constant, C. Notice that it is very similar to the quantifier elimination rules in Chapter 2 of the Semantics book, where we can infer an arbitrary constant, a, in place of a quantifier scoping over a formula. Then, once the function application semantics of the entire expression has been worked through, we substitute the two expressions, which then results in further function application possibilities. (13) Quantifier Substitution: For every expression, γ, in a sentence, we associate a body, α, and the set of quantifier substitutions, Σ, where Σ = {[C 1 /Q 1 ] σ1, [C 2 /Q 2 ] σ2,..., [C n /Q n ] σn } γ = α{σ} We now define a rule called Substitution Application. This applies to each substitution, σ i in Σ, and it performs the following operation: (14) α{σ u } = σ u (λuα[u]) Let s give a simple example to see how this works. We return to the derivation that broke earlier, namely, Big Bird loves every child. (15) STEP-BY-STEP: a. Big Bird loves every child. b. loves: λxλy[love(y, x)] c. every child: λp x[child(x) P (x)] d. Quantifier Substitution (QS): C : e, [C/λP x[child(x) P (x)]] σ e. Function Application: λxλy[love(y, x)] : e (e t), C : e = λy[love(y, C)] : e t f. VP now denotes: λy[love(y, C)]{σ} g. Function Application: λy[love(y, C)]{σ}(bb) = [love(bb, C)]{σ} h. Substitution Application: [love(bb, C)]{σ} = λp x[child(x) P (x)](λy[love(bb, y)]) i. Function Application: λp x[child(x) P (x)](λy[love(bb, y)]) = x[child(x) λy[love(bb, y)](x)] j. Function Application: x[child(x) λy[love(bb, y)](x)] = x[child(x) love(bb, x)] k. (16) TREE DERIVATION: a. Big Bird loves every child. S:t. x[child(x) love(bb, x)]] b. S:t. λp x[child(x) P (x)]](λy[love(bb, y)]) S:t. love(bb, C){[C/λP x[child(x) P (x)]] σ } Big Bird:e. bb VP: e t. λx[love(x, C)]{[C/λP x[child(x) P (x)]] σ } Big Bird V:e (e t) NP:(e t) t. λp x[child(x) P (x)] love. λxλy[love(y, x)] every child 6

If the quantifier substitution operation is similar to quantifier elimination, then the substitution application is similar to a successful arrow introduction, illustrating that the type shifting of the QNP to an individual was successful. This technique also works for embedded quantiers and coordinate NP constructions, which we will get to shortly. We will get to this topic in the next handout. 7