Degen, Hawkins, Graf, Kreiss and Goodman (2020): When Redundancy Is Useful: A Bayesian Approach to "Overinformative" Referring Expressions #
Degen and colleagues' rational speech act model with a continuous semantics. A referring
expression holds of an object to a degree in the unit interval. An adjective of semantic value x
holds to degree x of the objects in its Boolean extension and to degree 1 − x of the others,
and an expression of two adjectives multiplies their degrees. The literal listener normalizes the
degrees over the objects of the context, and the speaker chooses an expression in proportion to
the exponential of its utility, the log of the listener's probability of the intended object less
the cost of the expression. An adjective that the Boolean semantics makes redundant then adds
information, and adds more the less noisy it is.
Main statements #
overmodification_odds_lt_iff: among the three pins of the paper's first figure the speaker adds a redundant colour to a sufficient size more readily than a redundant size to a sufficient colour exactly when size is the noisier of the two, at every positive rationality and when the two redundant adjectives cost the same.color_overmodification_iff,size_overmodification_iff: without cost the redundant expression is preferred to the sufficient one exactly when the semantic value of the redundant adjective exceeds one half.boolean_no_preference: with Boolean values the redundant adjective adds nothing.
Implementation notes #
S1isRSA.speaker, whose rationalityαscales the whole utility. The paper weights informativeness and cost separately and notes that the two parameterizations are equivalent.- The listener and the speaker take any graded meaning, so the typicality semantics of the
paper's third experiment is the same model at another meaning, and
S1_real_lt_iffis its preference for the term of greater utility.
TODO #
- Tables 2 and 3 do not follow from Equation (1) at the stated values x_size = .8 and x_colour = .99. Their values match a listener proportional to the exponential of the meaning. The theorems follow the equations.
- The regression coefficients and the fitted parameters of the three experiments are not encoded.
References #
Continuous semantics #
An adjective of semantic value x holds to degree x of an object in its Boolean extension
and to degree 1 − x of any other, (6).
Equations
- DegenEtAl2020.noisy x p = if p then x else 1 - x
Instances For
The gain of a redundant adjective #
In a display where the target alone has the sufficient property, one competitor shares the
redundant property with it and b distractors share neither, the redundant adjective multiplies
the literal listener's probability of the target by this factor, where xs is the semantic value
of the sufficient adjective and xr that of the redundant one.
Equations
- DegenEtAl2020.gain b xs xr = xr * (xs + (↑b + 1) * (1 - xs)) / (xr + ↑b * (1 - xs) * (1 - xr))
Instances For
With one distractor the gain is the ratio of the listener's probabilities of the target under the redundant and under the sufficient expression.
Beside a Boolean sufficient adjective the redundant one adds nothing.
Beside a sufficient adjective short of Boolean, the redundant one adds information exactly when its semantic value exceeds one half.
Beside one sufficient adjective short of Boolean, the gain grows with the semantic value of the redundant adjective.
When two adjectives trade the sufficient and the redundant role, the gain is greater on the side where the redundant adjective is the less noisy of the two.
Listener and speaker #
The literal listener (1) normalizes the meaning of an expression over the objects at a uniform prior.
Equations
- DegenEtAl2020.L0 m = ProbabilityTheory.Kernel.ofDensity (ProbabilityTheory.uniformOn Set.univ) fun (u : U) (o : E) => ENNReal.ofReal (m u o)
Instances For
The speaker of (3) and (4) at rationality α chooses an expression in proportion to the
exponential of α times its utility, the log of the listener's probability of the object less
the cost C.
Equations
- DegenEtAl2020.S1 α C m = RSA.speaker α C (⇑(DegenEtAl2020.L0 m)) MeasureTheory.Measure.dirac
Instances For
Relabelling the expressions carries the speaker along, with the cost relabelled with them.
The listener's probability of an object is the share of its degree in the row.
The odds of one expression against another for an object are the ratio of the listener's
probabilities of the object to the power α, discounted by the difference in cost.
The speaker prefers the expression of greater utility.
When two expressions alone hold of an object to a positive degree, the probability of one is the logistic function of its advantage in utility over the other, scaled by the rationality.
An expression that alone holds of an object to a positive degree is produced for it with certainty.
A description distinguishes an object under the literal listener, so that the object is the listener's best guess, exactly when it does under the meaning.
The pins of the first figure #
Equations
- DegenEtAl2020.instDecidableEqSize x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- DegenEtAl2020.instReprSize.repr DegenEtAl2020.Size.big prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DegenEtAl2020.Size.big")).group prec✝
- DegenEtAl2020.instReprSize.repr DegenEtAl2020.Size.small prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DegenEtAl2020.Size.small")).group prec✝
Instances For
Equations
- DegenEtAl2020.instReprSize = { reprPrec := DegenEtAl2020.instReprSize.repr }
The colours of the pins.
Instances For
Equations
- DegenEtAl2020.instDecidableEqColor x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- DegenEtAl2020.instReprColor = { reprPrec := DegenEtAl2020.instReprColor.repr }
Equations
- DegenEtAl2020.instReprColor.repr DegenEtAl2020.Color.blue prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DegenEtAl2020.Color.blue")).group prec✝
- DegenEtAl2020.instReprColor.repr DegenEtAl2020.Color.red prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DegenEtAl2020.Color.red")).group prec✝
Instances For
Equations
- DegenEtAl2020.instDecidableEqPin x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- DegenEtAl2020.instReprPin.repr DegenEtAl2020.Pin.bigBlue prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DegenEtAl2020.Pin.bigBlue")).group prec✝
- DegenEtAl2020.instReprPin.repr DegenEtAl2020.Pin.bigRed prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DegenEtAl2020.Pin.bigRed")).group prec✝
- DegenEtAl2020.instReprPin.repr DegenEtAl2020.Pin.smallBlue prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DegenEtAl2020.Pin.smallBlue")).group prec✝
Instances For
Equations
- DegenEtAl2020.instReprPin = { reprPrec := DegenEtAl2020.instReprPin.repr }
Equations
- DegenEtAl2020.instInhabitedPin = { default := DegenEtAl2020.instInhabitedPin.default }
Equations
- DegenEtAl2020.instFintypePin = { elems := { val := ↑DegenEtAl2020.Pin.enumList, nodup := DegenEtAl2020.Pin.enumList_nodup }, complete := DegenEtAl2020.instFintypePin._proof_1 }
Equations
The size of a pin.
Equations
Instances For
The colour of a pin.
Equations
Instances For
Equations
- DegenEtAl2020.instDecidableEqUtterance x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DegenEtAl2020.instReprUtterance = { reprPrec := DegenEtAl2020.instReprUtterance.repr }
Equations
Equations
- One or more equations did not get rendered due to their size.
Equations
The size an expression names, if any.
Equations
- DegenEtAl2020.Utterance.big.size = some DegenEtAl2020.Size.big
- DegenEtAl2020.Utterance.bigBlue.size = some DegenEtAl2020.Size.big
- DegenEtAl2020.Utterance.bigRed.size = some DegenEtAl2020.Size.big
- DegenEtAl2020.Utterance.small.size = some DegenEtAl2020.Size.small
- DegenEtAl2020.Utterance.smallBlue.size = some DegenEtAl2020.Size.small
- DegenEtAl2020.Utterance.blue.size = none
- DegenEtAl2020.Utterance.red.size = none
Instances For
The colour an expression names, if any.
Equations
- DegenEtAl2020.Utterance.blue.color = some DegenEtAl2020.Color.blue
- DegenEtAl2020.Utterance.bigBlue.color = some DegenEtAl2020.Color.blue
- DegenEtAl2020.Utterance.smallBlue.color = some DegenEtAl2020.Color.blue
- DegenEtAl2020.Utterance.red.color = some DegenEtAl2020.Color.red
- DegenEtAl2020.Utterance.bigRed.color = some DegenEtAl2020.Color.red
- DegenEtAl2020.Utterance.big.color = none
- DegenEtAl2020.Utterance.small.color = none
Instances For
The meaning of an expression is the product, over the adjectives it contains, of the degree
to which each holds of the pin, (5) and (6), with semantic value xs for size and xc for
colour.
Equations
- One or more equations did not get rendered due to their size.
Instances For
Adding the redundant colour to the sufficient size multiplies the listener's probability of the small blue pin by the gain of the display.
Adding the redundant size to the sufficient colour multiplies the listener's probability of the big red pin by the gain of the display with the two semantic values exchanged.
For the small blue pin and without cost, the redundant small blue is preferred to the sufficient small exactly when the semantic value of colour exceeds one half, whatever that of size short of Boolean.
For the big red pin and without cost, the redundant big red is preferred to the sufficient red exactly when the semantic value of size exceeds one half, whatever that of colour short of Boolean.
The odds of the redundant small blue against small for the small blue pin exceed the odds of the redundant big red against red for the big red pin exactly when size is noisier than colour, at every positive rationality and when the two redundant adjectives cost the same. This is the paper's asymmetry, more redundant use of colour than of size.
The sufficient small distinguishes the small blue pin from the big ones, so that the listener's best guess is the target, exactly when the semantic value of size beats chance.
The redundant small blue distinguishes the pin exactly when the semantic value of size beats chance and the two values together exceed one, so a noisy colour can cost the identification that the sufficient description had. With Boolean values both descriptions distinguish.
With Boolean values the redundant modifier adds nothing, since small and small blue both identify the small blue pin with certainty and are produced alike.