Bergen & Goodman (2015): The strategic use of noise in pragmatic reasoning #
This file formalizes Bergen and Goodman's two applications of rational speech acts over a noisy
channel from the speaker's intended utterances to the perceived ones: the literal listener decodes
the intended utterance before interpreting it (eq. 6), the speaker's utility is the channel-expected
log posterior of the intended meaning (eq. 7), and the pragmatic listener inverts the speaker
composed with the channel (eq. 8). The channel misperceives each utterance as at most one other, at
a rate the speaker lowers by stressing a word (slipChannel). Sentence fragments have no literal
meaning, yet both listeners read the fragment "Bob" as the point mass on Bob having gone, at every
positive deletion rate (Ellipsis.L0_subject, Ellipsis.L1_subject), because only "Bob went to the
movies" deletes to it. Stress halves the rate at which a subject is misheard as the other, so the
exponentiated utility of a subject sentence is exp (-binEntropy rate) / 2, and a speaker who knows
that only Bob went prefers "BOB went" to "Bob went" (Prosody.S1_bobWent_lt_BOB_went), the form the
paper's exhaustive row records (Prosody.model_matches_stress_rows).
Main results #
Ellipsis.L0_subject,Ellipsis.L1_subject— a subject fragment is the point mass on its source, for every positive deletion rate;Ellipsis.S1_apply— the speaker utters the full sentence.Prosody.channelMix_eq_exp_neg_binEntropy— a subject sentence's exponentiated utility isexp (-binEntropy rate) / 2.Prosody.S1_bobWent_lt_BOB_went— the knowledgeable speaker prefers the stressed form.
Implementation notes #
Priors are unit weights, the rationality parameter is 1, and costs are zero. The channel runs from
the speaker's intended utterances to the perceived ones: for ellipsis the intended utterances are
the three full sentences (the paper's simplification), for prosody all five forms. Prosody is
perceived, so the stressed and unstressed forms are two copies of the subject-confusion channel at
rates ε / 2 and ε. The prosody speaker is the paper's knowledgeable one, for whom the divergence
utility is eq. 7.
TODO #
- Fragment production (Fig. 1, right) needs utterance costs; the ignorant speaker's lower stress rate (Fig. 2, right) needs the divergence utility over observations.
- The listener's exhaustive reading of stress (Fig. 2, left) is the paper's depth-two result
over knowledge states; at depth one it reduces to the monotonicity in the rate of the
confusion odds
(r ^ (1 - r) * (1 - r) ^ r) / ((1 - r) ^ (1 - r) * r ^ r), not yet proved.
References #
The slip channel #
Under the channel of a slip rate and a slip target, an intended utterance is perceived
intact with probability 1 - rate u and as slip u with probability rate u.
Equations
- One or more equations did not get rendered due to their size.
Instances For
Rational speech acts over the channel #
The literal listener decodes before interpreting, so the meaning of a perceived utterance is the
meaning of each intended one weighted by the utterance prior and the channel (eq. 6). The
speaker's informativity is the channel-expected log listener, whose exponential is the listener
mass averaged geometrically over perceptions (channelMix), and the speaker is the power-weight
best response to that mix (noisySpeaker, eqs. 4 and 7). The pragmatic listener inverts the
speaker composed with the channel (eq. 8). At the identity channel each operator is its
noiseless counterpart.
The meaning of a perceived utterance u_p is the meaning of each intended utterance,
weighted by the utterance prior and the channel (eq. 6).
Equations
- BergenGoodman2015.noisyMeaning N ρ m u_p w = ∫⁻ (u_i : I), (N u_i) {u_p} * m u_i w ∂ρ
Instances For
Without noise the perceived utterance is the intended one, weighted by its prior.
channelMix N L u_i w averages the listener mass at w geometrically over the
perceptions of u_i; it is the exponential of the channel-expected log listener, eq. 7's
informativity.
Equations
- BergenGoodman2015.channelMix N L u_i w = ∏ u_p : U, (L u_p) {w} ^ ((N u_i) {u_p}).toReal
Instances For
The mix over the perceptions the channel can produce.
The speaker over the channel (eqs. 4 and 7) weights each utterance by the channel-mixed
listener to the power α, scaled by the cost weight exp (-(α * C u)).
Equations
- BergenGoodman2015.noisySpeaker N α C L = ProbabilityTheory.Kernel.ofWeights fun (w : W) (u : I) => BergenGoodman2015.channelMix N L u w ^ α * ENNReal.ofReal (Real.exp (-(α * C u)))
Instances For
Row preference of the speaker reduces to comparing the weighted channel-mixed listener values; the normalization cancels.
Without noise the literal listener is the noiseless one at every utterance of positive finite prior mass.
Without noise the speaker is the noiseless one.
Without noise the pragmatic listener over the channel is the noiseless one.
Ellipsis #
Three meanings and the full sentences expressing them; deletion strikes the predicate, leaving a subject fragment with no literal meaning.
Equations
- BergenGoodman2015.Ellipsis.instDecidableEqMeaning x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- One or more equations did not get rendered due to their size.
Equations
Equations
- One or more equations did not get rendered due to their size.
- BergenGoodman2015.Ellipsis.instDecidableEqUtterance.decEq (BergenGoodman2015.Ellipsis.Utterance.full m) (BergenGoodman2015.Ellipsis.Utterance.subject m_1) = isFalse ⋯
- BergenGoodman2015.Ellipsis.instDecidableEqUtterance.decEq (BergenGoodman2015.Ellipsis.Utterance.full m) BergenGoodman2015.Ellipsis.Utterance.predicate = isFalse ⋯
- BergenGoodman2015.Ellipsis.instDecidableEqUtterance.decEq (BergenGoodman2015.Ellipsis.Utterance.subject m) (BergenGoodman2015.Ellipsis.Utterance.full m_1) = isFalse ⋯
- BergenGoodman2015.Ellipsis.instDecidableEqUtterance.decEq (BergenGoodman2015.Ellipsis.Utterance.subject m) BergenGoodman2015.Ellipsis.Utterance.predicate = isFalse ⋯
- BergenGoodman2015.Ellipsis.instDecidableEqUtterance.decEq BergenGoodman2015.Ellipsis.Utterance.predicate (BergenGoodman2015.Ellipsis.Utterance.full m) = isFalse ⋯
- BergenGoodman2015.Ellipsis.instDecidableEqUtterance.decEq BergenGoodman2015.Ellipsis.Utterance.predicate (BergenGoodman2015.Ellipsis.Utterance.subject m) = isFalse ⋯
- BergenGoodman2015.Ellipsis.instDecidableEqUtterance.decEq BergenGoodman2015.Ellipsis.Utterance.predicate BergenGoodman2015.Ellipsis.Utterance.predicate = isTrue ⋯
Instances For
Equations
- One or more equations did not get rendered due to their size.
Full sentences mean what they say; fragments have no literal meaning.
Equations
Instances For
Deletion strikes the predicate of a full sentence at rate δ.
Equations
Instances For
Deleting the predicate leaves the subject.
Equations
Instances For
The deletion channel at rate δ, from the speaker's full sentences, indexed by the meaning
they express, to the perceived utterances.
Equations
- One or more equations did not get rendered due to their size.
Instances For
The speaker's full sentences are equally likely.
Equations
- BergenGoodman2015.Ellipsis.uttPrior = MeasureTheory.Measure.count
Instances For
The uniform meaning prior.
Equations
- BergenGoodman2015.Ellipsis.μ = MeasureTheory.Measure.count
Instances For
The graded literal meaning of a full sentence.
Equations
Instances For
The literal listener (eq. 6).
Equations
- One or more equations did not get rendered due to their size.
Instances For
The speaker (eq. 7), choosing among the full sentences.
Equations
Instances For
The pragmatic listener (eq. 8).
Equations
Instances For
Only the full sentence for m deletes to its subject fragment.
Only the full sentence for m survives as itself.
A subject fragment is the point mass on the meaning whose full sentence deletes to it, at every positive deletion rate.
A full sentence is interpreted literally, at every deletion rate below 1.
The full sentence for m' is heard as itself or as its subject, so its channel-mixed
listener at m is 1 when m' = m and 0 otherwise.
The speaker utters the full sentence for its meaning.
The channelled speaker reaches the subject fragment for m only from m, with the deletion
rate.
The pragmatic listener also reads a subject fragment as the point mass on its source.
Prosody #
Stress halves the rate at which a subject is misheard as the other (the paper's ε / n at
n = 2); the conjunction is never misheard. A speaker who knows that only Bob went must keep
the listener from hearing "Alice went", so stress is worth more to them.
Equations
- BergenGoodman2015.Prosody.instDecidableEqMeaning x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- One or more equations did not get rendered due to their size.
Equations
Equations
Equations
- BergenGoodman2015.Prosody.instDecidableEqUtterance x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- One or more equations did not get rendered due to their size.
Literal meanings are lower-bounded, so "Alice went" is true whenever Alice went.
Equations
- BergenGoodman2015.Prosody.lit BergenGoodman2015.Prosody.Utterance.aliceWent = {BergenGoodman2015.Prosody.Meaning.onlyAlice, BergenGoodman2015.Prosody.Meaning.both}
- BergenGoodman2015.Prosody.lit BergenGoodman2015.Prosody.Utterance.ALICE_went = {BergenGoodman2015.Prosody.Meaning.onlyAlice, BergenGoodman2015.Prosody.Meaning.both}
- BergenGoodman2015.Prosody.lit BergenGoodman2015.Prosody.Utterance.bobWent = {BergenGoodman2015.Prosody.Meaning.onlyBob, BergenGoodman2015.Prosody.Meaning.both}
- BergenGoodman2015.Prosody.lit BergenGoodman2015.Prosody.Utterance.BOB_went = {BergenGoodman2015.Prosody.Meaning.onlyBob, BergenGoodman2015.Prosody.Meaning.both}
- BergenGoodman2015.Prosody.lit BergenGoodman2015.Prosody.Utterance.aliceAndBobWent = {BergenGoodman2015.Prosody.Meaning.both}
Instances For
Subjects are confused at rate ε, halved under stress; the conjunction is safe.
Equations
- BergenGoodman2015.Prosody.rate ε BergenGoodman2015.Prosody.Utterance.aliceWent = ε
- BergenGoodman2015.Prosody.rate ε BergenGoodman2015.Prosody.Utterance.bobWent = ε
- BergenGoodman2015.Prosody.rate ε BergenGoodman2015.Prosody.Utterance.ALICE_went = ε / 2
- BergenGoodman2015.Prosody.rate ε BergenGoodman2015.Prosody.Utterance.BOB_went = ε / 2
- BergenGoodman2015.Prosody.rate ε BergenGoodman2015.Prosody.Utterance.aliceAndBobWent = 0
Instances For
A subject is misheard as the other subject, with its prosody.
Equations
- BergenGoodman2015.Prosody.slip BergenGoodman2015.Prosody.Utterance.aliceWent = BergenGoodman2015.Prosody.Utterance.bobWent
- BergenGoodman2015.Prosody.slip BergenGoodman2015.Prosody.Utterance.bobWent = BergenGoodman2015.Prosody.Utterance.aliceWent
- BergenGoodman2015.Prosody.slip BergenGoodman2015.Prosody.Utterance.ALICE_went = BergenGoodman2015.Prosody.Utterance.BOB_went
- BergenGoodman2015.Prosody.slip BergenGoodman2015.Prosody.Utterance.BOB_went = BergenGoodman2015.Prosody.Utterance.ALICE_went
- BergenGoodman2015.Prosody.slip BergenGoodman2015.Prosody.Utterance.aliceAndBobWent = BergenGoodman2015.Prosody.Utterance.aliceAndBobWent
Instances For
The subject-confusion channel at rate ε.
Equations
Instances For
The uniform utterance prior.
Equations
- BergenGoodman2015.Prosody.uttPrior = MeasureTheory.Measure.count
Instances For
The uniform meaning prior.
Equations
- BergenGoodman2015.Prosody.μ = MeasureTheory.Measure.count
Instances For
The graded literal meaning.
Equations
- BergenGoodman2015.Prosody.lit' u = (BergenGoodman2015.Prosody.lit u).indicator 1
Instances For
The literal listener (eq. 6).
Equations
- One or more equations did not get rendered due to their size.
Instances For
The knowledgeable speaker (eq. 7), over all five forms.
Equations
Instances For
By eq. 7, the exponentiated utility of a subject sentence at slip rate r for the meaning
it is true of alone is exp (-binEntropy r) / 2.
The knowledgeable speaker's channel-mixed listener for the two forms of "Bob went" is the entropy form of their rates.
A speaker who knows that only Bob went prefers "BOB went" to "Bob went", since halving the rate lowers its binary entropy (Fig. 2, right, at depth one).
uttOf reads a row's stress feature as an utterance.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A speaker with the exhaustive meaning prefers the stressed row's form to the unstressed row's, at the paper's rate.