Docs / Studies / Studies.JingBlasiBickel2022

Dependency-length minimization and its limits: A possible role for a probabilistic version of the final-over-final condition

Jing, Y., Blasi, D. E. & Bickel, B. (2022). Language, 98(3), 397–418

A two-dependency catena is a dependency with a dependency of its dependent (hierarchical) or two of one head (parallel), harmonic when both point one way. The paper scores a sentence by the chance that a baseline relinearization has longer catenae. Mirroring keeps harmony and the score and exchanges head-final with head-initial pairs, so a law invariant under it, such as one weighting length alone, gives the score one law at k head-final and at k head-initial pairs. A score falling with head-finality needs a cause that sees direction, such as a penalty on final over initial.

Implementation notes

  • A sentence is a linearization σ of a tree g, the graph g.map σ: catenae and their head–dependent pairs are read off g, directions and lengths off σ. Only dependencies between verbs, nouns, adjectives and adverbs are measured, at distances counting every word; on catenae covering every arc the length is the total dependency length (length_eq_totalLength).
  • dlm is the probability that the paper estimates from 100 baseline samples, for any baseline law; fig2a is one sample.
  • The paper's tentative principle is modelled one catena at a time (disprefer): the final-over-initial configuration of a catena is downweighted by ε < 1 in a mirror-invariant law. Like the paper, the model drops both restrictions of Biberauer, Holmberg and Roberts, that the two heads lie in one extended projection and share their value of ±V.
  • The symmetry argument is the one Roberts makes against harmony as the source of the condition, in his chapter of the book of Sheehan, Biberauer, Roberts and Holmberg, whose chapter by Sheehan weighs the parsing accounts of the condition.

Errata

  • Fig. 2b, the free-word-order baseline, attaches into and certain to article, so it is not the dependency-preserving linearization of Figure 1 that §2.3 describes; with the heads of Figure 1 its order puts into after parts, reversing a dependency the baseline keeps.
  • The reference list credits "Harmony, symmetry, and dominance in word order universals" to Biberauer, Holmberg, Roberts and Sheehan; the chapter is Roberts's alone.

TODO

  • The paper's three baselines as laws on projective linearizations, which needs the supplementary materials on function words and the order of siblings. dlm_mirror and measure_dlm_headFinal hold for every baseline.
  • A law downweighting every final-over-initial catena of a sentence does not reduce to the model of one catena, since the other catenae break the symmetry measure_swap_directions gives.
  • Behaghel's law against nested ordering: the second is mirror-symmetric and the first is not.

References

Declarations

Two-dependency catenae, §2.2

Harmony, head-finality, length and the DLM score

L195–198

Figures 1 and 2a, §§2.1–2.4

L272

In Figure 1 the two hierarchical catenae, one of them harmonic, have three pairs of summed length 7, one of them head-final, and the two parallel catenae, neither harmonic, have four pairs of summed length 8, two of them head-final.

theorem table2Table 2L288–298
:
((hierarchical (lexical fig1)).card, (harmonic (Equiv.refl (Fin 9)) (hierarchical (lexical fig1))).card, (pairs (hierarchical (lexical fig1))).card, length (Equiv.refl (Fin 9)) (hierarchical (lexical fig1)), (headFinalPairs (Equiv.refl (Fin 9)) (hierarchical (lexical fig1))).card) = (2, 1, 3, 7, 1) ∧ ((parallel (lexical fig1)).card, (harmonic (Equiv.refl (Fin 9)) (parallel (lexical fig1))).card, (pairs (parallel (lexical fig1))).card, length (Equiv.refl (Fin 9)) (parallel (lexical fig1)), (headFinalPairs (Equiv.refl (Fin 9)) (parallel (lexical fig1))).card) = (2, 0, 4, 8, 2)

Built from , , , , , , ,

The four orders of a chain, (6)

The harmonic orders of the chain have length 2 and the disharmonic ones length 3; (6d), the mirror image of (6c), has its length, and is final over initial where (6c) is initial over final.

theorem ex6(6)L320–333

Built from , ,

Mirror-invariant laws

Under a law of linearizations invariant under mirroring, the DLM score has one distribution at k head-final pairs and at k head-initial pairs, so no such law makes the score fall with head-finality. Every law weighting dependency length alone is one (map_mirror_eq_self).

theorem measure_dlm_headFinalL377–388
{L : Type u_1} {n : ℕ} {g : DependencyGrammar.Graph L n} {μ ν : MeasureTheory.Measure (WordOrder.Arrangement (Fin n) n)} {C : Finset ((Fin n × Fin n) × Fin n × Fin n)} (hμ : MeasureTheory.Measure.map WordOrder.Arrangement.mirror μ = μ) (hg : g.IsForest) (hC : C ⊆ g.arcs ×ˢ g.arcs) (S : Set ENNReal) (k : ℕ) :
μ {σ : WordOrder.Arrangement (Fin n) n | dlm σ C ν ∈ S ∧ (headFinalPairs σ C).card = k} = μ {σ : WordOrder.Arrangement (Fin n) n | dlm σ C ν ∈ S ∧ (headInitialPairs σ C).card = k}

Built from , ,

p. 412: under a law of linearizations invariant under mirroring, reversing the directions of two dependencies preserves the probability of every event about their directions. Every law weighting dependency length alone is one (map_mirror_eq_self).

theorem measure_swap_directionsL390–401
{n : ℕ} {μ : MeasureTheory.Measure (WordOrder.Arrangement (Fin n) n)} {x : (Fin n × Fin n) × Fin n × Fin n} (hμ : MeasureTheory.Measure.map WordOrder.Arrangement.mirror μ = μ) (h₁ : x.1.1 ≠ x.1.2) (h₂ : x.2.1 ≠ x.2.2) (S : Set (HeadDirection × HeadDirection)) :
μ {σ : WordOrder.Arrangement (Fin n) n | Prod.map HeadDirection.swap HeadDirection.swap (directions σ x) ∈ S} = μ {σ : WordOrder.Arrangement (Fin n) n | directions σ x ∈ S}

Built from

L421–426
L429–434

Table 4, Fig. 6: let disprefer ν x ε downweight by ε < 1 the final-over-initial configuration of two dependencies under a mirror-invariant law ν. Under ν the lower dependency is as likely to be harmonic with the upper one when head-final as when head-initial; under disprefer ν x ε the head-final probability is unchanged and the head-initial one is greater. Every conditioning set has positive probability.

theorem cond_harmonicL451–522
{n : ℕ} {ν : MeasureTheory.Measure (WordOrder.Arrangement (Fin n) n)} {x : (Fin n × Fin n) × Fin n × Fin n} {ε : ENNReal} [MeasureTheory.IsFiniteMeasure ν] (hν : MeasureTheory.Measure.map WordOrder.Arrangement.mirror ν = ν) (h₁ : x.1.1 ≠ x.1.2) (h₂ : x.2.1 ≠ x.2.2) (hε : ε < 1) (hII : ν {σ : WordOrder.Arrangement (Fin n) n | directions σ x = (HeadDirection.headInitial, HeadDirection.headInitial)} ≠ 0) (hFI : ν {σ : WordOrder.Arrangement (Fin n) n | directions σ x = (HeadDirection.headFinal, HeadDirection.headInitial)} ≠ 0) :
(∀ (d : HeadDirection), ν {σ : WordOrder.Arrangement (Fin n) n | (directions σ x).2 = d} ≠ 0 ∧ (disprefer ν x ε) {σ : WordOrder.Arrangement (Fin n) n | (directions σ x).2 = d} ≠ 0) ∧ ν[{σ : WordOrder.Arrangement (Fin n) n | IsHarmonic σ x} | {σ : WordOrder.Arrangement (Fin n) n | (directions σ x).2 = HeadDirection.headFinal}] = ν[{σ : WordOrder.Arrangement (Fin n) n | IsHarmonic σ x} | {σ : WordOrder.Arrangement (Fin n) n | (directions σ x).2 = HeadDirection.headInitial}] ∧ (disprefer ν x ε)[{σ : WordOrder.Arrangement (Fin n) n | IsHarmonic σ x} | {σ : WordOrder.Arrangement (Fin n) n | (directions σ x).2 = HeadDirection.headFinal}] = ν[{σ : WordOrder.Arrangement (Fin n) n | IsHarmonic σ x} | {σ : WordOrder.Arrangement (Fin n) n | (directions σ x).2 = HeadDirection.headFinal}] ∧ (disprefer ν x ε)[{σ : WordOrder.Arrangement (Fin n) n | IsHarmonic σ x} | {σ : WordOrder.Arrangement (Fin n) n | (directions σ x).2 = HeadDirection.headFinal}] < (disprefer ν x ε)[{σ : WordOrder.Arrangement (Fin n) n | IsHarmonic σ x} | {σ : WordOrder.Arrangement (Fin n) n | (directions σ x).2 = HeadDirection.headInitial}]

Built from , ,

The chain of (6) under the uniform law

Nested ordering, §2.2

L590–613