Documentation

Studies.AlbrightHayes2003

Albright and Hayes (2003): Rules vs. analogy in English past tenses #

[AH03] learn the English past tense as a set of stochastic rules. Every stem–past pair is a word-specific rule, and minimal generalization over two rules with the same change keeps the segments they share outward from the change site, reduces the first pair that differ to the class of their shared features, and frees whatever lies beyond ([AH02] gives the full procedure). Each rule is scored by its reliability in the lexicon, hits over scope, discounted for small scope by a lower confidence limit ([Mik97]); the most reliable rules, the islands of reliability, exist for the regular change as well as for irregular ones ([Alb02] for Italian), and a candidate past takes the score of its best rule. Two wug experiments ([Ber58]) on 58 stems that the model chose to cross islands for the regular and for an irregular past find island effects of the same size for both, which the single default rule of the dual mechanism model ([PP88], [PP93]) cannot produce; the irregular effects replicate [BM83]. A generalized context model ([Nos90], with [Bro93a]'s segment similarity) run on the same lexicon misses the regular islands, follows single similar verbs, and misplaces the regular allomorphs, because its similarity is variegated where a rule's is structured: the allomorph depends on the final segment alone.

Implementation notes #

Minimal generalization is mg on the substrate's rewrite contexts, in which a leading word boundary is the anchored word-specific rule and its absence the free variable. The paper's own steps (6) and footnote 4, the island (8), and the regular allomorphy of (7b) are computed on the English fragment's segments, whose meet is the featural term and whose natural classes in the English inventory are what a featural term covers. Reliability is Stats; the statistics reported in Tables 1 and 4 and the ratings and production probabilities of Appendix A are rows. Vowel changes, which generalize on both sides of the change, the confidence-limit discount, and the analogical model itself are not modelled.

References #

Minimal generalization #

@[reducible, inline]

The structural description of a past-tense rule: the stem-final material before the change site, read left to right, a leading word boundary anchoring it to a whole stem and its absence standing for the free variable.

Equations
Instances For

    The stem meets the description.

    Equations
    Instances For

      Generalization proceeds from the change site outward ((5)). Shared segments are kept, the first pair that differ become the class of their shared features, and everything beyond them is freed.

      Equations
      Instances For

        The minimal generalization of two descriptions.

        Equations
        Instances For

          The rule learned from a list of stems generalizes each stem's word-specific rule in turn.

          Equations
          Instances For

            A stem meets its own word-specific rule.

            A description one segment long is met by exactly the segments it subsumes.

            theorem AlbrightHayes2003.mg_comm {c₁ c₂ : Context} :
            mg c₁ c₂ = mg c₂ c₁

            Minimal generalization is symmetric.

            theorem AlbrightHayes2003.matches_mg_left {c₁ c₂ : Context} {stem : List Phonology.Segment} (h : Matches c₁ stem) :
            Matches (mg c₁ c₂) stem

            The generalized rule covers everything either rule covered, so generalization only widens.

            theorem AlbrightHayes2003.matches_mg_right {c₁ c₂ : Context} {stem : List Phonology.Segment} (h : Matches c₂ stem) :
            Matches (mg c₁ c₂) stem
            theorem AlbrightHayes2003.matches_rtake_one {c : Context} {stem : List Phonology.Segment} (h : List.length c ≤ 1) :
            Matches c stem ↔ Matches c (stem.rtake 1)

            A description one segment long reads the final segment alone, the structured similarity a rule is confined to.

            Reliability #

            def AlbrightHayes2003.scopeOf {C : Type u_1} (c : Context) (lex : List (List Phonology.Segment × C)) :
            List (List Phonology.Segment × C)

            The scope of a rule is the stems of a lexicon meeting its description.

            Equations
            Instances For

              A rule's performance in a lexicon is the forms meeting its description and, among them, those whose past shows its change.

              • scope : ℕ
              • hits : ℕ
              Instances For
                def AlbrightHayes2003.instDecidableEqStats.decEq (x✝ x✝¹ : Stats) :
                Decidable (x✝ = x✝¹)
                Equations
                Instances For
                  def AlbrightHayes2003.Stats.ofLexicon {C : Type u_1} [DecidableEq C] (ch : C) (c : Context) (lex : List (List Phonology.Segment × C)) :

                  The statistics of a change in a described context over a lexicon.

                  Equations
                  • One or more equations did not get rendered due to their size.
                  Instances For
                    theorem AlbrightHayes2003.hits_le_scope {c : Context} {C : Type u_1} [DecidableEq C] (ch : C) (lex : List (List Phonology.Segment × C)) :
                    (Stats.ofLexicon ch c lex).hits ≤ (Stats.ofLexicon ch c lex).scope
                    theorem AlbrightHayes2003.scope_mono {c₁ c₂ : Context} {C : Type u_1} [DecidableEq C] (ch : C) (lex : List (List Phonology.Segment × C)) :
                    (Stats.ofLexicon ch c₁ lex).scope ≤ (Stats.ofLexicon ch (mg c₁ c₂) lex).scope

                    Generalization never loses a form.

                    Raw confidence is hits over scope.

                    Equations
                    Instances For

                      r is less reliable than s, the ratios cross-multiplied.

                      Equations
                      Instances For
                        @[instance_reducible]
                        Equations
                        theorem AlbrightHayes2003.lessReliable_iff {r s : Stats} (hr : 0 < r.scope) (hs : 0 < s.scope) :

                        The general suffixation rule (7a) over the learning set.

                        Equations
                        Instances For

                          An island of reliability is a rule the change works better in than the general rule ((8)).

                          Equations
                          Instances For
                            @[instance_reducible]
                            Equations

                            The paper's steps on the English fragment #

                            The stems of an inventory that a description one segment long covers are the natural class of its featural term.

                            In (6), vote and need differ first in their final segments, so the learned -əd rule keeps what [t] and [d] share, and that featural term characterizes the class [t, d] uniquely.

                            As footnote 4 observes, whatever [b], [g] and [n] share, [d] has, so the -d rule learned from rub, sag and plan reaches need, and only the phonology keeps needd out.

                            The voiced segments, as a description.

                            Equations
                            Instances For

                              The voiceless segments, as a description.

                              Equations
                              Instances For

                                The rule learned from miss, wish and laugh lies inside the island (8), and further fricative-final forms widen it to the island.

                                Appendix A #

                                A cell of Table 3 records whether the stem occupies an island for the regular past and for some irregular past.

                                • iorForRegular : Bool
                                • iorForIrregular : Bool
                                Instances For
                                  def AlbrightHayes2003.instDecidableEqIORCategory.decEq (x✝ x✝¹ : IORCategory) :
                                  Decidable (x✝ = x✝¹)
                                  Equations
                                  • One or more equations did not get rendered due to their size.
                                  Instances For
                                    Equations
                                    Instances For
                                      def AlbrightHayes2003.digits (s : String) :
                                      ℕ

                                      A printed decimal is read as the integer of its digits, ratings in hundredths and production probabilities in thousandths.

                                      Equations
                                      • AlbrightHayes2003.digits s = List.foldl (fun (n : ℕ) (c : Char) => if c.isDigit = true then 10 * n + (c.toNat - '0'.toNat) else n) 0 s.toList
                                      Instances For
                                        def AlbrightHayes2003.value (key : String) (r : Datum) :
                                        ℕ

                                        A row's numeric feature.

                                        Equations
                                        Instances For

                                          A row's reported rule statistics (Tables 1 and 4).

                                          Equations
                                          Instances For
                                            theorem AlbrightHayes2003.table4_islands (r : Datum) :
                                            r ∈ Examples.all → (r.feature? "island").isSome = true → ∀ s ∈ statsOf r, IsIsland s

                                            In Table 4 the twelve regular islands all outscore the general rule.

                                            Table 1 ranks gleed's pasts by raw confidence, gleed below gled below gleeded.

                                            def AlbrightHayes2003.rows (regular : Bool) (p : IORCategory → Bool) :
                                            List Datum

                                            The Appendix A rows of one past type in the cells satisfying p (the Peripheral stems of Table A2 have no cell).

                                            Equations
                                            • One or more equations did not get rendered due to their size.
                                            Instances For
                                              def AlbrightHayes2003.total (key : String) (rs : List Datum) :
                                              ℕ

                                              The sum of a numeric feature over rows.

                                              Equations
                                              Instances For
                                                def AlbrightHayes2003.MeanGT (key : String) (A B : List Datum) :

                                                The mean of key over A exceeds its mean over B, cross-multiplied.

                                                Equations
                                                Instances For
                                                  @[instance_reducible]
                                                  instance AlbrightHayes2003.instDecidableMeanGT (key : String) (A B : List Datum) :
                                                  Decidable (MeanGT key A B)
                                                  Equations
                                                  theorem AlbrightHayes2003.regulars_ior :
                                                  MeanGT "adjustedRating" (rows true fun (x : IORCategory) => x.iorForRegular) (rows true fun (x : IORCategory) => !x.iorForRegular) ∧ MeanGT "production" (rows true fun (x : IORCategory) => x.iorForRegular) (rows true fun (x : IORCategory) => !x.iorForRegular)

                                                  Regulars show islands of reliability (Fig. 2), in that novel regular pasts are rated higher, and volunteered more often, when the stem occupies an island for the regular change.

                                                  theorem AlbrightHayes2003.irregulars_ior :
                                                  MeanGT "adjustedRating" (rows false fun (x : IORCategory) => x.iorForIrregular) (rows false fun (x : IORCategory) => !x.iorForIrregular) ∧ MeanGT "production" (rows false fun (x : IORCategory) => x.iorForIrregular) (rows false fun (x : IORCategory) => !x.iorForIrregular)

                                                  Islands of reliability for irregulars, likewise.

                                                  theorem AlbrightHayes2003.regulars_not_cell_invariant :
                                                  total "adjustedRating" (rows true fun (x : IORCategory) => decide (x = { iorForRegular := true, iorForIrregular := false })) * (rows true fun (x : IORCategory) => decide (x = { iorForRegular := false, iorForIrregular := true })).length ≠ total "adjustedRating" (rows true fun (x : IORCategory) => decide (x = { iorForRegular := false, iorForIrregular := true })) * (rows true fun (x : IORCategory) => decide (x = { iorForRegular := true, iorForIrregular := false })).length

                                                  The single-default-rule prediction, that novel regular ratings do not vary with the stem's cell, fails on the Core data: the regulars-only and irregulars-only cells differ.

                                                  theorem AlbrightHayes2003.tradeoff :
                                                  MeanGT "adjustedRating" (rows true fun (x : IORCategory) => decide (x = { iorForRegular := true, iorForIrregular := false })) (rows true fun (x : IORCategory) => decide (x = { iorForRegular := true, iorForIrregular := true })) ∧ MeanGT "adjustedRating" (rows true fun (x : IORCategory) => decide (x = { iorForRegular := false, iorForIrregular := false })) (rows true fun (x : IORCategory) => decide (x = { iorForRegular := false, iorForIrregular := true })) ∧ MeanGT "adjustedRating" (rows false fun (x : IORCategory) => decide (x = { iorForRegular := false, iorForIrregular := true })) (rows false fun (x : IORCategory) => decide (x = { iorForRegular := true, iorForIrregular := true })) ∧ MeanGT "adjustedRating" (rows false fun (x : IORCategory) => decide (x = { iorForRegular := false, iorForIrregular := false })) (rows false fun (x : IORCategory) => decide (x = { iorForRegular := true, iorForIrregular := false }))

                                                  Trade-off (Figs. 3–4): a past is rated higher when its rival is not in an island, for regulars and irregulars alike.

                                                  theorem AlbrightHayes2003.ruleBased_islands :
                                                  MeanGT "ruleBased" (rows true fun (x : IORCategory) => x.iorForRegular) (rows true fun (x : IORCategory) => !x.iorForRegular)

                                                  The rule-based model's predicted regular ratings are higher in the regular islands: the stimuli were chosen by the model.

                                                  theorem AlbrightHayes2003.analogical_misses_islands (r : Datum) :
                                                  r ∈ Examples.all → (r.feature? "island").isSome = true → value "analogical" r < value "adjustedRating" r ∧ value "analogical" r < value "ruleBased" r

                                                  In Table 4, on the twelve regular pasts in the best islands the analogical model, unable to locate structured similarity, scores below both the participants and the rule-based model.

                                                  The pseudo-burnt irregulars of (15).

                                                  Equations
                                                  Instances For
                                                    theorem AlbrightHayes2003.burnt_underestimated :
                                                    total "ruleBased" burnt < total "adjustedRating" burnt ∧ total "adjustedRating" burnt < total "analogical" burnt

                                                    The rule-based model's one systematic error: it underrates the burnt-class forms, which the analogical model overrates.

                                                    theorem AlbrightHayes2003.regulars_preferred :
                                                    MeanGT "rating" (List.filter (fun (r : Datum) => decide (r.feature? "pastType" = some "regular")) Examples.all) (List.filter (fun (r : Datum) => decide (r.feature? "pastType" = some "irregular")) Examples.all)

                                                    Participants preferred regular pasts overall.