Albright and Hayes (2003): Rules vs. analogy in English past tenses #
[AH03] learn the English past tense as a set of stochastic rules. Every stem–past pair is a word-specific rule, and minimal generalization over two rules with the same change keeps the segments they share outward from the change site, reduces the first pair that differ to the class of their shared features, and frees whatever lies beyond ([AH02] gives the full procedure). Each rule is scored by its reliability in the lexicon, hits over scope, discounted for small scope by a lower confidence limit ([Mik97]); the most reliable rules, the islands of reliability, exist for the regular change as well as for irregular ones ([Alb02] for Italian), and a candidate past takes the score of its best rule. Two wug experiments ([Ber58]) on 58 stems that the model chose to cross islands for the regular and for an irregular past find island effects of the same size for both, which the single default rule of the dual mechanism model ([PP88], [PP93]) cannot produce; the irregular effects replicate [BM83]. A generalized context model ([Nos90], with [Bro93a]'s segment similarity) run on the same lexicon misses the regular islands, follows single similar verbs, and misplaces the regular allomorphs, because its similarity is variegated where a rule's is structured: the allomorph depends on the final segment alone.
Implementation notes #
Minimal generalization is mg on the substrate's rewrite contexts, in which a leading word
boundary is the anchored word-specific rule and its absence the free variable. The paper's own
steps (6) and footnote 4, the island (8), and the regular allomorphy of (7b) are computed on
the English fragment's segments, whose meet is the featural term and whose natural classes
in the English inventory are what a featural term covers. Reliability is Stats; the
statistics reported in Tables 1 and 4 and the ratings and production probabilities of Appendix
A are rows. Vowel changes, which generalize on both sides of the change, the confidence-limit
discount, and the analogical model itself are not modelled.
References #
Equations
- One or more equations did not get rendered due to their size.
- AlbrightHayes2003.instDecidableEqContextElem_studies.decEq (Subregular.LocalRewrite.ContextElem.seg a) Subregular.LocalRewrite.ContextElem.wordBoundary = isFalse ⋯
- AlbrightHayes2003.instDecidableEqContextElem_studies.decEq Subregular.LocalRewrite.ContextElem.wordBoundary (Subregular.LocalRewrite.ContextElem.seg a) = isFalse ⋯
- AlbrightHayes2003.instDecidableEqContextElem_studies.decEq Subregular.LocalRewrite.ContextElem.wordBoundary Subregular.LocalRewrite.ContextElem.wordBoundary = isTrue ⋯
Instances For
Minimal generalization #
The structural description of a past-tense rule: the stem-final material before the change site, read left to right, a leading word boundary anchoring it to a whole stem and its absence standing for the free variable.
Equations
Instances For
The word-specific rule of a stem ((3)).
Equations
Instances For
The stem meets the description.
Equations
- AlbrightHayes2003.Matches c stem = (Subregular.LocalRewrite.matchLeftContext c stem = true)
Instances For
Equations
Generalization proceeds from the change site outward ((5)). Shared segments are kept, the first pair that differ become the class of their shared features, and everything beyond them is freed.
Equations
- One or more equations did not get rendered due to their size.
- AlbrightHayes2003.mgRev x✝¹ x✝ = []
Instances For
The minimal generalization of two descriptions.
Equations
- AlbrightHayes2003.mg c₁ c₂ = (AlbrightHayes2003.mgRev (List.reverse c₁) (List.reverse c₂)).reverse
Instances For
The rule learned from a list of stems generalizes each stem's word-specific rule in turn.
Equations
- One or more equations did not get rendered due to their size.
- AlbrightHayes2003.learned [] = []
Instances For
A stem meets its own word-specific rule.
A description one segment long is met by exactly the segments it subsumes.
Minimal generalization is symmetric.
The generalized rule covers everything either rule covered, so generalization only widens.
A description one segment long reads the final segment alone, the structured similarity a rule is confined to.
Reliability #
The scope of a rule is the stems of a lexicon meeting its description.
Equations
- AlbrightHayes2003.scopeOf c lex = List.filter (fun (x : List Phonology.Segment × C) => Subregular.LocalRewrite.matchLeftContext c x.1) lex
Instances For
A rule's performance in a lexicon is the forms meeting its description and, among them, those whose past shows its change.
- scope : ℕ
- hits : ℕ
Instances For
Equations
- AlbrightHayes2003.instDecidableEqStats.decEq { scope := a, hits := a_1 } { scope := b, hits := b_1 } = if h : a = b then h ▸ if h : a_1 = b_1 then h ▸ isTrue ⋯ else isFalse ⋯ else isFalse ⋯
Instances For
The statistics of a change in a described context over a lexicon.
Equations
- One or more equations did not get rendered due to their size.
Instances For
Generalization never loses a form.
r is less reliable than s, the ratios cross-multiplied.
Equations
- AlbrightHayes2003.LessReliable r s = (r.hits * s.scope < s.hits * r.scope)
Instances For
Equations
- AlbrightHayes2003.instDecidableLessReliable r s = { decide := (r.hits * s.scope).succ.ble (s.hits * r.scope), reflects_decide := ⋯ }
The general suffixation rule (7a) over the learning set.
Equations
- AlbrightHayes2003.general = { scope := 4253, hits := 4034 }
Instances For
An island of reliability is a rule the change works better in than the general rule ((8)).
Instances For
Equations
- AlbrightHayes2003.instDecidableIsIsland s = { decide := (AlbrightHayes2003.general.hits * s.scope).succ.ble (s.hits * AlbrightHayes2003.general.scope), reflects_decide := ⋯ }
The paper's steps on the English fragment #
Instances For
Instances For
Equations
Instances For
Instances For
Equations
Instances For
Equations
Instances For
Instances For
Equations
Instances For
Equations
Instances For
Equations
Instances For
Instances For
Equations
Instances For
Equations
Instances For
The stems of an inventory that a description one segment long covers are the natural class of its featural term.
In (6), vote and need differ first in their final segments, so the learned -əd rule
keeps what [t] and [d] share, and that featural term characterizes the class [t, d]
uniquely.
As footnote 4 observes, whatever [b], [g] and [n] share, [d] has, so the -d rule learned
from rub, sag and plan reaches need, and only the phonology keeps needd out.
The voiced segments, as a description.
Equations
Instances For
The voiceless segments, as a description.
Equations
Instances For
In (7b) the -d rule generalizes to [+voice] as the stems come to span the voiced segments.
From rub, sag, plan, love and flow, whose final segments are all non-lateral, it
reaches every voiced segment but /l/, and a stem in /l/ completes it.
In (7b) the -t rule does likewise. From jump, miss and laugh, whose final segments
are all non-dorsal, it reaches every voiceless segment but /k/, and a stem in /k/ completes
it.
The island (8) is -t after a voiceless fricative.
Equations
- AlbrightHayes2003.voicelessFricative = Phonology.Segment.ofSpecs [(Phonology.Feature.sonorant, false), (Phonology.Feature.continuant, true), (Phonology.Feature.voice, false)]
Instances For
(8) is met by the four voiceless fricatives and nothing else.
The rule learned from miss, wish and laugh lies inside the island (8), and further fricative-final forms widen it to the island.
Appendix A #
A cell of Table 3 records whether the stem occupies an island for the regular past and for some irregular past.
- iorForRegular : Bool
- iorForIrregular : Bool
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- AlbrightHayes2003.IORCategory.ofString "both" = some { iorForRegular := true, iorForIrregular := true }
- AlbrightHayes2003.IORCategory.ofString "regOnly" = some { iorForRegular := true, iorForIrregular := false }
- AlbrightHayes2003.IORCategory.ofString "irregOnly" = some { iorForRegular := false, iorForIrregular := true }
- AlbrightHayes2003.IORCategory.ofString "neither" = some { iorForRegular := false, iorForIrregular := false }
- AlbrightHayes2003.IORCategory.ofString x✝ = none
Instances For
A printed decimal is read as the integer of its digits, ratings in hundredths and production probabilities in thousandths.
Equations
- AlbrightHayes2003.digits s = List.foldl (fun (n : ℕ) (c : Char) => if c.isDigit = true then 10 * n + (c.toNat - '0'.toNat) else n) 0 s.toList
Instances For
A row's numeric feature.
Equations
- AlbrightHayes2003.value key r = AlbrightHayes2003.digits ((r.feature? key).getD "0")
Instances For
A row's reported rule statistics (Tables 1 and 4).
Equations
- AlbrightHayes2003.statsOf r = (r.nat? "ruleScope").bind fun (s : ℕ) => Option.map (fun (x : ℕ) => { scope := s, hits := x }) (r.nat? "ruleHits")
Instances For
In Table 4 the twelve regular islands all outscore the general rule.
Table 1 ranks gleed's pasts by raw confidence, gleed below gled below gleeded.
The Appendix A rows of one past type in the cells satisfying p (the Peripheral stems of
Table A2 have no cell).
Equations
- One or more equations did not get rendered due to their size.
Instances For
The sum of a numeric feature over rows.
Equations
- AlbrightHayes2003.total key rs = (List.map (AlbrightHayes2003.value key) rs).sum
Instances For
The mean of key over A exceeds its mean over B, cross-multiplied.
Equations
- AlbrightHayes2003.MeanGT key A B = (AlbrightHayes2003.total key A * B.length > AlbrightHayes2003.total key B * A.length)
Instances For
Equations
- AlbrightHayes2003.instDecidableMeanGT key A B = { decide := (AlbrightHayes2003.total key B * A.length).succ.ble (AlbrightHayes2003.total key A * B.length), reflects_decide := ⋯ }
Regulars show islands of reliability (Fig. 2), in that novel regular pasts are rated higher, and volunteered more often, when the stem occupies an island for the regular change.
Islands of reliability for irregulars, likewise.
The single-default-rule prediction, that novel regular ratings do not vary with the stem's cell, fails on the Core data: the regulars-only and irregulars-only cells differ.
Trade-off (Figs. 3–4): a past is rated higher when its rival is not in an island, for regulars and irregulars alike.
The rule-based model's predicted regular ratings are higher in the regular islands: the stimuli were chosen by the model.
In Table 4, on the twelve regular pasts in the best islands the analogical model, unable to locate structured similarity, scores below both the participants and the rule-based model.
The pseudo-burnt irregulars of (15).
Equations
- AlbrightHayes2003.burnt = List.filter (fun (x : Datum) => decide (x.feature? "set" = some "burnt")) AlbrightHayes2003.Examples.all
Instances For
Participants preferred regular pasts overall.