DenicEtAl2021: experimental results (generated) #
Auto-generated from Linglib/Data/Experiments/DenicEtAl2021.json by scripts/gen_experiments.py.
Do not edit by hand: edit the JSON and re-run the generator.
Four inference-rating experiments on Amazon Mechanical Turk. A premise and a conclusion differ in a superset and a subset verb phrase (see birds, see doves) inside one of ten environments, and participants rated on a continuous bar how far the conclusion follows. The premise carried a negative polarity item, the positive polarity item some, or none. A directional rating keeps a subset to superset rating and reverses a superset to subset one (100 minus the rating). Effects are Bayesian mixed-model coefficients with 95% credible intervals and the posterior probability of the reported sign.
Raw data #
- https://github.com/milicaden/polarity-items-monotonicity-inferences: The material, data, analysis script and model output, as linked in §2.
References #
An experiment of the paper.
- exp1 : Experiment
Experiment 1: polarity items in the premise only
- exp2 : Experiment
Experiment 2: a polarity item in the premise repeated in the conclusion
- exp3 : Experiment
Experiment 3: Experiment 1 with the doubly negative environments added
- exp4 : Experiment
Experiment 4: Experiment 3 with the polarity item condition of an environment between participants
Instances For
Equations
- DenicEtAl2021.instDecidableEqExperiment x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- DenicEtAl2021.instReprExperiment = { reprPrec := DenicEtAl2021.instReprExperiment.repr }
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- One or more equations did not get rendered due to their size.
The class of an environment.
- ue : Monotonicity
UE: upward entailing
- de : Monotonicity
DE: downward entailing
- nm : Monotonicity
NM: non-monotone
- dn : Monotonicity
DN: doubly negative, a downward-entailing operator inside another
Instances For
Equations
- DenicEtAl2021.instDecidableEqMonotonicity x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- DenicEtAl2021.instReprMonotonicity = { reprPrec := DenicEtAl2021.instReprMonotonicity.repr }
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- One or more equations did not get rendered due to their size.
An environment the verb phrase of a premise and its conclusion occurs in.
- positive : Environment
positive: The purple alien saw birds.
- every : Environment
Every: Every alien saw birds.
- many : Environment
Many: Many aliens saw birds.
- negative : Environment
negative: The purple alien didn't see birds.
- no : Environment
No: No alien saw birds.
- few : Environment
Few: Few aliens saw birds.
- exactly12 : Environment
Exactly 12: Exactly 12 aliens saw birds.
- only12 : Environment
Only 12: Only 12 aliens saw birds.
- everyNot : Environment
Every-not: Every alien who did not see birds is hairy.
- noWithout : Environment
No-without: No alien spent a year without seeing birds.
Instances For
Equations
- DenicEtAl2021.instDecidableEqEnvironment x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- DenicEtAl2021.instReprEnvironment = { reprPrec := DenicEtAl2021.instReprEnvironment.repr }
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- One or more equations did not get rendered due to their size.
The order of the verb phrases of the premise and the conclusion.
- supersetToSubset : Direction
superset/subset: the superset verb phrase in the premise, the subset one in the conclusion
- subsetToSuperset : Direction
subset/superset: the subset verb phrase in the premise, the superset one in the conclusion
Instances For
Equations
- DenicEtAl2021.instDecidableEqDirection x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprDirection = { reprPrec := DenicEtAl2021.instReprDirection.repr }
Equations
- One or more equations did not get rendered due to their size.
Equations
- DenicEtAl2021.instDecidableEqPI x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- DenicEtAl2021.instReprPI.repr DenicEtAl2021.PI.npi prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DenicEtAl2021.PI.npi")).group prec✝
- DenicEtAl2021.instReprPI.repr DenicEtAl2021.PI.ppi prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DenicEtAl2021.PI.ppi")).group prec✝
- DenicEtAl2021.instReprPI.repr DenicEtAl2021.PI.noPI prec✝ = Repr.addAppParen (Std.Format.nest (if prec✝ ≥ 1024 then 1 else 2) (Std.Format.text "DenicEtAl2021.PI.noPI")).group prec✝
Instances For
Equations
- DenicEtAl2021.instReprPI = { reprPrec := DenicEtAl2021.instReprPI.repr }
Equations
- DenicEtAl2021.instFintypePI = { elems := { val := ↑DenicEtAl2021.PI.enumList, nodup := DenicEtAl2021.PI.enumList_nodup }, complete := DenicEtAl2021.instFintypePI._proof_1 }
Equations
- DenicEtAl2021.instDecidableEqRating x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- DenicEtAl2021.instReprRating = { reprPrec := DenicEtAl2021.instReprRating.repr }
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instFintypeRating = { elems := { val := ↑DenicEtAl2021.Rating.enumList, nodup := DenicEtAl2021.Rating.enumList_nodup }, complete := DenicEtAl2021.instFintypeRating._proof_1 }
Equations
- DenicEtAl2021.instDecidableEqTail x✝ y✝ = if h : x✝.ctorIdx = y✝.ctorIdx then isTrue ⋯ else isFalse ⋯
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprTail = { reprPrec := DenicEtAl2021.instReprTail.repr }
Equations
- DenicEtAl2021.instFintypeTail = { elems := { val := ↑DenicEtAl2021.Tail.enumList, nodup := DenicEtAl2021.Tail.enumList_nodup }, complete := DenicEtAl2021.instFintypeTail._proof_1 }
Superset and subset verb phrase pairs, Experiments 1 to 3. (§3.1.2, p. 3; checked against the page images.)
Equations
Instances For
Superset and subset verb phrase pairs, Experiment 4. (§7.1.2, p. 7; checked against the page images.)
Equations
Instances For
Responses faster than this many seconds were removed. (§3.2, p. 4; checked against the page images.)
Equations
- DenicEtAl2021.minResponseTime = { mantissa := 14, exponent := 1 }
Instances For
Responses slower than this many seconds were removed. (§3.2, p. 4; checked against the page images.)
Equations
- DenicEtAl2021.maxResponseTime = { mantissa := 10, exponent := 0 }
Instances For
A row of §3.1.2 and (14)–(21), pp. 3–4; (23)–(24), p. 6: the class of each environment.
- monotonicity : Monotonicity
Its class.
Instances For
Equations
- DenicEtAl2021.instDecidableEqEnvironmentRow.decEq { monotonicity := a } { monotonicity := b } = if h : a = b then h ▸ isTrue ⋯ else isFalse ⋯
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
The cells of §3.1.2 and (14)–(21), pp. 3–4; (23)–(24), p. 6, by environment; checked against the page images.
Equations
- DenicEtAl2021.environments DenicEtAl2021.Environment.positive = { monotonicity := DenicEtAl2021.Monotonicity.ue }
- DenicEtAl2021.environments DenicEtAl2021.Environment.every = { monotonicity := DenicEtAl2021.Monotonicity.ue }
- DenicEtAl2021.environments DenicEtAl2021.Environment.many = { monotonicity := DenicEtAl2021.Monotonicity.ue }
- DenicEtAl2021.environments DenicEtAl2021.Environment.negative = { monotonicity := DenicEtAl2021.Monotonicity.de }
- DenicEtAl2021.environments DenicEtAl2021.Environment.no = { monotonicity := DenicEtAl2021.Monotonicity.de }
- DenicEtAl2021.environments DenicEtAl2021.Environment.few = { monotonicity := DenicEtAl2021.Monotonicity.de }
- DenicEtAl2021.environments DenicEtAl2021.Environment.exactly12 = { monotonicity := DenicEtAl2021.Monotonicity.nm }
- DenicEtAl2021.environments DenicEtAl2021.Environment.only12 = { monotonicity := DenicEtAl2021.Monotonicity.nm }
- DenicEtAl2021.environments DenicEtAl2021.Environment.everyNot = { monotonicity := DenicEtAl2021.Monotonicity.dn }
- DenicEtAl2021.environments DenicEtAl2021.Environment.noWithout = { monotonicity := DenicEtAl2021.Monotonicity.dn }
Instances For
A row of §3.1.3, p. 4; §4.1.3, p. 5; §6.1.3, pp. 6–7; §7.1.3, p. 7: the participants of an experiment, recruited on Amazon Mechanical Turk.
- recruited : ℕ
Recruited.
- female : ℕ
Recruited and female.
- nonNative : ℕ
Excluded as not native speakers of English.
- monotonicityCheck : ℕ
Further excluded for not rating the upward and downward inferences higher in the upward and downward entailing environments respectively.
- kept : ℕ
Kept for the analysis.
- keptFemale : ℕ
Kept and female.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprParticipants = { reprPrec := DenicEtAl2021.instReprParticipants.repr }
The cells of §3.1.3, p. 4; §4.1.3, p. 5; §6.1.3, pp. 6–7; §7.1.3, p. 7, by experiment; checked against the page images.
Equations
- DenicEtAl2021.participants DenicEtAl2021.Experiment.exp1 = { recruited := 75, female := 38, nonNative := 1, monotonicityCheck := 8, kept := 66, keptFemale := 32 }
- DenicEtAl2021.participants DenicEtAl2021.Experiment.exp2 = { recruited := 72, female := 35, nonNative := 1, monotonicityCheck := 7, kept := 64, keptFemale := 28 }
- DenicEtAl2021.participants DenicEtAl2021.Experiment.exp3 = { recruited := 112, female := 69, nonNative := 7, monotonicityCheck := 13, kept := 92, keptFemale := 53 }
- DenicEtAl2021.participants DenicEtAl2021.Experiment.exp4 = { recruited := 81, female := 43, nonNative := 4, monotonicityCheck := 6, kept := 71, keptFemale := 36 }
Instances For
A row of §3.2, p. 4; §4.2, p. 5; §6.2, p. 7; §7.2, p. 7: the responses removed for their response time, in percent of the data.
- fast : Data.Experiments.Decimal
Faster than the minimum response time.
- slow : Data.Experiments.Decimal
Slower than the maximum response time.
Instances For
Equations
- DenicEtAl2021.instDecidableEqResponseExclusion.decEq { fast := a, slow := a_1 } { fast := b, slow := b_1 } = if h : a = b then h ▸ if h : a_1 = b_1 then h ▸ isTrue ⋯ else isFalse ⋯ else isFalse ⋯
Instances For
Equations
Equations
- One or more equations did not get rendered due to their size.
Instances For
The cells of §3.2, p. 4; §4.2, p. 5; §6.2, p. 7; §7.2, p. 7, by experiment; checked against the page images.
Equations
- DenicEtAl2021.responseExclusions DenicEtAl2021.Experiment.exp1 = { fast := { mantissa := 1, exponent := 0 }, slow := { mantissa := 9, exponent := 0 } }
- DenicEtAl2021.responseExclusions DenicEtAl2021.Experiment.exp2 = { fast := { mantissa := 6, exponent := 0 }, slow := { mantissa := 7, exponent := 0 } }
- DenicEtAl2021.responseExclusions DenicEtAl2021.Experiment.exp3 = { fast := { mantissa := 4, exponent := 0 }, slow := { mantissa := 13, exponent := 0 } }
- DenicEtAl2021.responseExclusions DenicEtAl2021.Experiment.exp4 = { fast := { mantissa := 8, exponent := 0 }, slow := { mantissa := 10, exponent := 0 } }
Instances For
A row of §3.2, p. 4; §4.2, p. 5; §6.2, p. 7; §7.2, p. 7: the mean ratings of the three training items (11)–(13), in percent.
- valid : Data.Experiments.Decimal
The clearly valid inference (11).
- invalid : Data.Experiments.Decimal
The clearly invalid inference (12).
- intermediate : Data.Experiments.Decimal
The intermediate inference (13).
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprTraining = { reprPrec := DenicEtAl2021.instReprTraining.repr }
Equations
- One or more equations did not get rendered due to their size.
Instances For
The cells of §3.2, p. 4; §4.2, p. 5; §6.2, p. 7; §7.2, p. 7, by experiment; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A row of §3.2, p. 4: the mean ratings of Experiment 1 by environment class, whatever the polarity item, in percent.
- monotonicity : Monotonicity
The class.
- rating : Rating
The rated direction.
- mean : Data.Experiments.Decimal
The mean.
The standard deviation.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprClassRating = { reprPrec := DenicEtAl2021.instReprClassRating.repr }
Equations
- One or more equations did not get rendered due to their size.
Instances For
The 6 rows of §3.2, p. 4, in the paper's order; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A row of §3.2, p. 4; §4.2, p. 6; §6.2, p. 7; §7.2, p. 8: the mean directional ratings by polarity item condition, in percent.
- experiment : Experiment
The experiment.
- monotonicity : Monotonicity
The class.
- pi : PI
The polarity item condition.
- mean : Data.Experiments.Decimal
The mean.
The standard deviation.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
Equations
- One or more equations did not get rendered due to their size.
Instances For
The 18 rows of §3.2, p. 4; §4.2, p. 6; §6.2, p. 7; §7.2, p. 8, in the paper's order; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A row of §3.4, p. 5; §4.3, p. 6; §6.3, p. 7; §7.3, p. 8; §8.1, p. 8: the effect of a polarity item against none on the directional ratings of a class, by experiment and in the meta- analysis over all four.
- experiment : Option Experiment
The experiment, none for the meta-analysis.
- monotonicity : Monotonicity
The class.
- pi : PI
The polarity item.
- estimate : Data.Experiments.Decimal
The posterior estimate E(μ).
- ciLow : Data.Experiments.Decimal
The lower end of the 95% credible interval.
- ciHigh : Data.Experiments.Decimal
The upper end of the 95% credible interval.
- tail : Tail
The side of zero whose posterior probability is reported.
- posterior : Data.Experiments.Decimal
That posterior probability.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprPIEffect = { reprPrec := DenicEtAl2021.instReprPIEffect.repr }
Equations
- One or more equations did not get rendered due to their size.
Instances For
The 16 rows of §3.4, p. 5; §4.3, p. 6; §6.3, p. 7; §7.3, p. 8; §8.1, p. 8, in the paper's order; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A row of Table 1, p. 9: the effect of a polarity item against none on one rating of a class, pooled over the four experiments, in Table 1.
- monotonicity : Monotonicity
The class.
- pi : PI
The polarity item.
- rating : Rating
The rating.
- meanPI : Data.Experiments.Decimal
The mean rating with the item, in percent.
- sdPI : Data.Experiments.Decimal
Its standard deviation.
- meanNoPI : Data.Experiments.Decimal
The mean rating without a polarity item, in percent.
- sdNoPI : Data.Experiments.Decimal
Its standard deviation.
- estimate : Data.Experiments.Decimal
The posterior estimate E(μ).
- ciLow : Data.Experiments.Decimal
The lower end of the 95% credible interval.
- ciHigh : Data.Experiments.Decimal
The upper end of the 95% credible interval.
- tail : Tail
The side of zero whose posterior probability is reported.
- posterior : Data.Experiments.Decimal
That posterior probability.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprRatingEffect = { reprPrec := DenicEtAl2021.instReprRatingEffect.repr }
The 8 rows of Table 1, p. 9, in the paper's order; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A row of §8.3, p. 9: the difference between two classes in the effect of a polarity item on directional ratings, the first class against the second.
- pi : PI
The polarity item.
- first : Monotonicity
The class whose effect is compared.
- second : Monotonicity
The class it is compared with.
- estimate : Data.Experiments.Decimal
The posterior estimate E(μ).
- ciLow : Data.Experiments.Decimal
The lower end of the 95% credible interval.
- ciHigh : Data.Experiments.Decimal
The upper end of the 95% credible interval.
- tail : Tail
The side of zero whose posterior probability is reported.
- posterior : Data.Experiments.Decimal
That posterior probability.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprInteraction = { reprPrec := DenicEtAl2021.instReprInteraction.repr }
The 6 rows of §8.3, p. 9, in the paper's order; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A row of Appendix A, Table A1, p. 13: the mean ratings of each class over the four experiments, whatever the polarity item, in percent, Table A1.
- meanDE : Data.Experiments.Decimal
The mean DE-rating.
- sdDE : Data.Experiments.Decimal
Its standard deviation.
- meanUE : Data.Experiments.Decimal
The mean UE-rating.
- sdUE : Data.Experiments.Decimal
Its standard deviation.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprClassMean = { reprPrec := DenicEtAl2021.instReprClassMean.repr }
Equations
- One or more equations did not get rendered due to their size.
Instances For
The cells of Appendix A, Table A1, p. 13, by monotonicity; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A row of Appendix A, p. 13: the difference in one rating between two classes, the first against the second, pooled over the four experiments.
- rating : Rating
The rating.
- first : Monotonicity
The class rated lower by the estimate's sign.
- second : Monotonicity
The class it is compared with.
- estimate : Data.Experiments.Decimal
The posterior estimate E(μ).
- ciLow : Data.Experiments.Decimal
The lower end of the 95% credible interval.
- ciHigh : Data.Experiments.Decimal
The upper end of the 95% credible interval.
- tail : Tail
The side of zero whose posterior probability is reported.
- posterior : Data.Experiments.Decimal
That posterior probability.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- DenicEtAl2021.instReprClassContrast = { reprPrec := DenicEtAl2021.instReprClassContrast.repr }
The 6 rows of Appendix A, p. 13, in the paper's order; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A row of Appendix B, p. 13: the difference between the two environments of a class in the effect of a polarity item on directional ratings, pooled over the four experiments.
- pi : PI
The polarity item.
- first : Environment
The environment whose effect is compared.
- second : Environment
The environment it is compared with.
- estimate : Data.Experiments.Decimal
The posterior estimate E(μ).
- ciLow : Data.Experiments.Decimal
The lower end of the 95% credible interval.
- ciHigh : Data.Experiments.Decimal
The upper end of the 95% credible interval.
- tail : Tail
The side of zero whose posterior probability is reported.
- posterior : Data.Experiments.Decimal
That posterior probability.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
The 4 rows of Appendix B, p. 13, in the paper's order; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.
Instances For
A row of Appendix B, p. 14: the effect of a polarity item against none on the directional ratings of one environment, pooled over the four experiments.
- pi : PI
The polarity item.
- environment : Environment
The environment.
- estimate : Data.Experiments.Decimal
The posterior estimate E(μ).
- ciLow : Data.Experiments.Decimal
The lower end of the 95% credible interval.
- ciHigh : Data.Experiments.Decimal
The upper end of the 95% credible interval.
- tail : Tail
The side of zero whose posterior probability is reported.
- posterior : Data.Experiments.Decimal
That posterior probability.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
- One or more equations did not get rendered due to their size.
Instances For
Equations
The 4 rows of Appendix B, p. 14, in the paper's order; checked against the page images.
Equations
- One or more equations did not get rendered due to their size.