Documentation

Linglib.Data.Experiments.DenicEtAl2021

DenicEtAl2021: experimental results (generated) #

Auto-generated from Linglib/Data/Experiments/DenicEtAl2021.json by scripts/gen_experiments.py. Do not edit by hand: edit the JSON and re-run the generator.

Four inference-rating experiments on Amazon Mechanical Turk. A premise and a conclusion differ in a superset and a subset verb phrase (see birds, see doves) inside one of ten environments, and participants rated on a continuous bar how far the conclusion follows. The premise carried a negative polarity item, the positive polarity item some, or none. A directional rating keeps a subset to superset rating and reverses a superset to subset one (100 minus the rating). Effects are Bayesian mixed-model coefficients with 95% credible intervals and the posterior probability of the reported sign.

Raw data #

References #

An experiment of the paper.

  • exp1 : Experiment

    Experiment 1: polarity items in the premise only

  • exp2 : Experiment

    Experiment 2: a polarity item in the premise repeated in the conclusion

  • exp3 : Experiment

    Experiment 3: Experiment 1 with the doubly negative environments added

  • exp4 : Experiment

    Experiment 4: Experiment 3 with the polarity item condition of an environment between participants

Instances For
    @[instance_reducible]
    Equations
    Equations
    • One or more equations did not get rendered due to their size.
    Instances For
      @[instance_reducible]
      Equations
      • One or more equations did not get rendered due to their size.

      The class of an environment.

      Instances For
        @[instance_reducible]
        Equations
        Equations
        • One or more equations did not get rendered due to their size.
        Instances For
          @[instance_reducible]
          Equations
          • One or more equations did not get rendered due to their size.

          An environment the verb phrase of a premise and its conclusion occurs in.

          • positive : Environment

            positive: The purple alien saw birds.

          • every : Environment

            Every: Every alien saw birds.

          • many : Environment

            Many: Many aliens saw birds.

          • negative : Environment

            negative: The purple alien didn't see birds.

          • no : Environment

            No: No alien saw birds.

          • few : Environment

            Few: Few aliens saw birds.

          • exactly12 : Environment

            Exactly 12: Exactly 12 aliens saw birds.

          • only12 : Environment

            Only 12: Only 12 aliens saw birds.

          • everyNot : Environment

            Every-not: Every alien who did not see birds is hairy.

          • noWithout : Environment

            No-without: No alien spent a year without seeing birds.

          Instances For
            @[instance_reducible]
            Equations
            Equations
            • One or more equations did not get rendered due to their size.
            Instances For
              @[instance_reducible]
              Equations
              • One or more equations did not get rendered due to their size.

              The order of the verb phrases of the premise and the conclusion.

              • supersetToSubset : Direction

                superset/subset: the superset verb phrase in the premise, the subset one in the conclusion

              • subsetToSuperset : Direction

                subset/superset: the subset verb phrase in the premise, the superset one in the conclusion

              Instances For
                @[instance_reducible]
                Equations
                Equations
                • One or more equations did not get rendered due to their size.
                Instances For
                  @[instance_reducible]
                  Equations
                  • One or more equations did not get rendered due to their size.

                  The polarity item condition of a premise.

                  • npi : PI

                    NPI: a negative polarity item, any or at all

                  • ppi : PI

                    PPI: the positive polarity item some

                  • noPI : PI

                    no PI: no polarity item

                  Instances For
                    @[instance_reducible]
                    instance DenicEtAl2021.instDecidableEqPI :
                    DecidableEq PI
                    Equations
                    def DenicEtAl2021.instReprPI.repr :
                    PI → ℕ → Std.Format
                    Equations
                    Instances For
                      @[instance_reducible]
                      Equations
                      @[instance_reducible]
                      Equations

                      A rating of one inference direction.

                      • ueRating : Rating

                        UE-rating: the rating of a subset to superset inference

                      • deRating : Rating

                        DE-rating: the rating of a superset to subset inference

                      Instances For
                        @[instance_reducible]
                        Equations
                        def DenicEtAl2021.instReprRating.repr :
                        Rating → ℕ → Std.Format
                        Equations
                        • One or more equations did not get rendered due to their size.
                        Instances For

                          The side of zero whose posterior probability is reported.

                          • belowZero : Tail

                            P(β < 0): the probability that the coefficient is negative

                          • aboveZero : Tail

                            P(β > 0): the probability that the coefficient is positive

                          Instances For
                            @[instance_reducible]
                            Equations
                            def DenicEtAl2021.instReprTail.repr :
                            Tail → ℕ → Std.Format
                            Equations
                            • One or more equations did not get rendered due to their size.
                            Instances For
                              @[instance_reducible]
                              Equations

                              Superset and subset verb phrase pairs, Experiments 1 to 3. (§3.1.2, p. 3; checked against the page images.)

                              Equations
                              Instances For

                                Superset and subset verb phrase pairs, Experiment 4. (§7.1.2, p. 7; checked against the page images.)

                                Equations
                                Instances For

                                  Responses faster than this many seconds were removed. (§3.2, p. 4; checked against the page images.)

                                  Equations
                                  Instances For

                                    Responses slower than this many seconds were removed. (§3.2, p. 4; checked against the page images.)

                                    Equations
                                    Instances For

                                      A row of §3.1.2 and (14)–(21), pp. 3–4; (23)–(24), p. 6: the class of each environment.

                                      Instances For
                                        def DenicEtAl2021.instDecidableEqEnvironmentRow.decEq (x✝ x✝¹ : EnvironmentRow) :
                                        Decidable (x✝ = x✝¹)
                                        Equations
                                        Instances For
                                          Equations
                                          • One or more equations did not get rendered due to their size.
                                          Instances For

                                            A row of §3.1.3, p. 4; §4.1.3, p. 5; §6.1.3, pp. 6–7; §7.1.3, p. 7: the participants of an experiment, recruited on Amazon Mechanical Turk.

                                            • recruited : ℕ

                                              Recruited.

                                            • female : ℕ

                                              Recruited and female.

                                            • nonNative : ℕ

                                              Excluded as not native speakers of English.

                                            • monotonicityCheck : ℕ

                                              Further excluded for not rating the upward and downward inferences higher in the upward and downward entailing environments respectively.

                                            • kept : ℕ

                                              Kept for the analysis.

                                            • keptFemale : ℕ

                                              Kept and female.

                                            Instances For
                                              def DenicEtAl2021.instDecidableEqParticipants.decEq (x✝ x✝¹ : Participants) :
                                              Decidable (x✝ = x✝¹)
                                              Equations
                                              • One or more equations did not get rendered due to their size.
                                              Instances For
                                                Equations
                                                • One or more equations did not get rendered due to their size.
                                                Instances For

                                                  The cells of §3.1.3, p. 4; §4.1.3, p. 5; §6.1.3, pp. 6–7; §7.1.3, p. 7, by experiment; checked against the page images.

                                                  Equations
                                                  Instances For

                                                    A row of §3.2, p. 4; §4.2, p. 5; §6.2, p. 7; §7.2, p. 7: the responses removed for their response time, in percent of the data.

                                                    Instances For
                                                      def DenicEtAl2021.instDecidableEqResponseExclusion.decEq (x✝ x✝¹ : ResponseExclusion) :
                                                      Decidable (x✝ = x✝¹)
                                                      Equations
                                                      Instances For
                                                        Equations
                                                        • One or more equations did not get rendered due to their size.
                                                        Instances For

                                                          The cells of §3.2, p. 4; §4.2, p. 5; §6.2, p. 7; §7.2, p. 7, by experiment; checked against the page images.

                                                          Equations
                                                          Instances For

                                                            A row of §3.2, p. 4; §4.2, p. 5; §6.2, p. 7; §7.2, p. 7: the mean ratings of the three training items (11)–(13), in percent.

                                                            Instances For
                                                              def DenicEtAl2021.instDecidableEqTraining.decEq (x✝ x✝¹ : Training) :
                                                              Decidable (x✝ = x✝¹)
                                                              Equations
                                                              • One or more equations did not get rendered due to their size.
                                                              Instances For
                                                                def DenicEtAl2021.instReprTraining.repr :
                                                                Training → ℕ → Std.Format
                                                                Equations
                                                                • One or more equations did not get rendered due to their size.
                                                                Instances For

                                                                  The cells of §3.2, p. 4; §4.2, p. 5; §6.2, p. 7; §7.2, p. 7, by experiment; checked against the page images.

                                                                  Equations
                                                                  • One or more equations did not get rendered due to their size.
                                                                  Instances For

                                                                    A row of §3.2, p. 4: the mean ratings of Experiment 1 by environment class, whatever the polarity item, in percent.

                                                                    Instances For
                                                                      def DenicEtAl2021.instDecidableEqClassRating.decEq (x✝ x✝¹ : ClassRating) :
                                                                      Decidable (x✝ = x✝¹)
                                                                      Equations
                                                                      • One or more equations did not get rendered due to their size.
                                                                      Instances For
                                                                        Equations
                                                                        • One or more equations did not get rendered due to their size.
                                                                        Instances For

                                                                          The 6 rows of §3.2, p. 4, in the paper's order; checked against the page images.

                                                                          Equations
                                                                          • One or more equations did not get rendered due to their size.
                                                                          Instances For

                                                                            A row of §3.2, p. 4; §4.2, p. 6; §6.2, p. 7; §7.2, p. 8: the mean directional ratings by polarity item condition, in percent.

                                                                            Instances For
                                                                              def DenicEtAl2021.instDecidableEqDirectionalMean.decEq (x✝ x✝¹ : DirectionalMean) :
                                                                              Decidable (x✝ = x✝¹)
                                                                              Equations
                                                                              • One or more equations did not get rendered due to their size.
                                                                              Instances For
                                                                                Equations
                                                                                • One or more equations did not get rendered due to their size.
                                                                                Instances For

                                                                                  The 18 rows of §3.2, p. 4; §4.2, p. 6; §6.2, p. 7; §7.2, p. 8, in the paper's order; checked against the page images.

                                                                                  Equations
                                                                                  • One or more equations did not get rendered due to their size.
                                                                                  Instances For

                                                                                    A row of §3.4, p. 5; §4.3, p. 6; §6.3, p. 7; §7.3, p. 8; §8.1, p. 8: the effect of a polarity item against none on the directional ratings of a class, by experiment and in the meta- analysis over all four.

                                                                                    Instances For
                                                                                      def DenicEtAl2021.instDecidableEqPIEffect.decEq (x✝ x✝¹ : PIEffect) :
                                                                                      Decidable (x✝ = x✝¹)
                                                                                      Equations
                                                                                      • One or more equations did not get rendered due to their size.
                                                                                      Instances For
                                                                                        def DenicEtAl2021.instReprPIEffect.repr :
                                                                                        PIEffect → ℕ → Std.Format
                                                                                        Equations
                                                                                        • One or more equations did not get rendered due to their size.
                                                                                        Instances For

                                                                                          The 16 rows of §3.4, p. 5; §4.3, p. 6; §6.3, p. 7; §7.3, p. 8; §8.1, p. 8, in the paper's order; checked against the page images.

                                                                                          Equations
                                                                                          • One or more equations did not get rendered due to their size.
                                                                                          Instances For

                                                                                            A row of Table 1, p. 9: the effect of a polarity item against none on one rating of a class, pooled over the four experiments, in Table 1.

                                                                                            Instances For
                                                                                              def DenicEtAl2021.instDecidableEqRatingEffect.decEq (x✝ x✝¹ : RatingEffect) :
                                                                                              Decidable (x✝ = x✝¹)
                                                                                              Equations
                                                                                              • One or more equations did not get rendered due to their size.
                                                                                              Instances For
                                                                                                Equations
                                                                                                • One or more equations did not get rendered due to their size.
                                                                                                Instances For

                                                                                                  The 8 rows of Table 1, p. 9, in the paper's order; checked against the page images.

                                                                                                  Equations
                                                                                                  • One or more equations did not get rendered due to their size.
                                                                                                  Instances For

                                                                                                    A row of §8.3, p. 9: the difference between two classes in the effect of a polarity item on directional ratings, the first class against the second.

                                                                                                    Instances For
                                                                                                      def DenicEtAl2021.instDecidableEqInteraction.decEq (x✝ x✝¹ : Interaction) :
                                                                                                      Decidable (x✝ = x✝¹)
                                                                                                      Equations
                                                                                                      • One or more equations did not get rendered due to their size.
                                                                                                      Instances For
                                                                                                        Equations
                                                                                                        • One or more equations did not get rendered due to their size.
                                                                                                        Instances For

                                                                                                          The 6 rows of §8.3, p. 9, in the paper's order; checked against the page images.

                                                                                                          Equations
                                                                                                          • One or more equations did not get rendered due to their size.
                                                                                                          Instances For

                                                                                                            A row of Appendix A, Table A1, p. 13: the mean ratings of each class over the four experiments, whatever the polarity item, in percent, Table A1.

                                                                                                            Instances For
                                                                                                              def DenicEtAl2021.instDecidableEqClassMean.decEq (x✝ x✝¹ : ClassMean) :
                                                                                                              Decidable (x✝ = x✝¹)
                                                                                                              Equations
                                                                                                              • One or more equations did not get rendered due to their size.
                                                                                                              Instances For
                                                                                                                Equations
                                                                                                                • One or more equations did not get rendered due to their size.
                                                                                                                Instances For

                                                                                                                  The cells of Appendix A, Table A1, p. 13, by monotonicity; checked against the page images.

                                                                                                                  Equations
                                                                                                                  • One or more equations did not get rendered due to their size.
                                                                                                                  Instances For

                                                                                                                    A row of Appendix A, p. 13: the difference in one rating between two classes, the first against the second, pooled over the four experiments.

                                                                                                                    Instances For
                                                                                                                      def DenicEtAl2021.instDecidableEqClassContrast.decEq (x✝ x✝¹ : ClassContrast) :
                                                                                                                      Decidable (x✝ = x✝¹)
                                                                                                                      Equations
                                                                                                                      • One or more equations did not get rendered due to their size.
                                                                                                                      Instances For
                                                                                                                        Equations
                                                                                                                        • One or more equations did not get rendered due to their size.
                                                                                                                        Instances For

                                                                                                                          The 6 rows of Appendix A, p. 13, in the paper's order; checked against the page images.

                                                                                                                          Equations
                                                                                                                          • One or more equations did not get rendered due to their size.
                                                                                                                          Instances For

                                                                                                                            A row of Appendix B, p. 13: the difference between the two environments of a class in the effect of a polarity item on directional ratings, pooled over the four experiments.

                                                                                                                            Instances For
                                                                                                                              Equations
                                                                                                                              • One or more equations did not get rendered due to their size.
                                                                                                                              Instances For
                                                                                                                                Equations
                                                                                                                                • One or more equations did not get rendered due to their size.
                                                                                                                                Instances For

                                                                                                                                  The 4 rows of Appendix B, p. 13, in the paper's order; checked against the page images.

                                                                                                                                  Equations
                                                                                                                                  • One or more equations did not get rendered due to their size.
                                                                                                                                  Instances For

                                                                                                                                    A row of Appendix B, p. 14: the effect of a polarity item against none on the directional ratings of one environment, pooled over the four experiments.

                                                                                                                                    Instances For
                                                                                                                                      def DenicEtAl2021.instDecidableEqInstanceEffect.decEq (x✝ x✝¹ : InstanceEffect) :
                                                                                                                                      Decidable (x✝ = x✝¹)
                                                                                                                                      Equations
                                                                                                                                      • One or more equations did not get rendered due to their size.
                                                                                                                                      Instances For
                                                                                                                                        Equations
                                                                                                                                        • One or more equations did not get rendered due to their size.
                                                                                                                                        Instances For

                                                                                                                                          The 4 rows of Appendix B, p. 14, in the paper's order; checked against the page images.

                                                                                                                                          Equations
                                                                                                                                          • One or more equations did not get rendered due to their size.
                                                                                                                                          Instances For