Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

criteria for good items #461

Open
maxheld83 opened this issue Sep 28, 2019 · 0 comments
Open

criteria for good items #461

maxheld83 opened this issue Sep 28, 2019 · 0 comments

Comments

@maxheld83
Copy link
Owner

  • Items should be statements on which reasonable people can disagree.
    An item that is formulated in a skewed fashion, or otherwise unlikely to illicit differential responses is a waste of participants time, because it cannot create any (co)variance.
  • Items should not be falsifiable, in the broadest sense.
    Items which depend on factual contexts, are, or will in the future become falsifiable are not great items.
    An ipsative measurement of such statements does not make much sense, and it is also not suited to capture subjectivity.
    Good items are often about axiological or ontological foundations.
  • Items should be truthful (in terms of @Habermas1988a), and should strive to meet a discourse ethics of communicative action.
    Items which merely replicate popular "discourse" -- that is, narrowly, speech distorted by power -- are not appropriate.
  • Items may be remedial.
    For some statements, it may be necessary to briefly explain concepts, which participants may be otherwise unfamiliar with.
    Participants may still sort some items as meaningless (in the relative middle of the distribution), but everyone should be able to comprehend every item.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant