Skip to content

Commit

Permalink
Merge branch 'main' into tfk/config
Browse files Browse the repository at this point in the history
  • Loading branch information
@tefkah
tefkah authored Feb 20, 2024
2 parents 106dc03 + 1f0ff42 commit e9659c4
Show file tree
Hide file tree
Showing 4 changed files with 97 additions and 175 deletions.
68 changes: 35 additions & 33 deletions integrations/evaluations/app/actions/respond/respond.tsx
View file
Original file line number Diff line number Diff line change
Expand Up @@ -104,39 +104,41 @@ const EvaluationProcess = () => {
</a>{" "}
and take credit.
</p>
<p>We ask evaluators to:</p>
<ol>
<li>
Write a review: a 'standard high-quality referee report,' with some{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#specific-requests-for-focus-or-feedback"
>
specific considerations
</a>
.
</li>
<li>
Give{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#metrics-overall-assessment-categories"
>
quantitative metrics and predictions
</a>
.
</li>
<li>
Answer a{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#survey-questions"
>
short questionnaire
</a>{" "}
about your background and our processes.
</li>
</ol>
<p>
We ask evaluators to:
<ol>
<li>
Write a review: a 'standard high-quality referee report,' with some{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#specific-requests-for-focus-or-feedback"
>
specific considerations
</a>
.
</li>
<li>
Give{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#metrics-overall-assessment-categories"
>
quantitative metrics and predictions
</a>
.
</li>
<li>
Answer a{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#survey-questions"
>
short questionnaire
</a>{" "}
about your background and our processes.
</li>
</ol>
</p>
<p>
You can read the full guidelines{" "}
<a
Expand Down
92 changes: 35 additions & 57 deletions integrations/evaluations/lib/components/Process.tsx
View file
Original file line number Diff line number Diff line change
Expand Up @@ -8,15 +8,43 @@ export const Process = (props: Props) => {
return (
<>
<p>
We strongly encourage evaluators to complete evaluations relatively quickly, for the
benefit of authors, research-users, and the evaluation ecosystem. If you submit the
evaluation within that window (by{" "}
{new Date(props.deadline.getTime() - 21 * (1000 * 60 * 60 * 24)).toLocaleDateString()} ),
you will receive a $100 “prompt evaluation bonus.” After{" "}
{props.deadline.toLocaleDateString()}, we will consider re-assigning the evaluation, and
later submissions may not be eligible for the full baseline compensation.
Deadline for promptness bonus:{" "}
{new Date(
props.deadline.getTime() - 21 * (1000 * 60 * 60 * 24)
).toLocaleDateString()}
</p>
<p>Final deadline: {props.deadline.toLocaleDateString()}</p>
<h2>About our evaluation process</h2>
<p>
We ask evaluators to:
<ol>
<li>
Write an evaluation; essentially a high-quality referee report. Consider{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators/conventional-guidelines-for-referee-reports"
>
standard guidelines
</a>{" "}
as well as The Unjournal’s emphases. Write a review: a “standard
high-quality referee report,” with some specific considerations. Please try
to address any specific considerations mentioned in our bespoke evaluation
notes, or any specific requests from the evaluation manager.
</li>
<li>Give quantitative metrics and predictions.</li>
<li>Answer a short questionnaire about your background and our processes.</li>
</ol>
</p>
<p>
We suggest that you read and consult our the full evaluation guidelines{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#publishing-and-signing-reviews-considerations-exceptions"
>
here
</a>{" "}
(or download the pdf, with all boxes unfolded).
</p>
<p>
As a sign that we{" "}
<a
Expand All @@ -39,56 +67,6 @@ export const Process = (props: Props) => {
</a>{" "}
and take credit.
</p>
<p>We ask evaluators to:</p>
<ol>
<li>
Write a review: a 'standard high-quality referee report,' with some{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#specific-requests-for-focus-or-feedback"
>
specific considerations
</a>
.
</li>
<li>
Give{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#metrics-overall-assessment-categories"
>
quantitative metrics and predictions
</a>
.
</li>
<li>
Answer a{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#survey-questions"
>
short questionnaire
</a>{" "}
about your background and our processes.
</li>
</ol>
<p>
You can read the full guidelines{" "}
<a
target="_blank"
href="https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#publishing-and-signing-reviews-considerations-exceptions"
>
here
</a>{" "}
(or{" "}
<a
target="_blank"
href="https://www.dropbox.com/s/jzxz11gmkrh8lbn/evaluations_as_pdf.pdf?dl=0"
>
download the pdf
</a>
).
</p>
</>
);
};
45 changes: 27 additions & 18 deletions integrations/evaluations/lib/components/Research.tsx
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
import { Card, CardContent } from "ui";

export type Props = {
title: string;
abstract: string;
Expand All @@ -9,7 +11,10 @@ export const Research = (props: Props) => {
return (
<>
{props.evaluating ? (
<h2>To evaluate</h2>
<>
<h2>The Unjournal: Evaluation Form</h2>
<h3>You have been asked to evaluate the following research:</h3>
</>
) : (
<>
<h2>About the research</h2>
Expand All @@ -18,23 +23,27 @@ export const Research = (props: Props) => {
</p>
</>
)}
<h3>{props.title}</h3>
{props.abstract ? (
<p>
<strong>Abstract:</strong> {props.abstract}
</p>
) : (
<p>
<em>No abstract provided.</em>
</p>
)}
{props.url && (
<p>
<a target="_blank" href={props.url}>
Link to research
</a>
</p>
)}
<Card>
<CardContent>
<h3>{props.title}</h3>
{props.abstract ? (
<p>
<strong>Abstract:</strong> {props.abstract}
</p>
) : (
<p>
<em>No abstract provided.</em>
</p>
)}
{props.url && (
<p>
<a target="_blank" href={props.url}>
View or download the original.
</a>
</p>
)}
</CardContent>
</Card>
</>
);
};
67 changes: 0 additions & 67 deletions pnpm-lock.yaml
View file

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

0 comments on commit e9659c4

Please sign in to comment.