|
73 | 73 | You will be assessing coherence, which measures the ability to provide a coherent response based on the user prompt.
|
74 | 74 |
|
75 | 75 | ## Criteria
|
76 |
| -Coherence: A clear and coherent presentation of ideas. The writing should demonstrate |
77 |
| -a logical flow, where ideas progress smoothly with clear transitions, and maintain |
78 |
| -relevance to the main point. Effective organization is essential, with a clear structure, |
79 |
| -signaling, and topic sentences to guide the reader. Additionally, the writing should |
80 |
| -exhibit strong cohesion, using word choices, sentence structures, pronouns, and |
81 |
| -figurative language to reinforce connections between ideas and create a unified piece. |
| 76 | +Coherence: A clear and coherent presentation of ideas. The writing should demonstrate a logical flow, where ideas progress smoothly with clear transitions, and maintain relevance to the main point. Effective organization is essential, with a clear structure, signaling, and topic sentences to guide the reader. Additionally, the writing should exhibit strong cohesion, using word choices, sentence structures, pronouns, and figurative language to reinforce connections between ideas and create a unified piece. |
82 | 77 |
|
83 | 78 | ## Rating Rubric
|
84 | 79 | `A`: Response A is better than Response B based on all the criteria provided.
|
|
508 | 503 | ## Criteria
|
509 | 504 | Coherence: The response presents ideas in a logical and organized manner, with clear transitions and a consistent focus, making it easy to follow and understand.
|
510 | 505 | Fluency: The text flows smoothly and naturally, adhering to grammatical rules and using appropriate vocabulary.
|
511 |
| -Instruction following: The response demonstrates a clear understanding of the summarization task instructions, satisfying all of the instruction's requirements. |
| 506 | +Instruction following: The response demonstrates a clear understanding of the task instructions, satisfying all of the instruction's requirements. |
512 | 507 | Groundedness: The response contains information included only in the context. The response does not reference any outside information.
|
513 | 508 | Verbosity: The response is appropriately concise, providing sufficient detail without using complex language to thoroughly address the prompt without being overly wordy or excessively brief.
|
514 | 509 |
|
|
590 | 585 | ## Criteria
|
591 | 586 | Coherence: The response presents ideas in a logical and organized manner, with clear transitions and a consistent focus, making it easy to follow and understand.
|
592 | 587 | Fluency: The text flows smoothly and naturally, adhering to grammatical rules and using appropriate vocabulary.
|
593 |
| -Instruction following: The response demonstrates a clear understanding of the summarization task instructions, satisfying all of the instruction's requirements. |
| 588 | +Instruction following: The response demonstrates a clear understanding of the task instructions, satisfying all of the instruction's requirements. |
594 | 589 | Groundedness: The response contains information included only in the context. The response does not reference any outside information.
|
595 | 590 | Verbosity: The response is appropriately concise, providing sufficient detail without using complex language to thoroughly address the prompt without being overly wordy or excessively brief.
|
596 | 591 | Collaborativity: The response actively contributes to the conversation by asking relevant follow-up questions, making suggestions, or offering insights when appropriate.
|
|
636 | 631 | ## Criteria
|
637 | 632 | Coherence: The response presents ideas in a logical and organized manner, with clear transitions and a consistent focus, making it easy to follow and understand.
|
638 | 633 | Fluency: The text flows smoothly and naturally, adhering to grammatical rules and using appropriate vocabulary.
|
639 |
| -Instruction following: The response demonstrates a clear understanding of the summarization task instructions, satisfying all of the instruction's requirements. |
| 634 | +Instruction following: The response demonstrates a clear understanding of the task instructions, satisfying all of the instruction's requirements. |
640 | 635 | Groundedness: The response contains information included only in the context. The response does not reference any outside information.
|
641 | 636 | Verbosity: The response is appropriately concise, providing sufficient detail without using complex language to thoroughly address the prompt without being overly wordy or excessively brief.
|
642 | 637 | Collaborativity: The response actively contributes to the conversation by asking relevant follow-up questions, making suggestions, or offering insights when appropriate.
|
|
788 | 783 |
|
789 | 784 | # User Inputs and AI-generated Response
|
790 | 785 | ## User Inputs
|
791 |
| -### Context |
792 |
| -{context} |
793 | 786 |
|
794 | 787 | ### Prompt
|
795 | 788 | {prompt}
|
|
831 | 824 |
|
832 | 825 | # User Inputs and AI-generated Responses
|
833 | 826 | ## User Inputs
|
834 |
| -### Context |
835 |
| -{context} |
836 | 827 |
|
837 | 828 | ### Prompt
|
838 | 829 | {prompt}
|
|
0 commit comments