File tree 1 file changed +36
-1
lines changed
1 file changed +36
-1
lines changed Original file line number Diff line number Diff line change @@ -174,7 +174,42 @@ python baselines/run_classifier.py \
174
174
175
175
预测结果 ` {task}_test.json ` 将生成在 ` RESULT_OUTPUT_DIR ` 目录下。
176
176
177
- ##### 提交结果(Submitting results)
177
+ #### 格式检查(Check format)
178
+
179
+ 在提交结果文件之前,可以使用` format_checker ` 来检查文件格式,避免因为格式不正确导致的无效评估。
180
+
181
+ * Step1: 将原始的测试文件(没有答案)` {taskname}_test.[json|jsonl|tsv] ` 复制到 ` format_checker ` 目录底下,并重命名为 ` {taskname}_test_raw.[json|jsonl|tsv] ` .
182
+ ```
183
+ # take the CMeEE task for example:
184
+ cp ${path_to_CMeEE}/CMeEE_test.json ${current_dir}/CMeEE_test_raw.json
185
+ ```
186
+ * Step2: 输入原始测试文件和你预测产生的文件,运行下面的格式检查脚本:
187
+ ```
188
+ python3 format_checker_${taskname}.py {taskname}_test_raw.[json|jsonl|tsv] {taskname}_test.[json|jsonl|tsv]
189
+
190
+ # take the CMeEE task for example:
191
+ python3 format_checker_CMeEE.py CMeEE_test_raw.json CMeEE_test.json
192
+ ```
193
+ 另外,下面的任务有别于上面的任务:
194
+ ** IMCS-NER & IMCS-V2-NER tasks:**
195
+ * Step1: 将原始的测试文件` IMCS-NER_test.json(IMCS-V2-NER_test.json) ` 和 ` IMCS_test.json(IMCS-V2_test.json) ` 复制到` format_checker ` 目录底下,并重命名为` IMCS-NER_test_raw.json(IMCS-V2-NER_test_raw.json) ` :
196
+ ```
197
+ # for IMCS-NER task:
198
+ cp ${path_to_IMCS-NER}/IMCS-NER_test.json ${current_dir}/IMCS-NER_test_raw.json
199
+ cp ${path_to_IMCS-NER}/IMCS_test.json ${current_dir}
200
+ # for IMCS-V2-NER task:
201
+ cp ${path_to_IMCS-V2-NER}/IMCS-V2-NER_test.json ${current_dir}/IMCS-V2-NER_test_raw.json
202
+ cp ${path_to_IMCS-V2-NER}/IMCS-V2_test.json ${current_dir}
203
+ ```
204
+ * Step2: 按下面的命令执行格式检查的脚本:
205
+ ```
206
+ # for IMCS-NER task:
207
+ python3 format_checker_IMCS_V1_NER.py IMCS-NER_test_raw.json IMCS-NER_test.json IMCS_test.json
208
+ # for IMCS-V2-NER task:
209
+ python3 format_checker_IMCS_V2_NER.py IMCS-V2-NER_test_raw.json IMCS-V2-NER_test.json IMCS-V2_test.json
210
+ ```
211
+
212
+ #### 提交结果(Submitting results)
178
213
179
214
将 ` RESULT_OUTPUT_DIR ` 目录下的结果文件打包成 ` .zip ` 文件便可提交, [ 提交结果] ( https://tianchi.aliyun.com/dataset/dataDetail?dataId=95414 )
180
215
You can’t perform that action at this time.
0 commit comments