Submission Guideline for NTCIR-6 CLIR Task
how to submit search results

------STAGE 2------


Sep/11/2006

[CLIR Task Home]

The method for your submitting search results at Stage 2 is almost same as at Stage 1.
Please refer to Submission guideline for Stage 1.

However, please notice the following points.

(1) Unit of files
Please make distinct 3 files (-N3, -N4, and -N5) for each runID. For example,
FILE 1: NII-J-C-T-01-N3
FILE 2: NII-J-C-T-01-N4
FILE 3: NII-J-C-T-01-N5

*Note that 'N3' in Run ID denotes NTCIR-3, 'N4' NTCIR-4 and 'N5' NTCIR-5.

*Please use runID with the corresponding identifier (-N3, -N4 or -N5) in each file. For example, in the case of 'NII-J-C-T-01-N3' file
030 0    cts_cec_19991118596    1                     4238     NII-J-C-T-01-N3
030 0    cts_cec_19991118596    2                     3211     NII-J-C-T-01-N3
...........
030 0    cts_cec_19991118596    1000                1116     NII-J-C-T-01-N3

(2) System description
In contrast, the participants do NOT have to prepare 3 distinct system descriptions for -N3, -N4 and -N5 respectively. It is enough to make a single description for each runID because the same IR techniques must be used within the same Run ID. Please drop the indentifiers, -N3, -N4 and -N5 in your system description. For example,

<TECHDESC>
<RUN>
<ID>NII-J-C-T-01</ID>
<INDEXUNIT>word</INDEXUNIT>
...
<SPTECH>searching translations of unknown terms automatically from Web pages</SPTECH>
<COMMENT>none</COMMENT>
</RUN>
<RUN>
<ID>NII-J-C-D-02</ID>
...
</RUN>
</TECHDESC>

(3)Please do not forget to make a text file (list.txt) including a list of names of all files which you created. An example of the list is as follows.

NII-J-C-T-01-N3
NII-J-C-T-01-N4
NII-J-C-T-01-N5
NII-J-C-D-02-N3
....
NII-C-J-DN-03-N5
NII.txt

*'NII.txt' is the system description file.