タスク参加募集 NTCIR-10 1CLICK-2 [参加登録受付中]

[Makoto Kato <kato [at] dl.kuis.kyoto-u.ac.jp>]

日本データベース学会の皆様，
（重複して受け取られた場合にはご容赦ください）

京都大学の加藤と申します．
モバイル検索などにおいて，
検索ボタンを押した直後にユーザを満足させるタスクのご案内です．

下記のURLより参加登録できますので奮ってご参加ください．
http://ntcir.nii.ac.jp/NTCIR10Regist/


###################################################
          CALL FOR TASK PARTICIPATION
            NTCIR-10 1CLICK-2 Task:
   One Click Access for English and Japanese

*NEW: NTCIR-10 task registration site is now open*
http://ntcir.nii.ac.jp/NTCIR10Regist/

Please visit the 1CLICK-2 website:
http://research.microsoft.com/en-us/people/tesakai/1click2.aspx

Test queries released: Aug 31, 2012
Evaluation results released: Feb 28, 2013
Final NTCIR-10 workshop: June 18-21 2013
###################################################


### OVERVIEW ###

Unlike traditional search engines
that return a ranked list of web pages,
One Click Access systems
return a short multi-document summary of webpages
and aim to satisfy the user immediately after
a click on the SEARCH button.
Systems must aim to return important pieces of information and
to minimise the amount of text the user has to read.
These requirements are particularly important in mobile environments.

1CLICK-1 at NTCIR-9 only considered a Japanese task,
but for this second round (1CLICK-2),
we are expanding our scope to English.
Moreover, while 1CLICK-1 considered only four query
types (CELEBRITY, LOCAL, DEFINITION and QA),
1CLICK-2 will use a more fine-grained taxonomy
comprising eight query types.

Evaluation will be based on
"information units" (iUnits),
also often referred to as "nuggets".
As in 1CLICK-1, we will use S-measure from
Sakai/Kato/Song CIKM'11
http://research.microsoft.com/en-us/people/tesakai/cikmfp0040-sakai.pdf
and will also consider developing new evaluation methods based on
Pavlu et al. WSDM'12
http://dx.doi.org/10.1145/2124295.2124343


### TASKS ###

Japanese Main Task

Given a Japanese query, return an X-character string
that contain important information (X=500,140).
This is basically the same as the 1CLICK-1 task.

English Main Task

Similar to the Japanese Main Task except that
query and the output are in English.

Query Classification Subtask (for Japanese and English)

Given a query, classify it into one of the eight known query types.


In addition to queries, the organisers will provide
query suggestion data and baseline web search results
to enhance repeatability and fairness, and to
encourage newcomers to participate.

### IMPORTANT DATES ###

Aug 31, 2012 		test queries released
Oct 31, 2012  		run submissions due
Nov 2012-Jan 2013 	nugget match evaluation
Feb 01, 2013      	very early draft overview released
Feb 28, 2013		evaluation results released
Mar 01, 2013		draft participant papers due
May 01, 2013		all camera ready papers due
Jun 18-21, 2013  	NTCIR-10


### HOW TO PARTICIPATE ###

Task registration page
http://ntcir.nii.ac.jp/NTCIR10Regist/

We encourage new participants to have a look at the 1CLICK-1 overview paper
to familiarise themselves with the task:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/NTCIR/01-NTCIR9-OV-1CLICK-SakaiT.pdf

Please note:
task participants must write a paper for the NTCIR-10 meeting (unrefereed)
and attend the meeting at NII, Tokyo in June 2013.


### ORGANISERS ###

Makoto Kato, Kyoto University, Japan
Takehiro Yamamoto, Kyoto University, Japan
Mayu Iwata, Osaka University, Japan
Matthew Ekstrand-Abueg, Northeastern University, USA
Shahzad Rajput, Northeastern University, USA
Virgil Pavlu, Northeastern University, USA
Zhicheng Dou, MSRA, China
Tetsuya Sakai, MSRA, China


## QUESTIONS? PLEASE CONTACT ##

ntcadm-1click at
nii dot ac dot jp


## LINKS ##

1CLICK-2 homepage:
http://research.microsoft.com/en-us/people/tesakai/1click2.aspx

1CLICK-1 homepage:
http://research.microsoft.com/en-us/people/tesakai/1click.aspx

NTCIR-10:
http://research.nii.ac.jp/ntcir/ntcir-10/index.html

NTCIR online proceedings:
http://research.nii.ac.jp/ntcir/publication1-en.html