DEADLINE
EXTENSION (SUBMISSIONS DUE JANUARY 5, 2007)
EVIA 2007:
The First International Workshop on Evaluating Information Access
(NTCIR-6
Pre-Meeting Workshop)
May 15,
2007 <at> NII, Tokyo, Japan.
Workshop
Co-Chairs:
Tetsuya
Sakai (Toshiba Corporate R&D Center, Japan) and
Mark
Sanderson (University of Sheffield, UK)
EVIA 2007
CFP Webpage:
http://research.nii.ac.jp/ntcir/ntcir-ws6/pmw-en.html
Evaluation of Information Retrieval, Question Answering and Text
Summarisation systems has been central to Information Access
research
for decades. As retrieval has become more pervasive and diverse, the
need for effective and efficient evaluation has never been more
important.
Following the success of the NTCIR Open Submission Sessions over the last
two
years, NTCIR will hold the First International Workshop on Evaluating
Information
Access (EVIA 2007), which will run the day before the main sessions
of
NTCIR start. We welcome submissions of high-quality papers from
participants and non-participants, especially those addressing one
or
more of the following topics:
- Test collections, their formation, evaluation metrics and
evaluation
environments
- Cross-conference comparison: NTCIR, CLEF, TREC, DUC and others
- Evaluation of specific information access tasks, e.g., for
education
and training
- Evaluation of query-specific approaches
- Evaluation of multilingual, multimedia and/or mobile information
access
- Real-world search topics and/or evaluation in vivo
- Novel information access tasks and their evaluation
The submitted papers will be blind-reviewed and those accepted will
be
presented orally at the Workshop on May 15, 2007. The accepted
papers
will be included in the online and printed versions of NTCIR-6
Proceedings. We expect the workshop to be more competitive than the
Open Submission Sessions held at NTCIR-4 and 5.
IMPORTANT DATES:
*January 5, 2007: Submissions due (NEW DEADLINE)*
February 15, 2007: Notifications of acceptance
March 15, 2007: Final manuscripts due
May 15, 2007 (Day 1 of the NTCIR-6 Workshop Meeting): EVIA 2007 takes
place
SUBMISSION GUIDELINES:
Please use latex8.sty and sample tex source file
(ntcir_author.tex) available at the NTCIR-5 website (not NTCIR-6)
http://research.nii.ac.jp/ntcir-ws5/proceedings.html
but for EVIA please note that the following special
instructions apply:
- NUMBER OF PAGES:
We allow up to 12 pages because some evaluation papers may
involve lots of results and analyses.
- ANONYMIZE!
To facilitate blind reviewing, do NOT include the author names in
your
manuscript, and "anonymize" your own citations to the best of
your ability.
- PAPER SUBMISSION URL:
https://www.softconf.com/starts/ntcir6-pmw/submit.html
You can also revise your submission at the above site.
The submission site can also be reached via our EVIA 2007 CFP
webpage.
Finally, please note that DUPLICATE SUBMISSIONS, if detected, will
be
rejected unconditionally. That is, submitting the same paper to EVIA
and to another conference simultaneously is strictly prohibited.
If you have any questions, please contact:
Tetsuya Sakai (tetsuya.sakai-g3qfMnKXm6lL9jVzuh4AOg@public.gmane.org) or
Mark Sanderson (m.sanderson-1V21x8GFL1deXsq7+8kxVA@public.gmane.org).
*
*
*
NTCIR is an evaluation exercise with an Asian language focus. Last
year,
NTCIR-5 attracted over 100 groups from 15 countries, the Sixth NTCIR
will be held at the National Institute of Informatics, Tokyo, Japan,
May
15-17, 2007. The meeting will bring together researchers working on
information access technologies such as Monolingual/Multilingual
Information Retrieval and Question Answering, to sum up their
one-year evaluation efforts for the NTCIR-6 tracks. A number of
NTCIR-6
participants will be given a chance to present their "site
reports"
at the regular sessions; All participants will present their results
at the poster sessions to exchange ideas and views.
____________________________________________________________________
Mark Sanderson, Room
225
Tel: +44 (0) 114 22 22648
Department of Information Studies Fax: +44
(0) 114 27 80300
University of Sheffield, Regent Court,
mailto:m.sanderson-3Ch7lUbXYW61Qrn1Bg8BZw@public.gmane.org
Portobello St, Sheffield, S1 4DP, UK
http://dis.shef.ac.uk/mark/
____________________________________________________________________
Good judgement is from experience, experience is from bad judgement