Mihai Lupu | 2 Mar 2010 14:51

Call for Participation - CLEF-IP 2010

> [Apologies if you get multiple copies]
> [Please help distribute]
> ==========================
> 
>            Evaluating Information Retrieval Techniques
>               in the Intellectual Property Domain.
>              CLEF-IP 2010 - Call for Participation
> 
> 
> After an interesting and rewarding first year, the Intellectual
> Property evaluation campaign (CLEF-IP) continues in 2010 as
> a benchmarking activity of the forthcoming "Conference on
> Multilingual and Multimodal Information Access Evaluation",
> CLEF 2010. The main goals of the CLEF-IP campaign are
> to create a large test collection of multi-lingual European
> patents and to evaluate retrieval techniques in the patent domain.
> 
> This year, CLEF-IP puts to use a collection of almost 2 million
> patent documents in XML format with text in English, German, and
> French.  The track contains two tasks:
>    - Prior Art Candidate Search: find patent documents that are
>    likely to constitute prior art to a given patent application
>    - Classification: classify a given patent document according
>    to the IPC and/or ECLA classification schemes
> 
> Participants are invited to apply their favourite retrieval method
> and/or classifier on given sets of topics and submit their results.
> Relevance assessment will be done using patent citations for
> the first task and current patent classifications for the second task.
> 
(Continue reading)

Craig Macdonald | 10 Mar 2010 19:54
Picon
Picon
Favicon

Terrier 3.0 Release announcement

Terrier, IR Platform v 3.0 - 10/03/2010
http://terrier.org/

Terrier 3.0, the next version of the open source IR platform from the
University of Glasgow (Scotland) has been released.

This is a major update to Terrier 3.0, including:
     - support for indexing WARC collections (such as ClueWeb09);
     - improved MapReduce mode indexing
     - improved and more scalable index structures
     - added field-based and proximity term dependence models, such as 
BM25F, PL2F and Markov Random Fields
     - new Web-based retrieval interface

Fuller change log at http://terrier.org/docs/current/whats_new.html

Leif Azzopardi | 16 Mar 2010 11:48
Picon
Picon
Favicon

IIiX 2010: Call for Papers

Dear Colleagues,

Just a reminder about that the IIiX 2010 deadline for papers and posters is April the 11th, and that we are looking for excellent submissions that fit the themes of the conference.  This year we have three main themes: Systems, Interaction and Behavior. 

Consequently we are looking for submissions which embody one of more of these themes and in particular provides interesting discussion about how one aspect influences or impacts upon another. For example, I'm the system's area chair and I would really like to see papers about systems, that go beyond reporting precision and recall, and relate how the IR system changes or affects the behavior of users and their interaction with system. 

I'm really looking forward to this year's IIiX (http://www.iiix2010.org) and I hope you can contribute to its success with some exciting and engaging submissions.

Best wishes
Leif Azzopardi
IIiX Area Chair 

  

Information Interaction in Context 2010
http://www.iiix2010.org/

The Information Interaction in Context conference (IIiX) explores the relationships between and within the contexts that affect information retrieval and information seeking, how these contexts impact information behavior, and how knowledge of information contexts and behaviors improves the design of interactive information systems.

The intention of IIiX is to foster an integrated approach to information access by bringing together members of the research communities in information seeking behavior (Behavior Track), interactive information retrieval (Interaction Track), and information retrieval system design (System Track).  A list of topics of interest can be found at the conference website.

Submissions are sought that integrate two or more of these perspectives.  While it is understood that one area might be the dominant theme of the submission, the expectation is that authors will provide an explicit discussion of how their submission informs at least one other area.  For example, a submission that primarily discusses system aspects should provide mention of how the system impacts interaction or behavior.  A paper that primarily discusses information behavior should discuss implications for interaction or system design.  Papers that investigate multiple themes directly are especially welcome.

PAPERS & POSTERS

IIiX encourages the submission of original, high quality research papers that have not been published previously and are not under review for another conference or journal. All submissions will be reviewed by an international program committee. Full papers, describing completed research results, should be no more than 10 pages in length.

Provocative and interesting poster submissions, describing planned, in-progress, and late-breaking results are also sought. The aim of the poster session is to encourage debate, discussion, and future collaboration. As well as being reviewed according to typical measures of originality and technical merit, submissions will also be reviewed for their suitability for an exciting and engaging poster session.

Poster papers should be no more than 4 pages in length.  In addition, authors of accepted posters are expected to include a 1 page image of their posters (in PDF) as part of their final submissions which will be included alongside the paper in the ACM Digital Library.  

Papers and posters are due April 11, 2010.

DOCTORAL CONSORTIUM

A Doctoral Consortium held in conjunction with the main conference provides an opportunity for doctoral students to present and discuss their research with senior researchers and other doctoral students in a seminar format. The Doctoral Consortium focuses on 1) advising students regarding current critical issues in their research, and 2) making students aware of the strengths and weaknesses of their research as viewed from different perspectives.

Submissions should include a short thesis description of 1,200-1,500 words and a statement of support for the applicant’s thesis advisor.  Additional details (including information about how to submit) can be found at: http://www.iiix2010.org/doctoral.php.  Submissions are due on April 30, 2010.

HCIR WORKSHOP

The 4th Annual Workshop on Human-Computer Interaction and Information Retrieval (HCIR 2010) will be held in conjunction with IIiX 2010. HCIR is the study of information retrieval (IR) techniques that bring human intelligence into the search process. It combines research from the fields of human-computer interaction (HCI) and IR, placing an emphasis on human involvement in search activities.  Additional details can be found at: http://www.iiix2010.org/hcir-workshop/.

IMPORTANT DATES (ALL 2010)

APRIL 11                  Papers and Posters Due
APRIL 30                  Doctoral Consortium Submissions Due
MAY 25                     Notifications
JUNE 18                   Camera Ready Copy Due
AUGUST 18-22        IIiX Conference, New Brunswick, NJ, USA 










Tony Russell-Rose | 17 Mar 2010 18:57

ECIR 2010 Industry Day, April 1, Milton Keynes

ECIR 2010 Industry Day

Thursday 1st April 2010

The Open University, Milton Keynes, UK

We are pleased to announce the European Conference on Information Retrieval
(ECIR) 2010 Industry Day. This event takes place the day after the main ECIR
programme and represents a unique opportunity to meet and share ideas with a
broad mix of experts from both industry and academia. We have a great list
of speakers who will present the latest challenges faced by practitioners in
both enterprise and web search. We are excited that this year we have some
talks on applications of semantic analysis which is considered to be a
rapidly maturing academic field, now ready for wider adoption in the
marketplace. The event should appeal to students, academics, researchers,
designers, and developers alike.

Programme

09:00 - 10:00 Registration (Berrill Building)
10:00 - 10:10 Welcome

--------------------------------------------------------------------------------

Session 1: Advancing Web Search

10:10 Ricardo Baeza-Yates (Yahoo! Research) "Mining the Web 2.0 to Improve
Search" 
10:35 Dan Crow (Google) "Google Squared: web scale, open domain information
extraction and presentation" 
11:00 Milad Shokouhi (Microsoft Research) "Relevance Challenges at Bing" 

--------------------------------------------------------------------------------

11:25 - 11:55 Coffee break

--------------------------------------------------------------------------------

Session 2: Enterprise Search

11:55 Vegard Sandvold (Comperio) "Search User Experience - The Essentials of
Great Search Design" 
12:20 David Hawking (Funnelback) "Getting value from the Search Master's
Toolbox" 
12:45 Nick Patience (The 451 Group) "Enterprise Search: State of the Market
2010 & Beyond" 

--------------------------------------------------------------------------------

13:10 - 14:10 Lunch

--------------------------------------------------------------------------------

Session 3: Domain-Specific Search

14:10 Rob Blackwell (Active Web Solutions) "Project Plaza - A new approach
to information management in the Construction Sector" 
14:35 Sally Chambers (The European Library) "Rethinking the library
catalogue: making search work for the library user" 
15:00 Francisco de Sousa Webber (Matrixware) 

--------------------------------------------------------------------------------

15:25 - 16:00 Coffee break

--------------------------------------------------------------------------------

Session 4: Beyond Search: Question-Answering

16:00 Jon McLoone (Wolfram Alpha)"Wolfram|Alpha - the new computational
knowledge engine" 
16:25 Simon Overell (True Knowledge) "Using AI to get Answers from the
Internet" 
Panel Discussion

16:50 Panel Topic: "Leveraging semantics to enable better search experiences" 
Dan Crow (Google), Gjergji Kasneci (Microsoft Research), Jon McLoone
(Wolfram Alpha), Simon Overell (True Knowledge). Panel moderator: Mike Taylor

This discussion will centre on the exciting subject of semantic analysis. We
will try to cover both technological and application orientated aspects of
this field. For example, some of the questions we will attempt to address
are as follows:

·         How feasible is it to automatically infer useful semantic
information from the Web?
·         How should we quantify trust and ambiguity in knowledge extracted
from the Web?
·         Could semantic search ever replace keyword search? 
·         What is a good UI for semantic search?

 
--------------------------------------------------------------------------------

17:30 - 19:30 Drinks reception

--------------------------------------------------------------------------------

 
Registration
The registration fee includes lunch and a copy of the Industry Day
proceedings. Tea and coffee will also be available throughout the day
followed by a drinks reception. Please register via the ECIR 2010
Registration site.  Fees: Students/BCS Member £95, Non-Member: £120.

 
Venue
Industry Day will be held at the same venue as the main conference (The Open
University). See http://kmi.open.ac.uk/events/ecir2010/ for further details.

 
Contact
If you have any enquiries about the event, please see
http://dces.essex.ac.uk/staff/udo/ecir2010/ or contact Udo Kruschwitz: udo
[at] essex.ac.uk 

 
Industry Day Organisers
Tony Russell-Rose, Endeca
Udo Kruschwitz, University of Essex
Mike Taylor, Microsoft Research

 
ECIR Industry Day is organised by the Information Retrieval Specialist Group
of the BCS (British Computer Society).

Benno Stein | 23 Mar 2010 09:02
Picon
Favicon

Final CFP: DEXA-Workshop on Text-Based Information Retrieval, TIR'10

FINAL CALL FOR PAPERS

---------------------------------------------------------------------------
*TIR'10  -  7th International Workshop on Text-Based Information Retrieval*
---------------------------------------------------------------------------

                   In conjunction with the DEXA 2010
 21st International Conference on Database and Expert Systems Applications

                 Bilbao, Spain, August 30 - September 3
                        http://www.tir.webis.de

---------------------------------------------------------------------------
About this Workshop:
---------------------------------------------------------------------------

Intelligent algorithms for mining and retrieval are the key technology to
cope with the information need challenges in our media-centered
society. Methods for text-based information retrieval receive special
attention, which results from the important role of written text, from the
high availability of the Internet, and from the enormous importance of Web
communities.

Advanced information retrieval and extraction uses methods from different
areas: machine learning, computer linguistics and psychology, user
interaction and modeling, information visualization, Web engineering,
artificial intelligence, or distributed systems. The development of
intelligent retrieval tools requires the understanding and combination of
the achievements in these areas, and in this sense the workshop provides a
common platform for presenting and discussing new solutions.

The following list organizes classic and ongoing topics from the field of
text-based IR for which contributions are welcome:

  - Theory. Retrieval models, language models, similarity measures, formal
    analysis

  - Mining and Classification. Category formation, clustering, entity
    resolution, document classification, learning methods for ranking

  - Web. Community mining, social network analysis, structured retrieval
    from XML documents

  - NLP. Text summarization, keyword extraction, topic identification

  - User Interface. Paradigms and algorithms for information visualization,
    personalization, privacy issue

  - User Context. Context models for IR, context analysis from user
    behaviour and from social networks

  - Multilinguality. Cross-language retrieval, multilingual retrieval,
    machine translation for IR

  - Evaluation. Corpus construction, experiment design, conception of user
    studies

  - Semantic Web. Meta data analysis and tagging, knowledge extraction,
    inference, and maintenance

  - Software Engineering. Frameworks and architectures for retrieval
    technology, distributed IR

The workshop is held for the seventh time. In the past, it was characterized
by a stimulating atmosphere, and it attracted high quality contributions
from all over the world. In particular, we encourage participants to
present research prototypes and demonstration tools of their research ideas.

---------------------------------------------------------------------------
Important Dates:
---------------------------------------------------------------------------

Mar 30, 2010    Deadline for paper submission
Apr 20, 2010    Notification to authors
May 17, 2010    Camera-ready copy due
Aug 30, 2010    Workshop opens

Contributions will be peer-reviewed by at least two experts from the
related field. Accepted papers will be published as IEEE proceedings by
IEEE CS Press.

---------------------------------------------------------------------------
Workshop Organization:
---------------------------------------------------------------------------

Benno Stein, Bauhaus University Weimar
Michael Granitzer, Know-Center Graz & Graz University of Technology

Contact: tir@...
Information about the workshop can be found at http://www.tir.webis.de

Mark Sanderson | 24 Mar 2010 14:08
Picon
Favicon

Final CFP - The 3rd International Workshop on Evaluating Information Access, EVIA 2010

***** FINAL CALL FOR PAPERS *****

The Third International Workshop on Evaluating Information Access
(EVIA 2010), a Satellite Workshop of NTCIR-8
http://research.nii.ac.jp/ntcir/ntcir-ws8/EVIA-2010/

June 15, 2010 at NII, Tokyo, Japan.
***************************************

Information Access technologies provide the interface between human 
information needs and digital information resources.  The reliable 
evaluation of these technologies has been recognized for decades as 
central to the advancement of the field.  As information retrieval 
becomes more pervasive, the forms of retrieval more diverse, and 
retrieval tools richer, the importance of effective, efficient, and 
innovative evaluation grows as well. In recognition of the need for a 
forum dedicated to the intensive discussion of evaluation issues, we 
have held two successful International Workshops on Evaluating 
Information Access (EVIA 2007 and 2008).  Proceedings and reports can be 
found below:

EVIA 2007 online proceedings: 
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings6/EVIA/
EVIA 2008 online proceedings: 
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings7/toc_evia.html

SIGIR Forum Report on EVIA 2007: 
http://sigir.org/forum/2007D/2007d_sigirforum_sanderson.pdf
SIGIR Forum Report on EVIA 2008: 
http://sigir.org/forum/2009J/2009j-sigirforum-sakai.pdf

Following these successes, we are happy to announce the Third 
International Workshop on Evaluating Information Access (EVIA 2010) on 
June 15, 2010 (coinciding with Day 1 of the NTCIR-8 Workshop Meeting) at 
the National Institute of Informatics (NII), Tokyo, Japan.  We invite 
papers addressing one or more of the following topics:

- Test collection formation, evaluation metrics, and evaluation environments
- Statistical issues in retrieval evaluation
- User studies and the evaluation of human-computer interaction in 
information retrieval (HCIR)
- Evaluation methods for multilingual, multimedia, or mobile information 
access
- Novel information access tasks and their evaluation
- Evaluation and assessment using implicit user feedback, crowdsourcing, 
living labs, or inferential methods
- Evaluation issues in industrial and enterprise retrieval systems

*** SUBMISSION INSTRUCTIONS ***

Submissions will be subject to double-blind reviewing.  Accepted papers 
will be included in the EVIA 2010 online proceedings, and summarized in 
a report to SIGIR Forum.

We invite submissions of regular papers (up to 9 pages) and short papers 
(up to 5 pages).
Submission upload page: http://www.easychair.org/conferences/?conf=evia2010

*** IMPORTANT DATES ***

- March 31, 2010    *submissions due*
- April 18, 2010        notification of acceptance
- May 10, 2010        final manuscripts due
- June 15, 2010        EVIA 2010 <at> NII, Tokyo, Japan
- June 15-18, 2010   NTCIR-8 <at> NII, Tokyo, Japan

*** EVIA 2010 PROGRAM COMMITTEE ***

Akiko Aizawa       NII                              Japan
Javed Aslam        Northeastern University          USA
Nicholas Belkin    Rutgers University               USA
Ben Carterette     University of Delaware           USA
Charlie Clarke     University of Waterloo           Canada
Georges Dupret     Yahoo! Research                  Chile
Norbert Fuhr       Universitaet Duisburg-Essen      Germany
Atsushi Fujii      Tokyo Institute of Technology    Japan
Donna Harman       NIST                             USA
Hideo Joho         University of Tsukuba            Japan
Gareth Jones       Dublin City University           Ireland
Noriko Kando       NII                              Japan
Evangelos Kanoulas University of Sheffield          UK
Jaana Kekalainen   University of Tampere            Finland
Mounia Lalmas      University of Glasgow            UK
Gary Geunbae Lee   POSTECH                          Korea
Mun-Kew Leong      National Library Board           Singapore
Jimmy Lin          University of Maryland           USA
Chin-Yew Lin       Microsoft Research Asia          China
Iadh Ounis         University of Glasgow            UK
Carol Peters       IEI-CNR                          Italy
Ian Ruthven        University of Strathclyde        UK
Tetsuya Sakai      Microsoft Research Asia          China
Mark Sanderson     University of Sheffield          UK
Falk Scholer       RMIT University                  Australia
Ian Soboroff       NIST                             USA
Paul Thomas        CSIRO                            Australia
William Webber     University of Melbourne          Australia
Emine Yilmaz       Microsoft Research Cambridge     UK

*** EVIA 2010 CO-CHAIRS ***

William Webber (University of Melbourne, Australia)
   wew@...
Mark Sanderson (University of Sheffield, UK)
   m.sanderson@...
Tetsuya Sakai (Microsoft Research Asia, China)
   tetsuyasakai@...

lkelly | 25 Mar 2010 20:06
Picon
Picon
Favicon

CFP: SIGIR 2010 Workshop on DESKTOP SEARCH (Understanding, Supporting and Evaluating Personal Data Search)

***Call for papers a SIGIR 2010 workshop on Desktop Search (Understanding, Supporting and Evaluating Personal Data Search), July 23, Geneva, Switzerland (http://www.cdvp.dcu.ie/DS2010/)***

 

 

Desktop Search Workshop

Understanding, Supporting, and Evaluating Personal Data Search

 A SIGIR 2010 workshop, July 23, Geneva, Switzerland

http://www.cdvp.dcu.ie/DS2010/

 

Desktop search refers to the process of searching within one’s personal space of information.  The information searched during a desktop search can include content that resides on one's personal computer (e.g., documents, emails, visited Web pages, and multimedia files), and may extend to content on other personal devices, such as music players and mobile phones.  Despite recent research interest, desktop search is under-explored compared to other search domains such as the web, semi-structured data, or flat text. 

 

This workshop will bring together researchers interested in desktop search with the goal of fostering collaborations and addressing the challenges faced in this area. The workshop will be structured to encourage group discussion and active collaboration among attendees. We encourage participation from researchers in the fields of information retrieval, personal information management, natural language processing, human-computer interaction, and related areas.

 

The topics of the workshop include but are not limited to:

 

  • Understanding desktop search behavior

·         Studies of desktop search behavior

·         Desktop query log analysis

·         Psychological aspects of re-finding (e.g., people’s memories of items)

  • Supporting desktop search

·         Retrieval approaches (e.g., content analysis, search algorithms)

·         Personalization to account for highly individual collections and needs

·         Interfaces for desktop search and presentation of results

  • Evaluating desktop search

·         Evaluation approaches (e.g., test collections, lab studies, log analyses)

·         Test set creation  (e.g., common reference task, common corpora)

  • Other uses of desktop collections

·         Life-logging

·         Introspection and reflection using personal collections

 

Submission Guidelines

Short papers (max 4 pages) and short position papers (max 2 pages) describing significant work in progress, late breaking results or ideas / challenges for the domain are invited. Submissions should be in ACM SIGIR format. LaTeX and Word templates are available at http://www.acm.org/sigs/publications/proceedings-templates (for LaTeX, use the "Option 2" style).

 

Anonymised papers in pdf format should be submitted to http://www.easychair.org/conferences/?conf=desktop2010 no later than midnight Pacific Daylight Time on June 3, 2010. Submissions will be subject to triple-blind reviewing.

 

Important Dates

June 3, 2010            Deadline for paper submission

June 27, 2010           Notification to authors

July 5, 2010             Camera-ready copy due

July 23, 2010           Workshop

 

Further Information

Further information is available on the workshop website at http://www.cdvp.dcu.ie/DS2010/ or by emailing the workshop organizers.

 

Workshop Organizers

David Elsweiler – University of Erlangen, Germany (david-0tjEYskydmyx7wk7FZxnQA@public.gmane.org)

Gareth J. F. Jones – Dublin City University, Ireland (gjones-j9mISXBebvq70S6Re0YL1A@public.gmane.org)

Liadh Kelly – Dublin City University, Ireland (lkelly-j9mISXBebvq70S6Re0YL1A@public.gmane.org)

Jaime Teevan – Microsoft Research Redmond, USA (teevan-0li6OtcxBFHby3iVrkZq2A@public.gmane.org)

 

Program Committee

Leif Azzopardi - University of Glasgow, UK

Ofer Bergman – Sheffield University, UK

Rob Capra -  University of North Carolina, USA

Sergey Chernov - University of Hanover, Germany

Bruce Croft - University of Massachusetts, USA

Ed Cutrell - Microsoft Research, India

Susan Dumais - Microsoft Research, USA  

Diane Kelly - University of North Carolina, USA

Ian Ruthven - University of Strathclyde, UK

 

Picon

2nd CFP CERI 2010 and Registration


*************** 2nd Call for Papers - CERI 2010 ***************

       1st Spanish Conference on Information Retrieval
 I Congreso Español de Recuperación de Información - CERI 2010
                   Madrid, 15-17 June 2010
                http://ir.ii.uam.es/ceri2010

******************************
*********************************

-- Registration is now open --

Information Retrieval (IR) technology is now part of the ambient work and home environments of many people and organisations. Examples of this are not hard to find, e.g. the widespread use of search engines to access the World Wide Web. IR has therefore become an increasingly important research area.

This conference's aim is to provide an international forum where researchers from both academia and industry can meet and have substantive interaction. CERI welcomes innovative contributions from a wide range of knowledge areas (not only Computer Science but also Information Science, Linguistics, etc.).

Furthermore, within this conference, the organizers aim at promoting the constitution of the Spanish Society of Information Retrieval. This new Society would support IR in Spain and it is the organizers' intention that the Society starts with as much support as possible. All scientists interested in the creation of this Society are welcome to participate.

We encourage national and international researchers to submit original papers, written in spanish or english, related to any aspect of IR including, but not limited to:

   * IR models
   * Evaluation
   * Performance, scalability, architectures and efficiency
   * Structured retrieval (XML, etc).
   * Filtering and recommendation systems
   * Digital libraries
   * Text mining. Classification and clustering
   * Web IR
   * Social networks
   * User studies, models and interaction
   * Multimedia and crosslingual IR

Submitted papers should be in the Springer Verlag LNCS style:

http://www.springer.com/computer/lncs?SGWID=0-164-7-72376-0

Papers should not exceed 12 pages and must be submitted as PDF files (an EasyChair system will be available for paper submission). They will be published in a conference proceedings book with ISBN, in electronic format, as well as in the conference's website.

Important dates:

Abstract submission deadline: 15 Apr 2010.
Paper submission deadline: 22 Apr 2010.
Notification of acceptance: 21 May 2010.
Submission of final version: 31 May 2010.
Conference: 15-17 June 2010.

Conference Chair:

- Pablo Castells, Universidad Autónoma de Madrid.

Programme Committee Chair:

- David E. Losada, Universidad de Santiago de Compostela.

Contact email: ceri2010-G3beldX/htM@public.gmane.org.

More info at: http://ir.ii.uam.es/ceri2010


--
Juan Antonio Martínez Comeche
Director Dpto. Biblioteconomía y Doc.
Library and Information Science Department
Fac. CC. Documentación
Universidad Complutense de Madrid
C/ Santísima Trinidad 37
28010 MADRID
juaamart-mjGOVl/DPLne5aOfsHch1g@public.gmane.org
juan.comeche-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
http://comeche.es/
http://griweb.es/
Martin Potthast | 26 Mar 2010 22:34
Picon
Favicon

2nd CFP: CLEF-Lab on Plagiarism Detection and Wikipedia Vandalism Detection, PAN'10

-------------------------------------------------------------------------------
Call for Participation:
Evaluation Campaign on Plagiarism Detection and Wikipedia Vandalism Detection
-------------------------------------------------------------------------------

           held in conjunction with the CLEF'10 conference
                  in Padua, Italy, September 20-23
                         http://pan.webis.de

-------------------------------------------------------------------------------
About the Campaign:
-------------------------------------------------------------------------------

Plagiarism detection in text documents is a challenging retrieval task:
today's detection systems are faced with intricate situations, such as
obfuscated plagiarism or plagiarism within and across languages.
Moreover, the source of a plagiarism case may be hidden in a large
collection of documents, or it may not be available at all. Informally,
the respective CLEF-Lab task can be described as follows:

 1. Plagiarism Detection. Given a set of suspicious documents and a set
    of source documents, the task is to find all plagiarized sections
    in the suspicious documents and, if available, the corresponding
    source sections.

Following the success of the 2009 campaign and based on our experience
we will provide a revised evaluation corpus consisting of artificial and
simulated plagiarism.

Vandalism has always been one of Wikipedia's biggest problems. However,
the detection of vandalism is done mostly manually by volunteers, and
research on automatic vandalism detection is still in its infancy.
Hence, solutions are to be developed which aid Wikipedians in their
efforts. Informally, the respective CLEF-Lab task can be described as
follows:

 2. Wikipedia Vandalism Detection. Given a set of edits on Wikipedia
    articles, the task is to identify all edits which are vandalism,
    i.e., all edits whose editors had bad intentions.

Participants are invited to submit results for one or both of the tasks.

-------------------------------------------------------------------------------
Important Dates:
-------------------------------------------------------------------------------

open              Registration
Jun 01, 2010      Result submission deadline
Jun 15, 2010      Notification of performance
Jul 15, 2010      Paper submission deadline
Aug 02, 2010      Notification of reviews
Sep 01, 2010      Final paper deadline
Sep 20-23, 2010   Evaluation lab at CLEF conference

-------------------------------------------------------------------------------
Campaign Organization:
-------------------------------------------------------------------------------

Webis  <at>  Bauhaus-Universität Weimar
http://www.webis.de

NLEL  <at>  Universidad Politécnica de Valencia
http://www.dsic.upv.es/grupos/nle

University of the Aegean
http://www.icsd.aegean.gr/lecturers/stamatatos

Bar-Ilan University
http://u.cs.biu.ac.il/~koppel

-------------------------------------------------------------------------------
Contact:
-------------------------------------------------------------------------------

E-mail: pan@...
Campaign Web page: http://pan.webis.de

Mark Sanderson | 30 Mar 2010 12:11
Picon
Favicon

EVIA 2010 - extended deadline for papers, April 2nd

***** DEADLINE EXTENDED TO APRIL 2 (timezone: GMT-12)! *****

The Third International Workshop on Evaluating Information Access
(EVIA 2010), a Satellite Workshop of NTCIR-8
http://research.nii.ac.jp/ntcir/ntcir-ws8/EVIA-2010/

June 15, 2010 at NII, Tokyo, Japan.
*****************************************************************

Information Access technologies provide the interface between
human information needs and digital information resources.  The
reliable evaluation of these technologies has been recognized for
decades as central to the advancement of the field.  As information
retrieval becomes more pervasive, the forms of retrieval
more diverse, and retrieval tools richer, the importance of
effective, efficient, and innovative evaluation grows as well.
In recognition of the need for a forum dedicated to the intensive
discussion of evaluation issues, we have held two successful
International Workshops on Evaluating Information Access (EVIA
2007 and 2008).  Proceedings and reports can be found below:

EVIA 2007 online proceedings:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings6/EVIA/
EVIA 2008 online proceedings:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings7/toc_evia.html

SIGIR Forum Report on EVIA 2007:
http://sigir.org/forum/2007D/2007d_sigirforum_sanderson.pdf
SIGIR Forum Report on EVIA 2008:
http://sigir.org/forum/2009J/2009j-sigirforum-sakai.pdf

Following these successes, we are happy to announce the Third
International Workshop on Evaluating Information Access (EVIA
2010) on June 15, 2010 (coinciding with Day 1 of the NTCIR-8
Workshop Meeting) at the National Institute of Informatics (NII),
Tokyo, Japan.  We invite papers addressing one or more of the
following topics:

- Test collection formation, evaluation metrics, and evaluation
   environments
- Statistical issues in retrieval evaluation
- User studies and the evaluation of human-computer interaction
   in information retrieval (HCIR)
- Evaluation methods for multilingual, multimedia, or mobile
   information access
- Novel information access tasks and their evaluation
- Evaluation and assessment using implicit user feedback,
   crowdsourcing, living labs, or inferential methods
- Evaluation issues in industrial and enterprise retrieval
   systems

*** SUBMISSION INSTRUCTIONS ***

Submissions will be subject to double-blind reviewing.  Accepted
papers will be included in the EVIA 2010 online proceedings, and
summarized in a report to SIGIR Forum.

We invite submissions of regular papers (up to 9 pages) and
short papers (up to 5 pages).
Submission upload page:
http://www.easychair.org/conferences/?conf=evia2010

*** IMPORTANT DATES (NEW!) ***

- April 2, 2010            *submissions due*
- April 20, 2010         notification of acceptance
- May 10, 2010           final manuscripts due
- June 15, 2010         EVIA 2010 <at> NII, Tokyo, Japan
- June 15-18, 2010        NTCIR-8 <at> NII, Tokyo, Japan

*** EVIA 2010 PROGRAM COMMITTEE ***

Akiko Aizawa       NII                              Japan
Javed Aslam        Northeastern University          USA
Nicholas Belkin    Rutgers University               USA
Ben Carterette     University of Delaware           USA
Charlie Clarke     University of Waterloo           Canada
Georges Dupret     Yahoo! Research                  Chile
Norbert Fuhr       Universitaet Duisburg-Essen      Germany
Atsushi Fujii      Tokyo Institute of Technology    Japan
Donna Harman       NIST                             USA
Hideo Joho         University of Tsukuba            Japan
Gareth Jones       Dublin City University           Ireland
Noriko Kando       NII                              Japan
Evangelos Kanoulas University of Sheffield          UK
Jaana Kekalainen   University of Tampere            Finland
Mounia Lalmas      University of Glasgow            UK
Gary Geunbae Lee   POSTECH                          Korea
Mun-Kew Leong      National Library Board           Singapore
Jimmy Lin          University of Maryland           USA
Chin-Yew Lin       Microsoft Research Asia          China
Iadh Ounis         University of Glasgow            UK
Carol Peters       IEI-CNR                          Italy
Ian Ruthven        University of Strathclyde        UK
Tetsuya Sakai      Microsoft Research Asia          China
Mark Sanderson     University of Sheffield          UK
Falk Scholer       RMIT University                  Australia
Ian Soboroff       NIST                             USA
Paul Thomas        CSIRO                            Australia
William Webber     University of Melbourne          Australia
Emine Yilmaz       Microsoft Research Cambridge     UK

*** EVIA 2010 CO-CHAIRS ***

William Webber (University of Melbourne, Australia)
   wew@...
Mark Sanderson (University of Sheffield, UK)
   m.sanderson@...
Tetsuya Sakai (Microsoft Research Asia, China)
   tetsuyasakai@...


Gmane