Research Projects
Semantic Annotation
Impressions Video
PatOlympics
A prototype evaluation class organised in conjunction with the 3rd Information Retrieval Symposium.
This half-day event will provide an interactive evaluation platform where prototypes of state-of-the-art patent retrieval systems will be tested and driven to their limits by patent retrieval professionals.
Participants will be able to interact with the experts, demonstrate the power and flexibility of their prototype and compete with other participants for the medals of the PatOlympics.
The 2010 PatOlympics have two PatSports: ChemAthlon and Cross-Language Retrieving. Participating groups can register to either one or both of the sports.
Description of PatSports
- ChemAthlon:
The participating groups are given requests for information similar to those of the Technical Survey task of theTREC Chemical IR Track 2009 : a natural language request containing chemical formulas, interactions and/or numeric ranges. The participants score by retrieving documents judged as relevant by the expert(s) who formulated the request for information.
- Cross-Language Retrieving:
The participating groups are given requests for information in one language and asked to retrieve all relevant documents in any language present in the collection.For both competitions, the virtual playing field - the collection of documents to be indexed - will be provided
prior to June 3rd.
IMPORTANT DATES
Participant registration deadline: 31 January 2010
Data collections released: 31 March 2010
PatOlympics: 3 June 2010
IMPORTANT NOTES
- Participating prototypes must not be existing commercial tools. They can be based on existing open source or non open source systems, but must have a significant novel component (either at its core or in its user interface).
- Systems must be able to send data over tcp/ip to the PatOlympics server. Specification of the communicatio protocol will be released by end of February 2010.
- Participating systems will NOT be required to disclose source codes.
- Participants in the PatOlympics may be ELIGIBLE FOR FREE REGISTRATION to the IRF Symposium (June 1st - June 3rd)
HOW TO REGISTER
Send an email to Mihai Lupu (m.lupu@ir-facility.org) with subject PatOlympics and a short description of the system you plan to use in the competition. Don't forget to specify which sport(s) you wish to take part in.
