CS-E4420 Information Retrieval

Transcription

1 CS-E4420 Information Retrieval Course assignments Esko Ikkala

2 Agenda General information about the course assignments Short demo: how to set up the necessary programming tools

3 Assignments There will be two assignments and you have to pass both of them First assignment is a personal task and the second one is a group task 10% of the course grading is based on the first assignment and 40% is based on the second assignment

4 What do you need to know You are expected to be able to write Java code You are also expected to be able to install external Java libraries You are expected to write a report You are expected to produce and draw curves illustrating the performance of the system variants for the report

5 Assignment 1 You are going to put together an information retrieval system using Java programming language The task involves indexing documents and searching them with Boolean queries You are supposed to learn how to install necessary tools for an IR system use basic functions of a text search engine library read the documentation

6 Lucene De facto standard for search libraries, written in Java Not a complete application, but rather a code library and API that can easily be used to add search capabilities to applications Text indexing and searching capability, independent of the file format (assignment 1) Includes ranking models, e.g. Vector Space Model and Okapi BM25 (assignment 2) => You don t have to implement the actual indexing/searching/ranking algorithms

7 Assignment 1 LuceneSearchApp.java 1. Create an index based on the news document collection 2. Create and run queries 3. Process and print the results Provided helper classes RssFeedParser.java RssFeedDocument.java XML dump of BBCs RSS news feed

8 Assignment 1 In this course we use Lucene version Note that many Lucene tutorials on the web have examples using older versions Helpful sources of information: Official Documentation a tutorial and walkthrough intro to Lucenen s APIs Assignment FAQs (MyCourses) Click edit and add new questions beginning with Q: at the bottom and I ll try to come up with an answer in a few days time

9 Assignment 1 Return your solution via MyCourses only one file should be returned: LuceneSearchApp_ your student number.java Deadline is March 14 at late submissions: minus 1 point / day force majeure occurrencies: contact the course mailing list

10 Assignment 2 Detailed instructions for the Assignment 2 will be published before lecture 9 In this assignment you will get familiar with the evaluation of information retrieval methods This is a group assignment, so you should form groups of 3-4 persons To form a group, just add your name and on Assingment 2 groups wiki (MyCourses). You can also add descriptions like "looking for members or "group full etc.

11 Assignment 2 Groups should be formed before lecture 9 (March 14). If you find it difficult to form a group, the assistant will appoint one to you The formed groups and their comparison scenarios will be posted on MyCourses on March 16 After the final groups have been posted, please contact your group members as soon as possible

12 Assignment 2 For this assignment, you will be provided with another document collection that contains articles and queries that will be used as the representations of information needs to retrieve articles You have to implement a Java program which performs comparison tasks to the document collection (you can reuse the program from assignment 1) Based on the results you get from the program you have to analyze the results using information retrieval evaluation methods that you will learn during the course

13 Assignment 2 Finally, you are expected to return your work as a 8-10 page document. The report can be written in English or Finnish The report must follow the structure explained in MyCourses You should decide who is responsible for which part; the report should also include a summary of the contributions of each group member

14 Assignment 2 Return your solution via MyCourses Deadline is May 16 at 23:55 late submissions: minus 1 point / day force majeure occurrencies: contact the course mailing list

15 DEMO: Get started with Lucene and Eclipse