Understanding the use of Temporal Expressions on Persian Web Search

Transcription

1 Understanding the use of Temporal Expressions on Persian Web Search Behrooz Mansouri Mohammad Zahedi Ricardo Campos Mojgan Farhoodi Alireza Yari Ricardo Campos TempWeb WWW Lyon, France, Apr 23, 2018 Iran Telecommunication Research Center Instituto Politécnico de Tomar LIAAD INESC TEC

2 Agenda Introduction 1 Related Work 2 Research Questions 3 Experimental Setting 4 Experimental Results 5 Conclusions 6

3

4 Temporal Queries 1969 [Campos, R. IR Journal (2017)] [Mansouri, B. CIKM 17]

5 Temporal Queries [Campos, R. IR Journal (2017)] [Mansouri, B. CIKM 17]

6 Implicit (e.g., World Cup) [Metzler SIGIR 09] estimated that 7% of the queries have an implicit temporal nature.

7 Explicit (e.g., Brasil 2014) According to [Nunes ECIR 08] only 1.5% of the queries are explicit.

8 How often (explicit How often (explicit or relative) temporal expressions are used in web queries?

9 Which type of temporal expressions (Date, Time, Duration, and Set) are commonly used?

10 To which time (past, current or future) do temporal expressions mostly refer to?

11 Which categories are most prevalent in terms of the use of temporal expressions?

12 How often do users reformulate their queries by adding temporal expressions to their initial query?

13 How using temporal expressions affects user s satisfaction?

14

15 Use of Temporal Expressions How often (explicit or relative) temporal expressions are used in web queries Same as Nunes our experiments also reveals that queries with temporal expressions (either explicit or relative) are relatively rare and account for only 1.9% of the total queries (513k queries) 49.8% of temporal queries are explicit (such as April 2018) 25,0% 20,0% 15,0% 10,0% 5,0% 0,0%

16 Types of Temporal Expressions Date: 73.7% Which type of temporal expressions (Date, Time, Duration and Set) are commonly used? Time: 19.1% Duration: 4.4% Set: 2.8% Top-5 most frequent temporal patterns in queries with temporal expression Pattern Example(s) Year Expressions 2016, 2017 Relative Days Tomorrow, Today Month + Year September 2017 Day + Month October 21 Part of Day + Relative Days Tomorrow Morning

17 Reference Time To which time (past, current or future) do temporal expressions mostly refer to? Current Past Future Next Week Football Matches 2012 April 23, 2018 April 30, 2018 London Olympics 2012 Today s news Query issue time

18 Reference Time To which time (past, current or future) do temporal expressions mostly refer to? Current Past Future Category Example % Past Reference Time Distribution 2012 Olympics with query issue time April % Current Today s weather 69.1% Future Next week football matches 14.7%

19 Topic Categories Which categories are most prevalent in terms of the use of temporal expressions? We randomly selected a representative sample of 10,000 unique queries with temporal expressions We then asked 3 editors (0.72 of agreement level) to select the best category (based on Yahoo answers categories) for each query

20 Topic Categories News & Events Which categories are most prevalent in terms of the use of temporal expressions? During the period of the event users tend to use temporal expressions more related to the present. For instance, during Rio Olympics, queries such as today s Olympics results were used quite often; Business & Finance 79.4% of the temporal queries issued within this category make use of relative temporal expressions (e.g., today and tomorrow ) meaning that people are mostly interesting in looking for present and near future events;

21 Topic Categories Education & Reference Which categories are most prevalent in terms of the use of temporal expressions? Temporal expressions were mostly used to refer to the publications date of books and articles;

22 Query Reformulation How often do users reformulate their queries by adding temporal expressions to their initial query? We begin by relying on the user s session ID which keeps track of the user s interaction with the search engine Then we investigate if temporal expressions were used in the user s initial query or reformulated in subsequent user interactions. To this regard we define a temporal search session, as a sequence of queries having at least one query with temporal expression (e.g., Olympics, Rio Olympics, and Olympics 2016 )

23 Query Reformulation How often do users reformulate their queries by adding temporal expressions to their initial query? We were able to consider a total number of 132.5K temporal search sessions. We found that in 74.2% of these search sessions, the initial query already had a temporal expressions (e.g., Olympics 2016) 1% (Past) 88.6% (Present) 10.4% (Future) In 25.8% of the temporal sessions, users added a temporal expression (Olympics Olympics 2016) 60% (Past) 13% (Present) 27% (Future)

24 User s Satisfaction How using temporal expressions affects user s satisfaction? In this work, we define the user s satisfaction as a successful search session, where the last interaction between the search engine and the user is a click on a URL. We looked at the 25.8% of the temporal search sessions where adding a temporal expression to an initial non-temporal query (Olympics Olympics 2016) has led to a final click. 75.9% of the search sessions were finished with a click. We also studied user s satisfaction on top 132.5K non-temporal search sessions and found that only 37.6% ended up What with is Information a click. Retrieval?

25 1.9% of the queries contain temporal expressions (of which 50.2% are relative) Most of temporal expressions follow the date format, specially year expressions Users mostly use temporal expressions to refer to the present time (69.1% of the temporal queries) We also found that temporal expressions are only used for a short number of queries and differently used in each topical category Users are usually aware of their target time frame when using temporal expressions, as 74.2% of the temporal search sessions were initiated with queries having temporal expressions (particularly recent dates) Finally, using temporal expressions in queries increases users satisfaction

26

27