Hercules Dalianis DSV/KTH-Stockholm University /

Transcription

1 DSV/KTH-Stockholm University / What is Business Intelligence? Flow / Archive Techniques Terminology Languages Channels Formats 1 2 To have a general view on the surrounding world in one or several areas. To have information of what other people say about me. Yesterday one did BI by reading news paper in paper form and by talking with people. Today one does BI by surveying news streams and by talking with people. Today with the growing Internet there is more and more information available. News papers, press releases, radio and TV are available in digital form. The information flow increases for each year. Different tools are needed to extract and compile the most important information. 3 4 One wants to go back in time Libraries Archives Searchable archives Time stamp Different formats can be surveyed Using Stemming Using truncation / wildcards Synonyms Automatic text summarization KWIC-Key word in context, snippets Multi text summarization Clustering Machine translation 5 6 1

2 Lucene search engine Effects of stemming in search engines EMM-News Explorer (or Retriever freely used from university) Tommy Ringart, Information officer, Merck, Sharp & Dohme, MSD 7 8 The word Intelligence is slightly ambiguous Means both capability and getting information Business intelligence (BI) means sometimes Operational Intelligence, Verksamhetsplanering within a organization. Planning activities within a organization Knowledge management is part of BI in a company. Knowledge management means knowledge of the knowledge of the employed in a organization 9 10 Specific terms for BI are: competitor intelligence competitive intelligence Market analysis Statistics Business development market intelligence, technical intelligence, customer intelligence Strategic planning Communication and information

3 Surveillance Macro economic Information officer (Public relations officer) Political Technological Social Demographic factors Market analysis person Business unit manager Sales manager To continuously and on a structural way survey and analyze the factors that affects the development and success of the company/organisation To use this information to make decisions. The number of open information sources has increased dramatically This requires selectivity so the sources can be assessed and analyzed All this together contributes to the development of the area Business Intelligence To have a general view of the surrounding in one or more areas. To have information of what others say about me. In the past one did this by reading news in papers and to talk with people. Today one does this by surveying news streams and to talk with people See connections Think different See outside the normal patterns Question things that everybody else is accepting. Ask queries about things that have been observed. Everything is not Science - it is also Art!

4 Thousands of languages in the world Ten big languages and then Swedish. Written information: Press releases, news papers, reports, scientific reports, books, annual reports. Some information is digital some is in paper form in a library. Spoken information: Radio, TV Read and cut in news papers Hundreds of employees Thousands of news papers each day. Inform the customers if an interesting news article turns up. Mail or fax press cuttings to customer Infopac does this also in a more advanced form Analyze the news article based on the requirements of the customer. What companies co-occur in the same news article? Annual turnover of these companies News flow News archive - library Kungliga biblioteket-saves all the books and the www production of Sweden. InternetArchive - WaybackMachine SVT and SR archive Internet is an large and unstructured archive. Semantic web InternetArchive - WaybackMachine !

5 News papers Radio/TV Company news Public information from public authorities. HTML TXT PDF PS -.ps postscript MS Office Word.doc Excel.xls Powerpoint.ppt The XML-format RSS - Rich Site Summary NewsML - Reuters etc.. RTF- Rich Text Format Sound - wav, au, mp3, wma, real-audio Pictures - jpg, gif, tiff WML-Wireless Markup Language WAP RDF- Rich Description Format -Semantic web RSS format RSS-Rich Site Summary Several news papers and organisations supply RSS feed:// RSS in XML, presentation independent format Easy to process and decide on RSS presentation Look for orange RSS symbol RSS readers Frequency of spider Once a month, once per day, once each 15 minutes. Accessibility Java scripts Robots.txt Invisible web and data bases. Intranets and extranets

6 Tsunami Tsunami Söktryck (Application Pressure) Söktryck, Application pressure latest.html Search Kauhajoki There is no simple entrance Must be treated specially and manually Either => Exhaustive search query Or => The database administrator solve this by creating an index with addresses Intranet inside fire walls Extranet inside fire walls but possible to logon for customers news sites, bank services, member sites and sales portals. American news paper on web

7 Know everything slightly ahead of everybody else To obtain an overview Survey some of my favorite web sites Computer Sweden, Aftonbladet, portals Internetbrus.com Read papers DN, Ny Teknik, Check some company web sites Check some public web sites All this in Swedish What about English, French, Spanish, Urdu, Hindi, Japanese and Chinese? Survey news flow automatically on several languages, formats and on all places. TDT-Topic Detection Tracking (2000) TDT-the concept comes from the DARPA research program TIDES Translingual Information Detection, Extraction and Summarization, Using computers to automatically detect, extract and translate news. English and Chinese news on Radio, TV and news on web sites are surveyed with speech recognition, text analysis using statistic, heuristic and linguistic method Segmentation - to distinguish different news in the news flow. Tracking - to follow news with the same subject/topic. Detection - to group news with the same subject. Link detection- to find if two news has some connection subject wise, and finally the most difficult: First Story Detection - to detect a completely novel new in the news flow. TDT tracking succeeds pretty well with the first four tasks with an error rate around percent. But with first story detection one does almost 70 percent wrong. Site / domain Language Format Demo

8 q=influensa&ctab=0&geo=se&geor=all&da te=2009&sort=0 Tsunami, influensa Search Business Intelligence Search Business Intelligence och Business Intelligence is an Art But also systematic work Flow / Archive Terminology Languages Channels Formats Techniques What is the difference between flow and archive? 47 8