Google Search Appliance

Transcription

1

2 Google Search Appliance Extending the Google Search Appliance to Crawl Valuable Data Behind the Firewall Nitin Mangtani May 27, 2009

3 Search is the starting point to the world s information

4 Google Enterprise Search Our Search Products More than 20,000 enterprise search customers Dedicated team of enterprise engineers focused on solving enterprise search problems. Backed by Google s core research and development Bringing Google.com search experience to businesses

5 Universal Search Employee Directory Content Management File share Wikis Intranet SharePoint

6 Google s Search Philosophy User Intuitive, unified results Highly relevant User-friendly innovation Reach All information Real-time data Customizable and extendable Security Highly secure architecture Standards-based Leverage existing security Scale Large corpus search Cross-enterprise management Flexible infrastructure

7 Personalized Search Experience Marketin g Engineerin g

8 Advanced Biasing Controls Administrators can create multiple biasing policies. Source biasing Date biasing Metadata biasing New! Front-end biasing New! Simple setup - No complex coding or scripts.

9 Metadata Biasing New! Biasing based on metadata attribute and value Boost all documents that have author as Larry Page Administrators control influence (positive or negative) on metadata attribute/value pairs Determine influence of metadata parameter On Specific metadata name, content

10 Embedding Search Box in your application <form method="get" action=" <input type="text" name="q" size="32" maxlength="256" value="query string"> <input type="submit" name="btng" value="google Search"> <input type="hidden" name="site" value="default_collection"> <input type="hidden" name="client" value="default_frontend"> <input type="hidden" name="output" value="xml_no_dtd"> <input type="hidden" name="proxystylesheet" value="default_frontend"> </form> Such forms are the most recognizable methods for generating GET requests, but there are numerous other ways. A web application may make a HTTP GET request directly: GET /search?q=query+string&site=default_collection &client=default_frontend &output=xml_no_dtd &proxystylesheet=default_frontend HTTP/1.0

11 Leverage users input

12 Do-It-Yourself KeyMatch

13 Search-as-you-Type

14 Universal Search: Powered by Google Search Appliance Google Search Appliance File shares Over 200 file formats MS Office, PDF, HTML, etc. Intranets Web servers Portals Databases Oracle SQL Server MySQL DB2 Sybase Enterprise applications Content Management ERP systems Documentu m Busines s intelligen ce systems SharePoint FileNet Livelink Any other system

15 Architecture

16 Real-Time Access to Business Applications Access to real-time business data with OneBox 2008 Q4 Q Q Q Q Secure Real-time access to business information Q Q The Google Search Appliance with OneBox is our command line interface to our world adding more content and additional OneBox interfaces will only increase the value to our organization Danny Perri, BOC Gases

17 Google OneBox for Enterprise ① ② ⑤ ③ XML ④ Provider Server 1. User enters a query 2. OneBox trigger determines if the query is relevant to a OneBox module. 3. The appliance makes a secure REST call (https GET request) to the predefined OneBox provider, passing security credentials and other parameters. 4. The provider users the information to determine appropriate, user-specific, secure results to the query, and passes those results back to the appliance in XML. 5. The XML is transformed into HTML based on the XSL template provided in the OneBox module and presented to the user inline with their search results.

18 Google OneBox for Enterprise Real-time, secure access to information from the search box Triggers - Configurable to show OneBox results: Always On: the module is invoked for every query Keyword(s): the module is invoked in response to specific keywords Regular Expression: invoked when query matches a regular expression Providers Internal: Specialized search content in a separate appliance collection External: Modules from OneBox module gallery External: API enables you to create your own modules

19 OneBox Results Schema <OneBoxResults> <resultcode>result_code </resultcode> <Diagnostics>failure_reason </Diagnostics> <provider>provider_name </provider> <searchterm>query_escape </searchterm> <totalresults>total_results_escape </totalresults> <title> <urltext>results_title </urltext> <urllink>results_uri </urllink> </title> <IMAGE_SOURCE>image_uri </IMAGE_SOURCE> <MODULE_RESULT> <U>uri </U> <Title>title </Title> <Field name="name1 ">value1 </Field> <Field name="name2 ">value2 </Field> <Field name="namen ">valuen </Field> </MODULE_RESULT> </OneBoxResults>

20 Security Document Level Security Provide the right users with access to the right documents Common Security Protocols HTTP-Basic NTLM (v1, v2) LDAP Advanced Security Kerberos New! SSO - Oracle (Oblix), CA/SiteMinder X509 Certificates Custom Authentication & Authorization Support for SAML SPI Zero Sign-on

21 Access Control (NTLM, HTTP Basic, SSO, etc.) 1. User executes search for public and secure content (access=a) 2. User is prompted for credentials (if NTLM/Basic Auth & SSO, user is prompted for both sets of credentials) 3. Users credentials are sent securely to the search appliance 4. Google Search Appliance queries index for all possible results Results Index # URL Secure 1 /preso.ppt 2 /policyhtml /welcome/ n /customer.jsp ntlm http basic none sso x 5. Search appliance makes authorization requests of the host content servers with user s credential set Host servers respond with success or failure 7. Secure results restricted to user are filtered from search results Content Mgmt. File shares Database 8. Final search results (filtered) are presented to the user

22 Traditional search technology for millions of docs Disaster Recovery Server + + Patch Deployme nt + Managem ent Server Volume License Managem ent Server

23 Google Architecture: 10M documents in a box

24

25 Health Vine Simplicity Patients Immediate Family Community

26

27

28

29 Where s your GSA?? The State of Missouri s use of Google GSA

30 Where was Missouri? 16 Executive Agencies No common web search No unified way for citizen s or businesses find information about State Government.

31 Where is Missouri?? Centrally Managed Google GSA Front Ends and Collections provided to all State Government entities Common search across all State Government web content Reliable information now easily found by citizens and businesses

32