PoolParty - Thesaurus Server

Transcription

1 Semantic Web Company PoolParty - Thesaurus Server PPT - User Guide

2 Table of Contents Introduction... 6 Thesaurus Basics... 6 Why to Create Your Own Thesaurus with PoolParty... 7 Semantic Applications Using PoolParty Thesauri... 8 Thesaurus Management Made Easy... 9 PPT Overview PP Client & System Requirements PoolParty, SKOS, RDF and URIs PPT's Graphical User Interface PoolParty's Toolbar PoolParty's Hierarchy Tree PoolParty's Details View Thesaurus Management Working With PPT Projects Creating Projects Project Details Autosave Projects Deleting Projects Working With Concept Schemes and Concepts Editing Details Creating Concept Schemes Concept Scheme Details Deleting Concept Schemes Creating Top Concepts Removing Top Concepts Creating Concepts Concept Details Searching for Concepts Deleting Concepts & Subtrees Managing your Thesauri Creating Relations by Drag and Drop Move Concepts by Drag and Drop Merging Concepts by Drag and Drop Adding Relations Using Autocomplete , Semantic Web Company (SWC) 2

3 Translating Labels in Multilingual Thesauri Adding Notes to your Concepts User Rights Management Roles Groups User Groups Corpus Management Create a Document Corpus Upload Documents to a Corpus Upload documents from your local drive Grab documents from html pages Paste a text to add it to your documents Viewing the Documents of a Corpus Documents Details dialogue Analyse Documents in your Document Corpus Candidate Terms List Extracted Concepts List Extracted Terms List Blacklist Custom Scheme Management Using predefined Custom Schemes Defining Custom Schemes Using Custom Scheme Importing predefined Custom Schemes Defining a Custom Scheme Add Classes Add Relations Add Attributes Custom Schema Details View Using a Custom Scheme Apply a custom class Insertion of relations and attributes The User Administration Create a new user User Roles and Groups in PoolParty Roles , Semantic Web Company (SWC) 3

4 Groups Manage existing users Add new user groups Linked Data Management Linked Data Publishing with PoolParty Displaying Available Projects in the LD Frontend Displaying Project Information in the Linked Data Frontend Displaying Concept Schemes as Linked Data Displaying Concepts as Linked Data Linked Data Enrichment with PoolParty Lookup Data from the Semantic Web Select a Resource and the Type of Mapping Copy Data from a Linked Resource Handling of Incorporated Data in the Linked Data Frontend The PoolParty Frontend Wiki Frontend SPARQL Endpoint Error Handling Advanced Thesaurus Management Import, Export and Reporting with PPT Exporting a Project Exporting Project Data Exporting Concept Schemes or Subtrees Importing Projects or Concept Schemes Importing Subtrees Backing Up a Project Available Formats for Import and Export Prerequisites for Importing non-poolparty SKOS Thesauri or Zthes thesauri Import Excel Taxonomies Generating Reports with PoolParty Additional Information for the Project and its Concepts Displaying the Concept Index Logging Information for a Project SPARQL endpoint of a project Displaying Triples Visualisation of a Project , Semantic Web Company (SWC) 4

5 Autopopulate your Thesaurus Harvest Linked Data to Generate a Seed Thesaurus Categorize Concepts Autopopulate Based on Categories SPARQL Lists and Collections Collections SPARQL lists Quality Management in PoolParty Define Quality Settings Create a Quality Report Approval Workflow Workflow Initialization Using the Workflow Initialize the Approval Workflow The workflow process PoolParty History History on the project level History on the concept level Advanced PoolParty Configuration Linking PoolParty Projects Link Projects on a PoolParty server Link Matching Concepts in Different Projects Adding Linked Data Sources View Available Linked Data Sources Create an Autocomplete Index The Admin Dashboard Automatic Snapshots Restore Projects from a Snapshot Troubleshooting PPT does not load after Update to Firefox , Semantic Web Company (SWC) 5

6 Introduction This manual is intended for users of the PoolParty Thesaurus Server (PPT). It mainly serves as a guide on how to work with PPT, aiming to be useful especially for a non-technical audience. All functionalities of PPT are outlined and various ways to use these features are described. You can also find some basics on concepts like thesauri and technologies like SKOS. The PPT - User Guide contains the following chapters: Thesaurus Basics Why to Create Your Own Thesaurus with PoolParty PPT Overview Thesaurus Management Corpus Management Linked Data Management The PoolParty Frontend Advanced Thesaurus Management Advanced PoolParty Configuration Troubleshooting As we try to keep this manual as comprehensible and easy to work with as possible, we welcome any of your suggestions for improvement so just comment or write to support@poolparty.biz. Thesaurus Basics A thesaurus is a special kind of a controlled vocabulary as it consists of a collection of concepts. A concept in a thesaurus is more than merely a word, but it is a 'unit of thought', which can have several labels, i.e. different words that are associated with it. These might be synonyms, abbreviations, spelling variants, and other words that can be used to refer to that concept. All this information can be stored with a concept in a thesaurus. Beyond that a thesaurus is also structured, as it describes the relationships between its concepts. 2014, Semantic Web Company (SWC) 6

7 Figure 1 Relations between concepts Concepts are arranged in hierarchical or associative relationships. Hierarchical relationships are used to indicate concepts which are narrower and broader in scope, e.g. in a geographical thesaurus one expects to have concepts for countries and cities and a structure that declares which country is a super-class of which cities. An associative relationship is of a more general nature, it can be used to indicate any kind of relation between concepts. Concepts and their relations are explained in greater detail by means of examples and visualisations in the following sections. Wikipedia sums up the uses for a thesaurus nicely: "In Information Science, Library Science, and Information Technology, specialized thesauri are designed for information retrieval. They are a type of controlled vocabulary, for indexing or tagging purposes. Such a thesaurus can be used as the basis of an index for online material." (Wikipedia) Why to Create Your Own Thesaurus with PoolParty PoolParty thesauri are used in varying industries like Finance, Public Sector, Telecommunications, Research, Pharma, Cultural Heritage and many more. In fact, any organisation with a demand for professional information management benefits from thesauri as organizational knowledge models while being equipped with a sophisticated insight about its existing domains. On our product website you can learn more about some different industry use cases. With PoolParty we designed a tool that makes it straightforward to create and maintain thesauri as knowledge models. To assure to provide the state of the art, the thesaurus language SKOS is used. It is especially designed to be used by domain experts without a Semantic Web background or special technical skills. It was conceived with various commercial applications for thesauri in mind and aims to facilitate these applications by 2014, Semantic Web Company (SWC) 7

8 offering a range of web services. In the following we elaborate on the use of thesauri in a corporate setting. Semantic Applications Using PoolParty Thesauri On top of PoolParty's currently developed service-interface a variety of semantic web applications can be realized, for example: annotation & tag recommender systems auto-complete and faceted browsing corporate bookmarking & social tagging corporate thesauri & controlled vocabularies recommender systems (similarity search) semantic search engines In a lot of content management systems the users can tag documents. While this turned out to be quite successful and is one of the key features of the 'Web 2.0', there is still a lot of room to improve this method. In a system with multiple users it is inevitable that they will use different tags to refer to the same concept. Using a thesaurus the system can consolidate synonyms, abbreviations, spelling mistakes and different tagging styles, thereby creating concepts instead of tags. Going a step further, a system can also apply text analysis algorithms to new content, discovering potential existing tags for it. Backed by a thesaurus these tag suggestion mechanisms become more powerful and help users to keep the tagging consistent, which makes finding documents easier. Inverse, by tracking suggestions for new tags the thesaurus could be adapted with new concepts as a quality assurance process to specify the content better. As an added benefit, tagging can be supported with a semantic autocomplete feature. With a regular autocomplete feature the system suggests words of phrases the user wants to type in without the user actually typing it in completely. With semantic autocomplete the user might also enter synonyms, which the system recognizes prompting it to suggest the concepts main label to the user. In the same way a thesaurus backed tagging helps to find documents. On the one hand searching is more efficient when tags are merged into concepts, as a user will find documents even when his search term is spelled differently than the tag of a relevant document. It is even possible to create advanced semantic search systems like faceted search. For an example of faceted search/browsing watch our demo search platform. Another example for a advanced semantic search system is a moderated search. An example for the latter is reegle a search engine for renewable energy and energy efficiency. reegle's search engine is based on a thesaurus and makes use of PoolParty services to provide automatic query expansion and moderated search mechanisms which help to refine search queries and retrieve more precise results. On the other hand the system can use concepts and their relationships to each other to calculate similarity between documents, thereby improving search results and their ranking. 2014, Semantic Web Company (SWC) 8

9 This can also be used to suggest documents that might be interesting to a user based on which content items he previously looked at, rated or otherwise interacted with. In this way an application can aid in serendipitous discovery of content relevant to the users' interests. Thesaurus Management Made Easy PoolParty's philosophy is to make the creation and maintenance of thesauri as easy as possible, without requiring any special knowledge or extensive training. The system's user interface was designed to be simple and intuitive to use, so any end-users could work effortlessly with it. PoolParty's thesaurus management interface is entirely web-based and offers user friendly drag and drop and autocomplete via AJAX, also a translation functionality for labels. But there's much more than a comfortable user interface. PoolParty helps to semi-automatically expand thesauri as you can use it to analyse documents relevant to your domain in order to glean candidate terms for your thesaurus. If you are starting from scratch and don't have any controlled vocabularies available, define the main categories of your domain and we can lend you a hand by creating a seed thesaurus with SKOSsy. Figure 2 PoolParty thesaurus management workflow PoolParty breaks with the conventional idea of isolated thesauri, offering the possibility to make your thesaurus available as linked data and connect it to related data on the Semantic Web. Using this innovative 'Linking Open Data' approach you are ready to receive relevant context information about your concepts. Further you are able to connect different thesauri or just parts for gaining integrated views on your domain. The described workflow is depicted in the image above. For a deeper understanding of the Linked Data and Linking Open Data methodology see Price Waterhouse Coopers Technology Forecast, Spring 09 or visit , Semantic Web Company (SWC) 9

10 PPT Overview In this section you get an overview on PPT's system requirements, thesaurus construction with SKOS and of the PPT user interface: PP Client & System Requirements PoolParty, SKOS, RDF and URIs PPT's Graphical User Interface For a demo go to our PoolParty thesaurus server instance on and login with your access credentials. If you haven't got access credentials yet you can register for a demo account here. PP Client & System Requirements Client Side PoolParty works with the following browsers: Chrome (25+) Firefox (3.6+) Safari (5+) PoolParty has been designed for a screen resolution of 1024x768 or higher. It is recommended to have a DSL connection to the Internet, otherwise response times might be a bit slow. Server Side If you want to run PPT on your own server, you will need 64bit GNU/Linux Server (tested distributions: Debian 6, CentOS 5 or 6, Red Hat Enterprise Linux 5 or 6, Ubuntu LTS) or 64bit Windows Server (tested distributions: Windows Server 2008 R2) 64bit build of Sun/Oracle Java Runtime 7 64bit build of Apache Tomcat 6 System Requirements depend on the used Product Bundle. PP basic server: minimum 2 GB RAM dedicated to PPTs Apache Tomcat (4 GB are recommended) PP advanced server: minimum 4 GB RAM dedicated to PPTs Apache Tomcat (8 GB are recommended) PP power tagging: minimum 4 GB RAM dedicated to PPTs Apache Tomcat (8 GB are recommended) PP enterprise server: minimum 8 GB RAM dedicated to PPTs Apache Tomcat (16 GB are recommended) PP semantic integrator: minimum 8 GB RAM dedicated to PPTs Apache Tomcat (16 GB are recommended) 2014, Semantic Web Company (SWC) 10

11 A PP advanced server with the recommended configuration above can store up to concepts together with 10 labels and 5 relations in average per concept. The concepts can be distributed over two or more projects. We recommend not to exceed the number of concepts per project. If all data is stored in memory we recommend not to store more than 10 projects per server. PoolParty, SKOS, RDF and URIs This list of the most important SKOS classes and properties used by PoolParty is relevant for advanced users or programmers who need to work with the RDF representation of a project. We also give a very short introduction to the Semantic Web technologies behind SKOS. For more comprehensive information on the Semantic Web, please go to W3C s Semantic Web Activity site and pick a presentation, which fits your interests. SKOS is based on the Resource Description Framework (RDF), which is one of the fundamental Semantic Web specifications. It was developed within the W3C standards framework. RDF uses graphs as its data structure. This means that each concept is a node and edges connect these nodes to create a graph. The image below displays data of a thesaurus presented as a graph. The graph has the concept 'Germany' as its central node. Several edges connect this node to its labels and definition as well as to other nodes. All edges are typed, thereby indicating which kind of relationships exist between the nodes they connect, e.g. the node 'Germany' is connected to the node 'Hamburg' via skos:narrower. The edges are called 'properties' in RDF. They can also connect a node with a literal, in the case of SKOS these are the labels, definitions or scope notes. Figure 3 A SKOS graph with the concept Germany' as the node in the center 2014, Semantic Web Company (SWC) 11

12 Each statement in RDF encodes information as so called 'triples'. A triple always has the form subject > predicate > object, e.g. 'Germany' > skos:narrower > 'Hamburg'. Each property and class in SKOS and each concept in PoolParty has a uniform (unique) identifier, also called URI. In the case of SKOS these are always HTTP URIs, in the case of PoolParty they can either be URNs or HTTP URIs. The complete URIs of SKOS properties or classes can be formed by expanding the namespace prefix 'skos:' which is just a shortcut for the base URI The complete URI for e.g. skos:narrower is The following table shows elements from the SKOS definition used by PoolParty: PoolParty SKOS Classes Concept Scheme (e.g. a thesaurus) Top Concept/Concept Collection The SKOS counterpart for a PoolParty concept scheme is skos:conceptscheme. In SKOS both are represented by the same class, namely skos:concept. A top concept is connected to a concept scheme (thesaurus) via the skos:hastopconcept/skos:topconceptof relation. Represents a skos:collection. Collections are labeled groups of concepts. A concept becomes part of a collection via the skos:member relation. Lexical properties Preferred Label, Alternative Label, Hidden Label skos:preflabel, skos:altlabel, skos:hiddenlabel are used to add lexical labels to concepts. Relation properties Broader/Narrower, Related Exact Match, Close Match, Broader Match, Narrower Match, Related Match skos:narrower, skos:broader and skos:related are used to create semantic relations between concepts. skos:exactmatch, skos:closematch, skos:broadmatch, skos:narrowmatch and skos:relatedmatch are used to create semantic relations to linked data resources, or to linked projects and may be used to create relations between concepts in different concept schemes Documentation properties Scope Note, Example, Definition Editorial Note, History Note, Change Note skos:scopenote, skos:example and skos:definition are used to add information about the meaning and the use of a concept. skos:editorialnote, skos:historynote, skos:changenote are used to add information about the maintenance, the history and changes made to a concept. Notation properties Notation skos:notation is used to add a classification code to a concept. 2014, Semantic Web Company (SWC) 12

13 A PoolParty project has no counterpart in SKOS. It is a PoolParty specific container, used to group concepts schemes, in PoolParty concept schemes are equated with thesauri. PoolParty uses more classes and properties from SKOS and also other schemas and ontologies than those listed above. Further details about this goes beyond the scope of this manual, so we restrict the list to the most important classes and properties for describing thesauri, which are also used in the other examples in this manual. Semantic technologies open up the possibility to use an RDF reasoning engine on thesauri to draw inferences, e.g. since narrower and broader relations can be transitive, a reasoner could list all narrower concepts of their parent as being also narrower concepts of their grandparents, e.g. 'Berlin's broader concepts are 'Germany' as well as 'Western Europe'. PPT's Graphical User Interface The image below shows PPT's graphical user interface. It is divided into three areas: Toolbar Provides the main menu, a search function and the document processing icons. Hierarchy tree Displays the hierarchical structure of your project. Click on the boxes to select a concept scheme or a concept. Details view Displays detailed information available for the selected project, concept scheme or concept. The available information is grouped in tabs. You can use the tab bar to switch between the different views. Figure 4 PoolParty GUI 2014, Semantic Web Company (SWC) 13

14 PoolParty's Toolbar The PoolParty Toolbar provides the following functions: Figure 5 PoolParty Toolbar Main menu The PoolParty menu provides functions for managing Projects and Document Corpora, Tools for thesaurus management e.g. quality reports, the Options menu where you can define e.g. the Themes of the interface or the language used for autocomplete, the Advanced menu for the PoolParty configuration. Click the PoolParty umbrella on the top left corner to get information about PoolParty, on the right section the logged in user is displayed, the Help menu and the Logout button is available. The Advanced menu is only available for users that have been assigned to the PoolParty Admininistrator role. Thesaurus Search Via the thesaurus search you can search for concepts in a thesaurus via autocomplete. After typing 3 characters you will get a list of suggestions you can choose from if the search string matches a preferred, alternative or hidden label in your thesaurus. By Selecting an entry you will jump to the concept in the PoolParty's Hierarchy Tree and the concept information is displayed in the PoolParty's Details View. Pressing the Enter key brings you to the list of matching concepts in the concept search. Notification area For each project an autosave function is enabled by default which creates automatic snapshots of the whole project in a defined interval. The snapshot information shown in the notification area provides information whether the autosave function works correctly and if snapshots of the project have been created. Icon bar Via the icon bar you can switch between the following functionality: Thesaurus Management Corpus Management Custom Schemas User Administration PoolParty's Main Menu The following table lists all items of PoolParty's main menu: Left Menu Menu Item Description 2014, Semantic Web Company (SWC) 14

15 About Menu Item Description Opens a window with some basic information about PoolParty. Here you can also find version and license information about your PoolParty server. Team Contact News Opens a window listing all people involved in the development of PoolParty. Opens a window with contact information for PoolParty. Opens an RSS feed with news about PoolParty in the details view. This feed is also displayed when you log into PoolParty. This option is activated by default but can be deactivated.quick Project Create Project Opens the Create Project dialogue. The Create Project menu entry is only available for users who are PoolParty Administrators. Open Project Quick Open Delete Current Project Import Export Reports Close Project Opens the Open Project dialogue. Displays a list of all available projects for the user. Deletes the currently open project. The Delete Current Project menu entry is only available for users who are PoolParty Administrators. Opens the Import Project or Concept Scheme dialogue. Opens the Export Project dialogue. Opens the Reports dialogue. Closes the currently open project. Corpora Create Corpus Refresh Extraction Model Opens the Create Corpus dialogue. Refresh the model (per language) used for term extraction for this project. Changes made to a project are only taken into account for term extraction after refreshing the extraction model. Tools Collapse All Concept Index Quality Report Autocomplete Index SPARQL Lists Collapses all open branches in the hierarchy tree. Opens the concept index of your thesaurus. Starts the creation of a quality report for the project. Lets you choose to enable or disable the autocomplete index for the project. Lets you create SPARQL lists for the project. 2014, Semantic Web Company (SWC) 15

16 Menu Item Delete Project Opens the Delete Project dialogue. Description The Delete Project menu entry is only available for users who are PoolParty Administrators. Options Display Languages Lets you choose the languages displayed for concepts and concept schemes. You cannot deselect the default language. Autocomplete Language Themes Lets you choose the language to be used for autocomplete. You can only select one language for autocomplete. Lets you choose the PoolParty theme to be used. Currently only the "Blue Bird" theme used for screenshots throughout the manual is available for PoolParty 4. SKOS View Lets you switch between the Basic and Advanced view of the SKOS tab. Advanced The Advanced menu is only available for users who are PoolParty Administrators. Initialize Workflow Custom Schema Linked Projects Subproperties Linked Data Administration Quality Settings Opens the Initialize Workflow dialogue. Opens the Create Custom Schema dialogue. Opens the Linked Projects dialogue. Opens the Subproperties dialogue. Opens the Linked Data Sources dialogue. Opens the Quality Settings dialogue. User Administration Admin Dashboard Opens the User Administration dialogue Opens the PoolParty Admin Dashboard. Right Menu Menu Item <username> Change Password Description Displays the name of the logged in user. Opens the Change Password dialogue. Help Online Help Opens the online help for this PoolParty version. 2014, Semantic Web Company (SWC) 16

17 Menu Item Download Help Manual Logout Description Opens the download link for a PDF version of the PoolParty - User Guide. Logs you out of PoolParty. PoolParty's Hierarchy Tree In the image below you can see how a concept hierarchy looks like in PoolParty. The nodes of the hierarchy tree are colour coded and represent projects, concept schemes (thesauri) and concepts. The following list describes them: Figure 6 Concept hierarchy tree in PoolParty Project (blue) The topmost node represents the current PoolParty project. It is a container used to hold one or more thesauri. Click on it to get the details view of the project where you can view or edit metadata for the project and see various statistics about it, e.g. total number of concepts and labels. Concept schemes (purple) A concept scheme can hold multiple top concepts and concepts. Click on it to get the details view of the scheme where you can view or edit its metadata. Top-Concepts (dark green) and Concepts (green) The concepts on the first level below a concept scheme are called top-concepts, which in turn can hold other concepts. Each concept can have children so called sub-concepts. This concept hierarchy is formed by stating that concepts are in a 'narrower' or 'broader' relationship. By stating that the concept 'Germany' has a broader concept 'Western Europe', we say that the latter is its parent. On the contrary the narrower concepts of 'Germany' are its sub-concepts and their total number is shown in brackets. Click on any 2014, Semantic Web Company (SWC) 17

18 concept or top-concept to get the details view of the concept where you cand view or edit its metadata. Another possibility to link concepts to each other is saying that concepts are 'related'. This doesn't put concepts in a hierarchical relationship, but in an associative one. It is rather a semantic association which can be used to express any kind of relation between concepts on any level in the tree. One might for example say that the concept 'Germany' from the Regions concept scheme is related to the concept 'University of Leipzig' in the Places concept scheme. Related concepts are not displayed in the hierarchy tree but in the details view of the concepts. If you opened too many branches of your project's hierarchy tree and you want to close them all at once, you can do that by selecting 'Collapse All' from the Tools menu. Polyhierarchical Structure in a Thesaurus Before you start your own thesaurus project it is important to notice the difference between a thesaurus and traditional folder trees as we all know from e.g. Windows Explorer. Although represented as a tree, a thesaurus is not just a simple tree but it is a semantic network. An example is shown in the image below e.g. a concept labeled 'Berlin' can be a sub-concept of 'Capitals' as well as a sub-concept of 'Germany'. In this case the 'Berlin' concept exists only once in the system (represented by exactly one URI) although displayed in the tree at various positions. Figure 7 Polyhierarchical structure in a thesaurus 2014, Semantic Web Company (SWC) 18

19 PoolParty's Details View In the details view you can find, add and edit detailed information for the selected node (project, concept scheme, concept) in the hierarchy tree. All data you enter in PoolParty is validated and you get immediate feedback when you try to enter data that is not allowed for the respective field type. Located at the top of the details view underneath the name of the selected node you can find its identifier. The uniform identifier is the URI or URN of the selected project, concept scheme or concept. The type and form of the identifier is defined when creating the project. For projects with URIs it is displayed as a link to the respective concept schemes and concepts in the Linked Data Frontend. All data you enter in PoolParty in the details view or via other options is validated to prevent inconsistencies. Figure 8 Details view of a concept in PoolParty The available information in the details view is grouped in tabs. The number and type of tabs depends on the configuration of the project and the type of node that is selected in the hierarchy tree. Tabs in a projects details view: Metadata & Statistics Metadata, statistic and settings of the project and links to the SPARQL Endpoint and the HTML Frontend (default tab). Concepts Provides the Concept Search tab and the Concept Index tab. 2014, Semantic Web Company (SWC) 19

20 Triples Shows all triples related to a concept selected from the project. History information for the project. SPARQL Provides a SPARQL endpoint for the project. Autopopulate Displays incoming links from mappings to this project in other PoolParty projects on the server. Quality Report Shows the quality report information if a report has been calculated for the project. Tabs in a concept schemes details view: Metadata General information for the concept scheme. Triples Shows all Triples for the concept scheme <Custom Schema tabs> Next to the Triples tab 1...n tabs for defining custom properties for concept schemes are displayed depending on how many custom schemas with properties for concept schemes are defined on the server. Tabs in a concepts details view: Details SKOS SKOS information for the concept (default tab). For the SKOS tab a Basic view (default) and an Advanced view providing more information is available. You can switch between those views via the Option > SKOS View menu. <Custom Schema tabs> Next to the SKOS tab 1...n tabs for defining custom properties for concepts are displayed depending on how many custom schemas are defined on the server. Notes SKOS notes defined for the concept. Documents Documents tagged with this concept. Linked Data Information on and handling of linked data for the concept. Triples Shows all triples related to the concept. Visualization Shows a visualization (concept map) of the concept and its relations. Quality Report Shows the quality report information for this concept if a report has been calculated for the project. 2014, Semantic Web Company (SWC) 20

21 History Shows all history entries for the selected concept. Validation of Entered Data All entered data in PoolParty is validated to prevent you from adding invalid data. When you start typing in a field the background is highlighted green as long as you do not enter a character that is not allowed. Figure 9 Validation - Valid entry Whenever a character which is not allowed was entered, the background of the field will be highlighted red and a message is displayed telling you which characters are allowed or not allowed in this field. Figure 10 Validation - Invalid entry Thesaurus Management In this section you find information on the basic thesaurus management functions of PoolParty: Working With PPT Projects Working With Concept Schemes and Concepts Managing your Thesauri User Rights Management Working With PPT Projects A PPT project is a container used to hold one or more concept schemes (thesauri). After logging in you can open an existing project by clicking the Load Project entry from the Project menu.. This opens the Open Project dialogue where you get a list of all projects including additional information like subject, creator or creation date. You can search over all projects or sort by column. To open a project double click on it or select the project and click the Open Project button. 2014, Semantic Web Company (SWC) 21

22 Figure 11 Opening a project - dialogue Additionally you can open projects via the drop-down list that appears when you move over the Load Project entry from the Project menu. Figure 12 Opening a project - drop down Always when opening a project a check is made if the data in the project is valid. If any changes in the data to the last status (status at last logout) is detected, PoolParty assumes that there is something wrong and a message is displayed. In this case the autosave mechanism of PPT is disabled. You should check your project and contact your PoolParty administrator to restore from a snapshot created by the autosave mechanism of PoolParty. Figure 13 Validity check information You can also create new projects, edit project details and delete a project. 2014, Semantic Web Company (SWC) 22

23 When you finished your work, you can log out of PoolParty in the Project menu by selecting 'Logout'. If you remain idle for more than 30 minutes, PoolParty will automatically log you out. Creating Projects To create a new project, select 'Create Project' in the Project menu. The New Project dialogue appears and you can select if you want to: Create a new project or Create a project from a previously exported project Create a New Project Figure 14 New Project - Select creation type If you choose to create a new project you have to add the projects metadata in the Metadata tab of the New Project dialogue. You have to enter a title and a subject for your project and you can add additional information about the project. Clicking Next brings up the language selection settings. Figure 15 New Project - Metadata 2014, Semantic Web Company (SWC) 23

24 You can change the meta information of your project later in the details view of your project. New Project - Languages Scroll through the list of available languages or type the first letters of your desired language to select the 'Default language' for the project. It will be used as default for displaying the labels of concepts. You can add more languages by selecting them and clicking on the -> button and remove them with the <- button (double clicking works as well). The first language you select will be marked green and is defined as default language for the project. You can change the default language by selecting a language an clicking the Set Default Language button. The languages are divided in two groups so the most often used languages are on top and can be easily selected. You have to choose at least one language as default language for the project. All languages installed on the PoolParty server are available. Figure 16 New Project - Languages Theses settings cannot be changed after the creation of a project but you can view the project settings in the details view of your project. If you want to add languages to an existing project or change the default language, export your project, delete the project and create it as a new project from the export. There you can adjust the language settings to your needs. 2014, Semantic Web Company (SWC) 24

25 After choosing your project's languages, click Next to define access rights for your project. New Project - Usergroups The last screen is for selecting the usergroups which should have permission to view and edit a project. Selection and de-selection works as with languages. If the 'Public' group is selected, anyone who has access to this PoolParty server can view and edit this project. Otherwise access is restricted to users of the selected groups. For more information on this topic, read the user rights management section of this manual. Figure 17 New Project - Usergroups You can change the permissions also later in the details view of your project. Click on Create Project and your project will be created. The project details view will be displayed and the project will have a tree for 'Free Concepts'. Now you are ready to create thesauri and new concepts or import an existing thesaurus. If you press the Advanced button you are directed to the Advanced tab of the New Project dialogue and can define advanced settings for your project. Advanced Project Settings In the Advanced tab of the New Project dialogue you can define advanced settings for a project like: Used URI pattern 2014, Semantic Web Company (SWC) 25

26 Repository Type Autosave Interval Quality Settings Figure 18 Advanced project settings Used URI pattern PoolParty offers the possibility to give access to a project as linked data. In the Linked Data tab the definition for the URI pattern for the project is managed. The following parameters are available: Base URL Represents the first part of the created URIs. The BaseURL has to start with ' 2014, Semantic Web Company (SWC) 26

27 followed by the domain that should be used for the linked data URIs. The URL of the PoolParty server is used as default value. Project identifier Represents the second part of the created URIs and is used to distinguish between different projects on a PoolParty server. The project name is defined as default value. Spaces in the project name are deleted. ID Generation Represents the last part of the created URIs and defines the method for creating unique identifiers for the concepts. The following methods are available: Increment (Default) You need to define a starting number from which the incrementation starts. All concepts get a single incremented number starting at the defined starting number (Default: 0). UUID All concepts are represented by their 'Universal Unique Identifier' (UUID). From preflabel All concepts are represented by the preferred label of the default language of the project. If two concepts with the same preferred label exist, a number is added to the preferred label (e.g. 'Label_(1)'). If linked data publishing is properly configured on your server and you enter the URI of a concept in a browser you will get to PoolParty's Linked Data frontend. To provide public availability of the created linked data, the defined BaseURL must exist and point to the PoolParty server. How to configure a web-server for linked data publishing is described in the Administrator Guide. Repository Type This is the type of triple store (RDF store) in which your concepts, relations, etc. will be stored. There are three options: Native Repository (Default) All triples are stored in PoolParty's file system. As a rule of thumb you usually should use this option. Memory All triples are stored in PoolParty's server memory. This is needed when you have large thesauri with many thousands of concepts and the performance of e.g. the autocomplete feature is crucial. Please note, that if you have many projects using memory repositories your PoolParty server needs enough memory. Autosave Interval For all repositories an autosave function is enabled by default taking a snapshot of the project in the defined interval. Via the Autosave project select box you can choose the snapshot interval - the following options are available: disable 5 min 10 min (Default) 2014, Semantic Web Company (SWC) 27

28 15 min 30 min Clicking Create Project creates a project with the defined advanced settings. It is not recommended to disable snapshots for a project. In this case you cannot restore a project if the repository gets corrupted or deleted. All theses settings cannot be changed after the creation of a project but you can view the project settings in the details view of your project. Quality Settings Defines the quality settings for your project used for generating quality reports but also determining what rules are used when generating content. The following settings are available: Default (Default) Automatic Indexing Classification Document Suggestions Restrictive Checks Disabled You can export your project, delete the project and create it as a new project from the export. This way you can adjust all those settings to your needs. Create a Project from an Export If you have exported your project you can create a project from the exported file. That way it is possible to copy a whole project on one server or move a project with all it's data to another server. If you select the 'Create Project from Export' option in the first step of the New Project dialogue you can select the export file in your file system. Figure 19 Create project from export 2014, Semantic Web Company (SWC) 28

29 When you click Next the project information is loaded from the export file and the Metadata tab of the New Project dialogue is displayed. All settings of the exported project are predefined and you can go through the steps of project creation and accept or change the settings. Figure 20 Edit the projects metadata Via the export project and create project from export function you can e.g. change the language settings of a project or change the repository type of a project. Project Details After creating a project, when you open a project or when you click the project node in the hierarchy tree you open the default details view of the project (the Metadata & Statistics tab). It is divided into four main parts: UUID Below the project title the unique identifier (UUID) of the project is displayed. The identifier is used for several different functions e.g. part of the snapshot names or as name of the extraction model. Metadata Displaying metadata for this project like title, subject, creation date, creator etc. You can edit parts of the projects metadata clicking the Edit icon. Languages Displaying the languages of the project defined when creating the project. 2014, Semantic Web Company (SWC) 29

30 Statistics Displaying statistical information for the project like the number of concepts or preferred labels etc. Settings Displaying project settings: Quality Setting Displaying the quality settings for your project used for generating quality reports. You can edit the setting clicking the Edit icon. Usergroups Displaying the security settings of the project. You can edit the security settings clicking the Edit icon. Document Processing Displaying if document processing has been enabled for the project. If document processing has not been enabled when creating the project you can enable it here. URI Generation Displaying the URI generation pattern defined when creating the project. Repository Type Displaying the repository type defined when creating the project. Via the PP Browser button in the upper right corner you can access the PoolParty Browser where you can find the SPARQL Endpoint and the Wiki Frontend of the project. Via the LD Frontend button you can access the Linked Data frontend of the project. Figure 21 Project details - Metadata & Statistics tab 2014, Semantic Web Company (SWC) 30

31 The project metadata is stored in a separate graph following the VoID (Vocabulary of Interlinked Datasets) schema. In addition project data can be provided in the ADMS (Asset Description Metadata Schema) schema defined by the EU. Project Data Stored as VoID Graph All metadata of a project and some additional information is available as a VoID graph. VoID is an RDF vocabulary for the description of (linked) datasets. Basically all metadata available for a project is available in the VoID graph but also some statistical information and some other information related to the projects. This information can be used for displaying project information in the Linked Data frontend of PoolParty but it can also be accessed via the SPARQL endpoint of a project. The following table shows all data available in a projects VoID graph: Element (PP) Property (VoID) Description Metadata Title dct:title Title of the project. Subject dct:subject Subject of the project. Description dct:description Descriptions of the project. Author dct:creator Creators/Authors of the project Publisher dct:publisher Publishers of the project. Contributor dct:contributor Contributors of the project Created dct:date Creation date of the project Statistic Information swc:numberofconcepts Number of Concept Schemes swc:numberofconceptschemes Number of Concepts Additional Information void:datadump void:sparqlendpoint void:vocabulary void:feature Link to the exports made to the server. Linkt to the SPARQL endpoint of the project. Used vocabularies (SKOS). Available serializations. 2014, Semantic Web Company (SWC) 31

32 Project Data Stored as ADMS Graph When you switch to the ADMS subtab of the Metadata & Statistics tab of a project you can define ADMS information for you project. This will be available when you publish the project as linked data or export the project data. All data will be stored in a separate ADMS graph. You can create and delete different versions of ADMS metadata. The definition is divided over several tabs: Metadata Data is retrieved from the project metadata and cannot be changed in the ADMS subtab. Version Allows you to define a version note, the metadata language and the status following the ADMS specification. Publisher Data is retrieved from the project metadata and cannot be changed in the ADMS subtab. Distribution Data is available if a export for this project exists. You need to use the export to server function. Autosave Projects Figure 22 ADMS definition for a project During project generation an autosave interval for a project is defined and snapshots of a project are generated in the defined interval. Information is displayed in the header of the PoolParty Backend whether the creation of snapshots was successful. This enables you to detect if the autosave feature works properly and you can recover a project if anything went wrong. 2014, Semantic Web Company (SWC) 32

33 Figure 23 Snapshot information If a snapshot could not be saved on the disk, a red colored error message will appear and you should contact your system administrator to locate the problem. Details on the autosave and recovery process can be found in the "Advanced PoolParty Configuration" section of this guide. Even if the autosave function is enabled for a project it is strongly recommended to backup a project regularly. Deleting Projects To delete the currently opened project select 'Delete Current Project' in the Project menu. The Delete Project dialogue opens asking you to confirm the process. Figure 24 Deleting the open project If you want to delete another project from your PoolParty server or delete several projects in a row select 'Delete Project' from the Tools menu. The Select Project dialogue appears showing you all projects you are allowed to access according to your assigned user groups. When you select a project and click the Delete Selected Project button the Delete Project dialogue opens asking you to confirm the process. After finishing the process you can continue to select and delete projects or close the Select Project dialogue. Make sure to export and back-up your project your projects if you want to keep them for further use. Working With Concept Schemes and Concepts PPT offers a multi user environment to enable collaborative editing of thesauri. In this section you find information on working with concept schemes and concepts: Editing Details Creating Concept Schemes Concept Scheme Details Deleting Concept Schemes Creating Top Concepts 2014, Semantic Web Company (SWC) 33

34 Removing Top Concepts Creating Concepts Concept Details Searching for Concepts Deleting Concepts Deleting Subtrees Concurrent editing is handled in a 'last in wins' way. So if two users edit the same concept scheme or concept at the same time the changes that were stored last are used. Editing Details All information for a selected concept scheme or concept can be edited in the details view. You have different ways of adding, editing or deleting details depending on the type of property. 1. To edit labels or documentation properties click on the pen icon to activate inline editing. 2. Clicking the + icon lets you add new labels or documentation properties or relations. 3. Click the link icon to add relations to your concept scheme or concept. Via autocomplete you can search for existing concepts. 4. Click the x icon to delete labels, documentation properties or relations to your concept. Figure 25 Editing details 2014, Semantic Web Company (SWC) 34

35 Preferred labels cannot be deleted since exactly one preferred label has to exist per concept. Deleting relations will not delete the concepts themselves, thus deleting relations disconnects concepts that were previously related to each other via narrower, broader, related, exact or close match. ation to the hierarchy tree and become 'loose concepts' you cannot delete the last broader relationship of a concept. Creating Concept Schemes It's easy to add concept schemes (thesauri) to your project. Simply double click the project node in the hierarchy tree or select 'Create Concept Scheme' from the context menu to open the New Concept Scheme dialogue. The fields are filled per default with the definitions of the project. You can change the title and subject and add additional information for your concept scheme. Figure 26 Creating concept schemes You can edit this information later in the Metadata tab of the details view of the concept scheme. Concept Scheme Details After creating a concept scheme or when you click a concept scheme node in the hierarchy tree you open the details view of the concept scheme the Metadata tab. On the left side you find the top concepts linked to your concept scheme and you can add top concepts clicking the link icon and selecting a concept. On the right side you find the metadata for the concept scheme. You can add and edit metadata the same way you can edit a concepts details. For 2014, Semantic Web Company (SWC) 35

36 projects with URIs the URI of the concept scheme is displayed as a link to the respective concept schemes in the Linked Data Frontend. Deleting Concept Schemes Figure 27 Concept scheme details - Metadata tab If you want to delete a concept scheme you have to remove all it's top concepts. This prevents you from deleting concept schemes that have relationships you might have overlooked. For concept schemes without top concepts the Delete button is displayed. Clicking the button a dialogue appears asking you to confirm that the scheme will be deleted. Creating Top Concepts Figure 28 Deleting concept schemes Per double click on the concept scheme node you want to use as a parent in the hierarchy tree or selecting 'Create Top Concept' in the context menu you open the New Top Concept 2014, Semantic Web Company (SWC) 36

37 dialogue. When you create a top concept you can only define the name (preferred label) of the concept. You can add all other definitions for the concept later in the SKOS tab of the details view of the concept. Removing Top Concepts Figure 29 Creating top concepts For top concepts which are used as top concepts in another concept scheme or as a narrower concept of another concept in a concept scheme in your project the Remove as Top Concept button is displayed in the concept details view. Clicking that button removes the selected concept as a top concept but does not delete the concept itself. Creating Concepts Figure 30 Remove as top concept 1. There are three simple ways to create new concepts: 2. By double clicking a concept's node in the hierarchy tree. 3. By clicking the + icon in the 'Narrower' area of a selected concept. 4. Through a context menu which can be accessed by right clicking any node in the tree. Figure 31 Ways for creating concepts 2014, Semantic Web Company (SWC) 37

38 After selecting one way to create a concept, the New Concept dialog appears. You have to enter the name (preferred lable) for the concept, clicking Create Concept completes the procedure. Figure 32 Creating concepts After creating a concept you can edit all concept details and delete concepts. Concept Details The image below shows the default tab of the details view for a concept which is the SKOS tab. For the SKOS tab a Basic view and an Advanced view is available. In the Basic view only the basic SKOS properties for a concept are available. You can switch between the Basic and Advanced view via the Option > SKOS View menu. In this example we see the Advanced view for the concept 'Germany'. The main view for a concept is divided into four areas containing different information: Figure 33 Concept details view - SKOS tab 2014, Semantic Web Company (SWC) 38

39 The list below shows all SKOS properties available in the SKOS tab. The properties available in the Basic view are marked with *. Semantic relations Broader Concepts / Narrower Concepts* The 'broader' area of a concept's details displays its parent(s), while the 'narrower' area lists all the child concepts. Related* All concepts related (in some way) to the current one. Exact Matching Concepts Concepts of different concept schemes (thesauri) or linked data which are identical. Default setting for resources mapped to the concept via the linking open data feature of PoolParty. Close Matching Concepts Concepts of different concept schemes (thesauri) or linked data which are nearly identical. Broader Matching Concepts / Narrower Matching Concepts Concepts of different concept schemes (thesauri) or linked data which have a broader / narrower meaning. Related Matching Concepts Concepts of different concept schemes (thesauri) or linked data which are related in some way. Lexical Labels There may be only one preferred label in each language of a concept, while multiple alternative and hidden labels are allowed. Preferred Label* The main word or phrase that is used to identify the concept. Each concept must have a preferred label, but not more than one for each language. Alternative Label* Other words or phrases used to refer to this concept. This includes synonyms, acronyms, abbreviations, spelling variants and irregular plural/singular forms. Hidden Label* Labels that should be hidden for display purposes of the concept, but which still will be used for search operations. These are misspellings or otherwise deprecated terms for a concept. Notation Notation A classification code uniquely identifying the concept in the concept scheme. Document properties Scope Note* A description to clarify the usage and scope of a concept, i.e. information about what is or is not included within its meaning. Example An example to illustrate the usage and scope of a concept. Definition* A description of the meaning of the concept. 2014, Semantic Web Company (SWC) 39

40 Find more information about PoolParty and SKOS in chapter PoolParty, SKOS, RDF and URIs Searching for Concepts To find a concept quickly within an opened project, begin to enter a search string in the search bar. The system will look for concepts that contain that string in any label (also in alternative labels etc.) and will suggest matching ones. The example displayed in the image below shows that three concepts were found when 'feder' was entered as a search string. 'Germany' is being found also because it has an alternative label 'Federal Republic of Germany'. Selecting a concept from the drop-down list presented by autocomplete will expand the containing branch of the hierarchy tree and also will display the concept's details view. Figure 34 Autocomplete suggestion in the search bar To search for results starting with the search string use ^ (e.g. "^feder") to search for results ending with the search string use $ (e.g. "federation$") Alternatively it is possible to hit the Enter key after having entered a search string. In that case a search is done in the project and a list of all concepts in which the search string matches a preferred, alternative or hidden label is displayed in the Concepts > Concept Search tab of the project node. Via the filter section you can filter the list by label (all (default), only preferred, only alternative, only hidden). Here you can also determine whether the search string should be at the beginning of the concept label or should only contain it, and also if it should not be contained by any label at all. Figure 35 Concept search 2014, Semantic Web Company (SWC) 40

41 Per default, autocomplete and concept search only searches for labels in the default language of the project. Via Options > Autocomplete Language you can select the language of the project used for autocomplete. The active language is displayed in the search bar on the left. Autocomplete starts searching for concepts after typing at least three characters! Deleting Concepts & Subtrees To delete a concept, you can use the Delete Concept button or the respective menu entry in the context menu of the tree. When clicking it, a message appears which is asking you to confirm the deletion of this concept scheme or concept and all its narrower concepts. When you click Confirm the sub-tree is deleted and a message appears telling you the number of deleted concepts. Figure 36 Delete a concept Deleting a sub-tree deletes the concept scheme or concept and all narrower concepts independent if they are also narrower concepts somewhere else in your thesaurus project. So take care when you use this function. When you merge a concept the following information will be generated to indicate that the concept is deprecated: <URI-of-Concept> owl:deprecated "true" <URI-of-Concept> dcterms:contributur "user-who-deleted-the-concept" <URI-of-Concept> dcterms:modified "time-when-concept-was deleted" 2014, Semantic Web Company (SWC) 41

42 So you can retrieve deleted concepts via the SPARQL endpoint and you can make them available in the LD frontend. Managing your Thesauri PPT offers some additional functions that help thesaurus managers to easily maintain and develop their thesauri: Creating Relations by Drag and Drop Move Concepts by Drag and Drop Merging Concepts by Drag and Drop Adding Relations Using Autocomplete Translating Labels in Multilingual Thesauri Adding Notes to your Concepts Creating Relations by Drag and Drop Managing the thesaurus works like a charm by using PoolParty's ubiquitous drag and drop functionality. To express that there is a relationship between concepts, select one of the involved concepts in the tree on the left. In the example displayed in the image below, we selected 'University of Leipzig' from the concept tree. Then we dragged the node with the concept 'Leipzig' and drop it into the 'University of Leipzig's area for related concepts, thereby creating the desired link between the two concepts. Naturally this works bi-directional. Not only will 'Leipzig' show up in 'University of Leipzig's related concept's area but also 'University of Leipzig' will show up in 'Leipzig's related concept's area. Figure 37 Creating a relationship between concepts by using drag and drop When you drag a concept all areas where you can drop it are displayed in a darker grey (see image above). You can not only drag and drop concepts to create relationships to other concepts you can also drag and drop a concept to the Alternative Label or Hidden Label area of another concept to merge two concepts. 2014, Semantic Web Company (SWC) 42

43 Move Concepts by Drag and Drop If you want to move a concept from one place in your hierarchy to another you can simply press the Shift-button and drag & drop the concept as a narrower concept below the respective new root node. Figure 38 Move concept per drag and drop When you drag a concept, all areas where you can drop it are displayed in a darker grey (see image above). You cannot only drag and drop concepts to create relationships to other concepts, you can also drag and drop a concept to the Alternative Label or Hidden Label area of another concept to merge two concepts. Merging Concepts by Drag and Drop Let s assume you have two concepts that are actually the same, i.e. one concept's preferred label is actually a synonym of another concept. You can merge those concepts in the following way: 1. Select the concept with the preferred label you want to keep. 2. Simply drag the synonymous concept to the Alternative Label or Hidden Label area of the concept you want to keep. 3. A message appears asking you if you want to merge the two concepts. By confirming the message the two concepts are merged, automatically removing the obsolete concept from the project whereby the new, consolidated concept inherits all relations from the removed one. 2014, Semantic Web Company (SWC) 43

44 Figure 39 Merge concepts If you have accidently created two concepts with the same Preferred Label you can also merge them by dragging one concept to the Alternative Label or Hidden Label area of the other When you merge a concept the following information will be generated to indicate that the concept is deprecated: <URI-of-Concept> owl:deprecated "true" <URI-of-Concept> dcterms:contributur "user-who-deleted-the-concept" <URI-of-Concept> dcterms:modified "time-when-concept-was deleted" <URI-of-Concept> dcterms:isreplacedby "concept-it-has-been-merged-with" So you can retrieve merged concepts via the SPARQL endpoint and you can make them available in the LD frontend. Adding Relations Using Autocomplete Another way to create relationships between concepts is using PoolParty's autocomplete functionality. The image below demonstrates its capabilities. 1. Select one of the concepts you want to link. 2. Click the link icon in one of its semantic relations areas and start to enter a string. Immediately PoolParty will show you any concepts that have a label containing that string. This of course also works for alternative or hidden labels of the concept you are looking for. 2014, Semantic Web Company (SWC) 44

45 Figure 40 Using autocomplete to create relations between concepts Autocomplete starts searching for other concepts after typing at least three characters. You can select the language used for autocomplete in the Options menu. Translating Labels in Multilingual Thesauri PoolParty offers a linked data based translate function for the preferred labels of concepts in multilingual thesauri. Linked data based means that your concept has to be linked to a resource in DBpedia which is taken as a source for the translation. To check for possible translations click the Linguistics button above the label fields in the concepts details view (1). The Linguistics Services dialogue will open. If no link to a resouce in DBpedia exists you will be asked to create one. In our case a link exists and we can select the 'DBPediaTranlsation Service' (2). Possible translations will be suggested on the right in the Results field. Select the respective translation and (3) and click the Add selected > button (4) to add the translation to your concept. Clicking Save (5) will complete the process close the dialogue. Figure 41 Translate preferred labels of a concept 2014, Semantic Web Company (SWC) 45

46 Adding Notes to your Concepts PoolParty helps thesaurus managers in keeping track of the development of their thesauri offering the possibility to add notes to concepts. There are different types of notes available: Change Notes Notes which add information about a modification to a concept. Editorial Notes Notes for an editor, translator or maintainer, e.g. to discuss possible meanings of a concept History Notes Notes about the past state/use/meaning of a concept. You can add and display notes selecting the Metadata tab of a concept. The Metadata tab holds two sub-tabs: the Metadata subtab is displayed per default and displays information about the history of a concept and the Notes subtab. In the Notes subtab you can set a filter to display notes added to the concept. Per default all notes are displayed. You can filter notes per note typ, author and/or date. Figure 42 Displaying notes To create a new note click the respective button. The New Note dialogue appears. You can select the note type and add a title and a comment. When you click the Create Note button the note is added to the concept. 2014, Semantic Web Company (SWC) 46

47 User Rights Management Figure 43 Adding notes Creating users in PoolParty has to be managed via the User Administration. In this process each user gets assigned roles and groups that handle his access to projects. Only a Superadministrator can access the User Administration and create and manage users and user groups. The rights for a project are set while creating a project by assigning user groups and/or the Public role to a project. A user can only assign user groups to a project he is a member of. Only users that are in at least one of the user groups assigned to a project are allowed to view and edit the project. You can change the assigned user groups of a project editing the User groups section in the projects details view. Figure 44 Change user groups of a project 2014, Semantic Web Company (SWC) 47

48 Roles In PoolParty the following roles exist: PoolParty User This is the default role that has to be assigned to every user to be able to log into the PoolParty backend. PoolParty Administrator The Administrator role allows to create and delete projects for the assigned groups and gives access to the Advanced menu where several advanced configuration functions are available. Super Administrator The Superadministrator role allows access to the User Administration and the Admin Dashboard. Wiki Editor The Wiki Editor role allows only access to the Wiki view of a project. Users with this role cannot open a project or take any other action in the backend. Wiki Editors have also to be assigned to the respective user group of a project to be able to view and edit the project in the Wiki view. The behaviour of the Wiki Editor role only works that way if the frontend access level for the server are set to 'Login'. A User should be whether PoolParty User or Wiki Editor. Also the Administrator or Superadministrator role should only be assigned to PoolParty Users. Groups Assigning PoolParty Users to groups provides them access to projects that have these groups assigned. PoolParty Administrators in addition can create and delete projects in the groups they are assigned to. The group Public is a special grup in PoolParty. It provides the following: Users that have the group Public assigned can make projects public. That means the Linked Data frontend of the project and the SPARQL Endpoint are publicly available. User Groups User groups can be defined in the User Administration there is one default user group Public available for users that have the role Public assigned. Assigning the role Public to a project indicates that the project is published and the Linked Data frontend, the Wiki view and also the SPARQL endpoint are available. If the Public role is not assigned to a project, you have to log in to the backend to access the Wiki view and the Linked Data frontend and SPARQL endpoint will not be available. 2014, Semantic Web Company (SWC) 48

49 Corpus Management PoolParty supports you in creating a new thesaurus from scratch or extending your existing thesauri with relevant concepts derived from documents matching your domain. The PoolParty Corpus Management tightly integrates the PoolParty Extractor into the thesaurus management process as it uses its ability to analyze documents and extract words and phrases based on a knowledge model (thesaurus). This means that you can process documents (PDF, DOC, Powerpoint,...) that are related to your project's topic. Extracted domain specific terms can then be integrated into your thesaurus. PoolParty uses information extraction algorithms to find your project's concepts if they are mentioned in a document. Additionally the text will be statistically analyzed, and terms and phrases deemed relevant to the document are suggested. Figure 45 Corpus Management When you switch to the Corpus Management view you can: Create a Document Corpus Upload Documents to a Corpus Viewing the Documents of a Corpus Analyse Documents in your Document Corpus Multiple corpora are only available for PoolParty Enterprise server and PoolParty Semantic Integrator. Create a Document Corpus Via Corpora > Create Corpus or right-clicking the project node (1) in the hierarchy tree in the Corpus Management view the Create Corpus dialogue will be opened. 2014, Semantic Web Company (SWC) 49

50 You have to enter a name for the corpus and select the language you want to create the corpus for (Default: default language). When you click Create (2) the corpus will be created and appears in the hierarchy on the left. Figure 46 Create corpus Now you can start uploading documents to your corpus. Creating multiple corpora is only available for PoolParty Enterprise server and PoolParty Semantic Integrator. Upload Documents to a Corpus Once you have created a document corpus you will find the details view of your corpus on the right. It displays statistics about the corpus and also about the last analysis of your corpus. Right click the corpus node and select Add Documents to open the Upload Documents dialogue. You can: Upload documents from your local drive Grab documents based on HTML pages Paste a text to add it to your documents 2014, Semantic Web Company (SWC) 50

51 Figure 47 Add documents You can view all documents uploaded to your corpus in the Corpus Documents tab. Unlimited file upload is only available for PoolParty Enterprise server and PoolParty Semantic Integrator. For all other license types the upload is limited to 100 files or a complete size of 10 MB. Upload documents from your local drive By selecting the Upload Documents tab in the Upload Documents dialogue, you can select files from your local drive to be uploaded to your document corpus. Basically any text based document format is supported (doc, pdf, rtf etc.). Click the Browse button to open the file upload dialog and select files. Click the Upload button to start the file upload. While the upload is running you will get a progress bar. When the upload is finished you will get information per file if the upload was successful. Figure 48 Upload documents 2014, Semantic Web Company (SWC) 51

52 You can view all documents uploaded to your corpus in the Corpus Documents tab. Unlimited file upload is only available for PoolParty Enterprise server and PoolParty Semantic Integrator. For all other license types the upload is limited to 100 files or a complete size of 10 MB. Grab documents from html pages When selecting the Grab Website tab in the Upload Documents dialogue, you can provide URLs to create documents to be uploaded to your document corpus. The content from the provided website is grabbed and stored as a file to your corpus. Via the HTML Cleaning setting you can choose between two methods to clean the content from unnecessary information like banners, navigation etc. The following settings are available: None (Default) PP Service Included basic HTML cleaning service External Service External service for extended cleaning of HTML. When the upload is finished, you will get information whether the upload was successful. Figure 49 Grab websites and add them to your corpus You can view all documents uploaded to your corpus in the Corpus Documents tab. Unlimited file upload is only available for PoolParty Enterprise server and PoolParty Semantic Integrator. For all other license types the upload is limited to 100 files or a complete size of 10 MB. 2014, Semantic Web Company (SWC) 52

53 Paste a text to add it to your documents When selecting the Paste Text tab in the Upload Documents dialogue, you can insert title and text to add documents to your document corpus. The content provided by copy and paste is stored as a file to your corpus. When the upload is finished you will get information whether the upload was successful. Figure 50 Upload a pasted text to your corpus You can view all documents uploaded to your corpus in the Corpus Documents tab. Unlimited file upload is only available for PoolParty Enterprise server and PoolParty Semantic Integrator. For all other license types the upload is limited to 100 files or a complete size of 10 MB. Viewing the Documents of a Corpus To see which documents have been uploaded to your document corpus already, select the Corpus Documents tab in the details view of your corpus node. Double clicking a document to opens the Documents Details dialogue where you can review the quality of document indexing. You can search for specific documents and delete uploaded documents one by one or by selecting all displayed documents. 2014, Semantic Web Company (SWC) 53

54 Documents Details dialogue Figure 51 Viewing documents Double-clicking a document in the documents list opens the Document Details dialogue. Here you geht the following information: 25 most relevant concepts (color coded by concept scheme) 25 most relevant terms that have been found for this document All concept schemes from which concepts are found are displayed highlighted with different colors providing information for the color coding of concepts in the text. You can enable and disable highlighting of concepts and terms. Concepts are highlighted by default. Clicking the star icon in front of a term adds the term to the candidate terms list. You can also select terms or phrases in the text and add them as candidate terms that way. These selected terms are shown in pink in the cloud of terms and concepts. 2014, Semantic Web Company (SWC) 54

55 Figure 52 Document details In addition, you can open a list of all concepts that where found in the document or go to the extracted terms or candidate terms list. Analyse Documents in your Document Corpus When you have uploaded documents to your corpus you can start a corpus analysis via the respective button in the metadata tab of the corpus details view or the context menu. When the analysis is completed some statistics are displayed in the Corpus Analysis Summary. The corpus analysis results in the following lists: Candidate Terms List Extracted Concepts List Extracted Terms List Blacklist 2014, Semantic Web Company (SWC) 55

56 Candidate Terms List Figure 53 Analyse document corpus The list shows terms that have been selected in the Extracted Terms List or in the Documents Details dialogue as relevant for the thesaurus. Candidate terms can be selected and linked to existing concepts as synonyms or as narrower concepts. Figure 54 Candidate terms list Terms are selected by clicking on them. They appear in the "Terms" column. For selecting a concept from the thesaurus one can search for them in the search field below the "Concepts" column or select them directly from the thesaurus tree and drag them to the box below the search field. To view the thesaurus tree click the symbol above the corpus data. 2014, Semantic Web Company (SWC) 56

57 Figure 55 Switch from corpus context to thesaurus context Once the concept(s) and the term(s) that should be linked are selected choose from the options in the "Terms" column how to link them (add as alternative or hidden label, or add as (new) narrower concepts) and click "Add". Figure 56 Select concept from thesaurus and term from extracted terms list for merging Extracted Concepts List This list contains all concepts from the thesaurus that have been detected in the uploaded documents. It gives an overview of how often those concepts were used in the document corpus and also lists the most frequently used label of each concept. In addition, the broader concepts and concept schemes of those concepts are shown. Via the Show (matching terms) button a list of extracted terms will be displayed that are similar to the respective concept. This helps to identify synonyms (alternative labels) and new narrower concepts which can be added to a concept with a few mouse-clicks. By blacklisting a concept, it will be excluded from the extraction model. 2014, Semantic Web Company (SWC) 57

58 Extracted Terms List Figure 57 Extracted concepts list This list shows terms which have been extracted from the document corpus and which are not part of the thesaurus (yet). Terms can be sorted by four different relevance factors: Relevance: The Mutual Information Score, the Content Term Score and the term frequency were combined into one score that gives an overall relevance that is normally a good starting point for going through the list of extracted terms. Mutual Information Score (MIS): Mutual information (MI) provides information about dependency of variables and can be used to estimate if two or more consecutive words in a text should be considered a compound term that is formed by those words. The idea is that if words are independent that they will occur together just by chance, but if they are observed together more often than expected than they are dependent and are candidates for terms. Content Term Score (CTS): Content terms are enriched in documents where they appear, i.e. they are not the most frequent terms in the document set but when they occur in a document then they tend to occur very often indicating their importance for defining the content of the document. Frequency: The total number of occurrences of a term in the corpus. 2014, Semantic Web Company (SWC) 58

59 Via the Show (similar terms) button a list of terms is generated which contains only those terms which are similar to the respective term. This feature helps to bundle similar terms that can be attached as synonyms or as narrower concepts to a certain concept in one step. By activating the Star button, terms will be put on the candidate terms list. In addition terms can be excluded from extraction (blacklisted). Candidate terms can be selected and linked to existing concepts as synonyms or as narrower concepts (see Candidate Terms List for details). Blacklist Figure 58 Extracted terms list Concepts (from the thesaurus) and extracted terms can be added to the blacklist (click on the symbol). Figure 59 Adding concepts and extracted terms to the blacklist 2014, Semantic Web Company (SWC) 59

60 Concepts and terms are listed separately. To switch from one to the other use the drop down menu above the list. Figure 60 Show concepts in black list Concepts or terms set on the blacklist will not be extracted from documents any more (in a given project as these lists are project specific). These settings also affect the extraction results when documents are analysed via the API. To remove an element from the blacklist simply click the source list. symbol and it is put back to the Custom Schema Management PoolParty offers the possibility to add custom schemas defining additional metadata properties for concepts. This feature enables you to extend the expressiveness of the SKOS schema to describe concepts more specifically by adding e.g. additional properties from the DCterms or FOAF scheme or from any other vocabulary or ontology which might be 2014, Semantic Web Company (SWC) 60

61 relevant for the domain of your thesaurus. It is also be possible to develop its own schema or ontology. The PoolParty Custom Scheme functionality allows the creation of custom classes, relations and attributes:custom classes: defined custom classes can be used to represent a type of entity. Custom classes can be used to define domain and range restrictions for relations and attributes: Custom relations: three different relation types can be defined between concepts, concept schemes and already defined custom classes. Custom attributes: concepts, concept schemes and custom classes can be equipped with attributes with specified type and domain. Using predefined Custom Schemes Administrators can import common vocabularies that are already preconfigured and optimized for usage in PoolParty. E.g. the SKOS schema is used by default as a pre-defined schema which can be loaded from the schema library. Importing predefined Custom Schemes Defining Custom Schemes Administrators can define classes, relations and attributes in the Custom Scheme dashboard. Defining a Custom Scheme Using Custom Scheme Defined custom classes can be assigned to whole concepts schemes and will be propagated that way to all concepts in that scheme automatically. In addition, classes can be assigned to single concepts on demand. Using a Custom Scheme Importing predefined Custom Schemes PoolParty provides common vocabularies that can be imported and used by a simple mouse click. Administrators can access the Scheme tab and select Add from Library. A dialog opens that allows to select a vocabulary. By pressing Import, the vocabulary can be used in your projects. 2014, Semantic Web Company (SWC) 61

62 Figure 61 Import Scheme from Librar Imported Schemes can not be edited. It is not possible to add or delete classes, relations or attributes. Imported Schemes can be deleted and reimported at a future time. The provided vocabularies are preconfigured and optimized for usage in PoolParty. At the moment it is not possible to import or add other vocabularies from outside. Defining a Custom Scheme Administrators can define a Custom Scheme by accessing the Scheme tab and selecting New Scheme. Add Classes Figure 62 Custom Scheme dashboard In the next step you can define classes by clicking Add Class in the Classes tab. In the Create New Class dialog you can select a label. Based on the label, a URI is suggested automatically. If needed, the suggested URI can be edited. 2014, Semantic Web Company (SWC) 62

63 Add Relations Figure 63 Definition of a class The definition of relationships between Concepts, Concept Schemes and already defined Custom Classes can be achieved in the Relations tab. Click Add Relation to define a new relation. In the Create New Relation dialog there are three different relationship types that can be defined: Symmetric Inverse Directed The Symmetric relation expresses a relationship where the character is the same, regardless of the direction. Figure 64 Definition of a symmetric relation The Inverse relation allows you define a relationship where the character depends on the direction. 2014, Semantic Web Company (SWC) 63

64 Figure 65 Definition of an inverse relation A Directed relation is a simple relationship that can be set to type Single. Add Attributes Figure 66 Definition of a directed relation To equip Concepts, Concept Schemes and Custom Classes with attributes you can click the Add Attribute button in the Attributes tab. In the Create New Attribute dialog you first select the label of the attribute. 1) You can select between the following Types: URI Label Literal Integer Date Boolean 2) When an attribute has a unique character, you can select the Single checkbox. 3) Finally, you can define which class should be equipped with the attribute: select the Domain of the attribute. Concepts, Concept Schemes and Custom Classes can be selected as Domain. 2014, Semantic Web Company (SWC) 64

65 Custom Schema Details View Figure 67 Define a custom attribute When you select the respective tab you can review details of Custom Schemes in the respective details view. Pressing Delete Scheme allows you to delete the whole Custom Scheme. By pressing in the Actions column it is possible to delete the item. The Single column is only informative. You can not select/unselect the Single type of already created directed relations. In the Classes details view you get an overview over classes and where this class is domain and range of. Figure 68 Classes details view In the Relation details view you get an overview over the already defined relations. 2014, Semantic Web Company (SWC) 65

66 Figure 69 Relations details view The Attributes details view presents defined attributes. Using a Custom Scheme Apply a custom class Figure 70 Attributes details view There are two ways of assigning custom classes: Apply custom class on all sub-concepts of a concept scheme Select the concept scheme, which contains the concepts you want to apply the custom class to. Click the right-hand mouse button. In the context menu that opens, select Apply Custom Class... In the Apply Custom Class dialog you can select the Custom Scheme and the Custom Class you want to apply. 2014, Semantic Web Company (SWC) 66

67 Figure 71 Assigning a custom class to concept scheme After clicking Save in the Apply Custom Class dialog you will find all sub-concepts typed with the respective class. The label of applied custom classes can be seen below the concepts preferred label. Figure 72 Presentation of custom class New concepts generated within a typed concept scheme "inherit" the applied custom class. Apply custom class specifically to a selected concept Select the concept you want to apply the custom class to. Click the right-hand mouse button. In the context menu that opens, select Apply Custom Class... In the Apply Custom Class dialog you can select the Custom Scheme and the Custom Class you want to apply. After clicking Save in the Apply Custom Class dialog you can see the label of the applied custom class below the concepts preferred label 2014, Semantic Web Company (SWC) 67

68 Insertion of relations and attributes In the Details tab you can select the tab corresponding to the wanted custom scheme. On the left hand side you can insert attribute values. When you select the type-aware dialog opens, checking the input of the correct data type. button a Figure 73 Inserting attributes Relations can be inserted on the left hand side. In this example you can see the insertion of the relation <University> <is located in> <Location>. 2014, Semantic Web Company (SWC) 68

69 Figure 74 Defining relations When the user selects a concept that does not have the requested class an error message is displayed. Related concepts can be simply clicked to review the relation. The example shows the reverse relation <Filed of study> <is taught at> <University>. Figure 75 Review inverse relation The User Administration You can create and manage PoolParty users directly via the PoolParty backend. PoolParty uses spring security for authentication and authorization. You open the User Administration via the respective icon in the toolbar or via the Advanced menu. 2014, Semantic Web Company (SWC) 69

70 Figure 76 User administration In the User Administration the following functions are available: Create a new user Manage existing users Add new user groups The User Administration is only available for users with the Super Administrator role. Create a new user You open the User Administration via the respective icon in the toolbar or via the Advanced menu. In the User tab all existing users are listed and you can create new user accounts via the + icon on top. You have to provide a username and password. Via roles the access to PoolParty functionalities can be managed. Via groups access to projects can be managed. Figure 77 Create a new user The User Administration is only available for users with the Super Administrator role. 2014, Semantic Web Company (SWC) 70

71 User Roles and Groups in PoolParty Roles In PoolParty the following roles exist: PoolParty User This is the default role that has to be assigned to every user to be able to log into the PoolParty backend. PoolParty Administrator The Administrator role allows to create and delete projects for the assigned groups and gives access to the Advanced menu where several advanced configuration functions are available. Super Administrator The Superadministrator role allows access to the User Administration and the Admin Dashboard. Wiki Editor The Wiki Editor role allows only access to the Wiki view of a project. Users with this role cannot open a project or take any other action in the backend. Wiki Editors have also to be assigned to the respective user group of a project to be able to view and edit the project in the Wiki view. The behaviour of the Wiki Editor role only works that way if the frontend access level for the server are set to 'Login'. A User should be whether PoolParty User or Wiki Editor. Also the Administrator or Superadministrator role should only be assigned to PoolParty Users. Groups Assigning PoolParty Users to groups provides them access to projects that have these groups assigned. PoolParty Administrators in addition can create and delete projects in the groups they are assigned to. The group Public is a special grup in PoolParty. It provides the following: Users that have the group Public assigned can make projects public. That means the Linked Data frontend of the project and the SPARQL Endpoint are publicly available. Manage existing users You open the User Administration via the respective icon in the toolbar or via the Advanced menu. In the User tab you can view and manage all existing users. Click the Edit (1) icon to open the Edit User dialogue. In that dialogue you can change the roles and the group assignment of the user. Via the Delete (2) icon you can delete existing users. 2014, Semantic Web Company (SWC) 71

72 The User Administration is only available for users with the Super Administrator role. You cannot delete the user you are logged in with. Add new user groups Figure 78 Edit user You open the User Administration via the respective icon in the toolbar or via the Advanced menu. In the Groups tab you can add new user groups that can be assigned to projects and users to grant access to projects based on the assigned user groups. You have to provide a name for the group and clicking the Create Group icon. The User Administration is only available for users with the Super Administrator role. Figure 79 Create user groups 2014, Semantic Web Company (SWC) 72

73 Linked Data Management PoolParty offers new and comfortable ways to publish your projects as Linked Data to the Semantic Web and to enrich your concepts with additional facts from the Semantic Web by linking them to similar concepts published in the Linked Open Data Cloud (LOD cloud). This functionality supports any thesaurus manager to generate richer knowledge models around specific domains. Linked Data Publishing with PoolParty Linked Data Enrichment with PoolParty Linked Data Publishing with PoolParty PoolParty offers the possibility to publish a project as linked data according to the linked data principles defined by W3C (see also: "Linked Data Patterns" by Leigh Dodds and Ian Davis). This requires that the a URI pattern has been defined during the creation of a project and that the linked data publishing is properly configured on your server. PoolParty offers the possibility to publish the following pages: Server page The server page can be reached entering the base URL of the server or project (e.g. It displays all public projects on this PoolParty server and offers additional information and download links. Project page The project page can be reached entering the base URL and the project identifier of the project (e.g. It displays the project information (metadata, concept schemes and download links). Concept scheme page The concept scheme page can be reached entering the base URL and the project identifier and the ID of a concept scheme in the project (e.g. It displays all data available for the resource. Concept page The concept page can be reached entering the base URL and the project identifier and the ID of a concept in the project (e.g. It displays all data available for the resource. The whole Linked Data frontend is based on a MVC model and velocity templates making it very easy to adapt the frontend to specific needs regarding content and layout. 2014, Semantic Web Company (SWC) 73

74 The Linked Data frontend is only available if a project is public (the user group 'Public' is assigned to a project). To provide public availability of the created linked data, the defined base URL must exist and point to the PoolParty server. How to configure a web-server for linked data publishing is described in the Administrator Guide. Displaying Available Projects in the LD Frontend The PoolParty server page offers information on all public projects available on the server. Basically all information available for the projects can be displayed in the server page. In the default template you can find the following information: Project title - displayed as link to project page. Subject Last Modified Number of Concepts Downloads - displayed as links to available downloads. Figure 80 LD frontend server page 2014, Semantic Web Company (SWC) 74

75 Displaying Project Information in the Linked Data Frontend The PoolParty project page offers information on a project. Basically all information available for the projects can be displayed. Additionally all concept schemes and top concepts can be included. In the default template you can find the following information: Basic Metadata Subject, Description, Last Modified, Number of Concepts, Default Language Concept Schemes Title as URL to resource, subject Downloads - displayed as links to available downloads. Additional Metadata Created, Author, Publisher, Contributor Via the RDF/XML tab you can view/download the VoID graph of the project. Via the SPARQL tab you can access the SPARQL endpoint of the project. Also a search bar is available where you can find concepts which are part of this project. The search includes an autocomplete function and for multilingual projects a language selector. Figure 81 Linked Data frontend - project page 2014, Semantic Web Company (SWC) 75

76 Displaying Concept Schemes as Linked Data The PoolParty concept scheme page offers information on a concept scheme in a project. All information available for the concept scheme is displayed. Per default the html tab is displayed offering a human readable HTML version of the data available for the concept including RDFa. Under the RDF/XML tab and the TriX tab you get a machine-processable RDF version of the concept scheme. In the concept scheme page a search bar is available where you can find concepts in this project. The search includes an autocomplete function and for multilingual projects a language selector. Figure 82 LD frontend concept scheme page Displaying Concepts as Linked Data The PoolParty concept page offers information on a concept scheme in a project. All information available for the concept scheme is displayed. Per default the html tab is displayed offering a human readable HTML version of the data available for the concept 2014, Semantic Web Company (SWC) 76

77 scheme including RDFa. Under the RDF/XML tab and the TriX tab you get a machine-processable RDF version of the concept scheme. In the concept scheme page a search bar is available where you can find concepts in this project. The search includes an autocomplete function and for multilingual projects a language selector. Figure 83 LD frontend concept page 2014, Semantic Web Company (SWC) 77

78 Linked Data Enrichment with PoolParty Driven by the Linked Data initiative more and more viable data sets about various topics were published on the semantic web. PoolParty offers the possibility to link to different data sources and the PoolParty Linked Data framework allows to integrate new sources rather easily. The following Linked Data Sources are available in PoolParty per default: DBpedia en, Dbpedia de The semantic version of Wikipedia. DBpedia categories en, DBpedia categories de Categories of the semantic version of Wikipedia. GeoNames Geographical database covering all countries. LCSH (Library of Congress Subject Headings) Programmatic access to different data sources offered by the Library of Congress (e.g. subject headings). WordNet Lexical database of English. Yago Semantic knowledge base including facts about entities (like persons, organizations, cities, etc.). Umbel Lightweight ontology structure for relating Web content and data to a standard set of subject concepts. Via the Linked Data Administration you can select which linked data sources should be available for a project. As soon as the sources have been defined for the project you can link the concepts of your project to resources from the selected linked data sources. Lookup Data from the Semantic Web Basically there are two ways to access the Lookup dialogue where you can link your concept to resources from the available linked data sources. Via the Link to LOD button in the SKOS tab (1) The button is only displayed when linked data sources have been selected for your project in the linked data administration and the Advanced view is enabled for the SKOS tab. Via the Linked Data tab when selecting the source you want to link to. (2) For each linked data source a tab is displayed where you can link to resources from this source and manage the data linked to this concept. If no sources are selected for the project a message is displayed. Both approaches open the Lookup dialogue where in the first step you can select the resource you want to link to. The images below show the two possible ways to open the dialogue. 2014, Semantic Web Company (SWC) 78

79 Figure 84 How to open the lookup dialogue Select a Resource and the Type of Mapping After having opened the linked data linking dialogue a list of resources will be displayed to be linked with your own thesaurus concepts. The list is calculated based on a search including all the labels of the corresponding concept. By clicking the URI of a resource the respective page will be opened. Now you can check if the suggested resource is the right one. You can select the type of mapping you want to establish for this resource. The following types are available: None (Default) All SKOS matching properties skos:exactmatch, skos:closematch, skos:broadermatch, skos:narrowermatch, skos:relatedmatch owl:sameas rdf:seealso Once you have selected the mapping, you can establish additional mappings for this linked data source or change the LD source to create additional mappings for other resources. Via Save you can save the currently defined mappings. This should be done before you change the linked data source. Via Save and Close you can save all mappings and close the dialogue. As soon as you have created mappings for your concept you can start to copy data from the linked resources. 2014, Semantic Web Company (SWC) 79

80 Figure 85 Select resource to link to Copy Data from a Linked Resource After adding a resource you want to link to and defining the mapping type (1) you can select the mapping you want to copy data from. Click the copy data button to open the respective dialogue and select the mapping you want to get data for (2). The data is displayed in groups where the property is the heading of the group (3) and the value or values for this property are displayed in a block below (4). You can select all data for a property by clicking the checkbox next to the property or select (5) distinct values by clicking the respective checkbox next to the value (6). In both cases the selected property will be high-lighted in orange. 2014, Semantic Web Company (SWC) 80

81 PoolParty offers also the possibility to Figure 86 Choose data you want to add/copy to your concept Change the property for copying data Define preferences for selected data Change the property for copying data When copying data from a linked resource it is possible to specify a different property than the one provided by the Linked Data resource. Click Change property to choose a different property. You can select from all properties with the same data type available in PoolParty in the SKOS tab or as a defined metadata property: For example, to create a mapping of the DBpedia abstract to the skos:definition (1). After selecting the new property for the data to be copied, it will be displayed next to the original property and highlighted in orange (2). When you have selected all the data you want to add to your concept, click the Save button in the Lookup dialogue. 2014, Semantic Web Company (SWC) 81

82 Define preferences for selected data Figure 87 Change property for copying data You can define and save preferences for the data which should be copied per linked data source. Select the respective properties (1) and click the Save Preferences button (2) to define your preferences. To reset your preferences definition click the Clear Preferences button. 2014, Semantic Web Company (SWC) 82

83 Figure 88 Define preferences for copying linked data Handling of Incorporated Data in the Linked Data Frontend In PoolParty based projects all incorporated data from other linked data sources is stored in a separate graph to preserve the provenance information of the data. In the Linked Data Frontend of PoolParty data from other sources is displayed in separate areas in the html tab. Since the RDF/XML format does not support graphs this data is not available in the RDF/XML tab but in the TriX tab it is available again as a separate graph. 2014, Semantic Web Company (SWC) 83

84 Figure 89 Handling of incorporated data in the linked data frontend The PoolParty Frontend PoolParty offers a frontend for easy access to your thesauri. The PoolParty frontend is divided in two main parts: The PoolParty Browser which is divided in the following parts: Wiki The Wiki tab offers a light weight editing frontend to display and navigate your project and edit labels and document properties (definition, scope note) of concepts. SPARQL The SPARQL tab provides a SPARQL endpoint to query your thesauri. 2014, Semantic Web Company (SWC) 84

85 The Linked Data Frontend Provides the possibility to publish your thesauri according to the linked data principles defined by W3C. You can get access to the PoolParty Browser by clicking the PP Browser button in the project details view. For projects with URIs you can open the Linked Data Frontend by clicking the LD Frontend button in the projects details view or by clicking the identifier (URI) of the concept scheme or concept displayed as a link in the details view of the concept or concept scheme. The Linked Data Frontend is only available only available for "Public" projects. Configuration options for the PoolParty frontend like the accessibility of the Wiki frontend or displayed information in the Linked Data Frontend can be defined via the PoolParty Server Configuration. You can find a detailed description of the configuration options for the PoolParty frontend in the Administrator Guide. Wiki Frontend The Wiki tab offers a light weight editing frontend which provides an alternative way to browse and edit your thesauri. You can find the wiki frontend in the Wiki tab of the PoolParty Browser. Depending on the frontend configuration the user rights for your project can give everyone access to your thesauri via the wiki frontend. Just send them the URL for a project's wiki frontend, and provided they have access to the page, they can browse your thesauri in their web browser. They can also use the auto-complete supported search function and switch between the different languages of the project. It is also possible to add, edit or delete labels, scope notes and definitions in the wiki frontend by clicking on the corresponding links next to the labels. Relations cannot be changed or added in the wiki frontend. 2014, Semantic Web Company (SWC) 85

86 Figure 90 Wiki Frontend SPARQL Endpoint PoolParty offers a full-fledged SPARQL endpoint to query your thesauri. This is particularly useful for distributed queries, where you can incorporate data from various sources. You can find the SPARQL Endpoint in the SPARQL tab of the PoolParty Browser. The SPARQL endpoint is available via basic authentication for users having access to the project or publicly available for Public projects. You can select the format of the results of a query, add namespace definitions to your queries selecting one of the checkboxes in the Add Namespace section or start with one of the sample queries provided. Once your query is defined click the Run Query button to get the results. The following result formats are available: Table (Default) xml/text xml/application json/text json/application 2014, Semantic Web Company (SWC) 86

87 Figure 91 PoolParty's SPARQL Endpoint Find more information about the SPARQL Endpoint in the PoolParty - Developer Guide. Error Handling In the PoolParty Frontend sometimes something might go wrong and instead of the concept, concept scheme or project you are looking for you get an error. The following Table shows all error codes that may appear, with an explanation why they might appear: Error Code Description 401 This error code is displayed if you try to open an URI and are not logged in or have missing privileges. 404 This error code is displayed if you try to open an URI that does not exist. 500 This error code is displayed if there are problems with the PoolParty server. 502 This error code is displayed if there are problems in the communication between the PoolParty Backend and Frontend. 2014, Semantic Web Company (SWC) 87

88 Advanced Thesaurus Management In this section you find information on advanced thesaurus management functionalities in PoolParty: Import, Export and Reporting with PPT Additional Information for the Project and its Concepts Autopopulate your Thesaurus SPARQL Lists and Collections Quality Management in PoolParty Approval Workflow PoolParty History Import, Export and Reporting with PPT PPT offers the possibility to export and import projects or parts of projects in different formats and to create various reports of projects. In this section you find information on the available import and export functionalities: Exporting a Project Exporting Project Data Exporting Concept Schemes or Subtrees Importing Projects or Concept Schemes Importing Subtrees Backing Up a Project Available Formats for Import and Export Prerequisites for Importing non-poolparty SKOS Thesauri or Zthes thesauri Import Excel Taxonomies Generating Reports with PoolParty Exporting a Project To export a whole project including the projects metadata and settings select 'Export' from the Project menu to open the Export Project dialogue and choose the 'Export Project' setting. In that case all settings in the Export RDF and Export Data tab are pre-selected and cannot be changed. If you click export, a zipped archive is generated holding all data to copy, move or restore your project. 2014, Semantic Web Company (SWC) 88

89 Figure 92 Exporting a project Per default the file name is 'pp_project_<title>.ppar' but you can change the file name later. The.ppar extensions stands for "PoolParty Archive". It is a zip-archive holding all the data of your project. Exporting Project Data Select 'Export' from the Project menu to open the Export Project dialogue to export data from your project. You can select what data should be exported in which format. If you choose the 'Export Project' setting you can export your whole project including the project metadata and setting. Figure 93 Exporting a project Concepts (selected per default) All concept schemes and concepts in the project. 2014, Semantic Web Company (SWC) 89

90 Free Concepts All free concepts added per PPT-API not integrated in your thesaurus yet. SPARQL Lists All SPARQL lists defined for the project. VoID The VoID graph of your project ADMS The ADMS graph of your project Choose the export format and click Export. Per default the file name is 'pp_project_<node name>' but you can change the file name later. If you choose the 'Export to Server' option the export file is saved on the PoolParty server. Deleted and merged Concepts are not included in the export. Related Linked Data, notes added to concepts and subproperty definitions for the project are only exported if you use the export format Trix or TriG. You can also export all data related to your project which is not stored in the triple store via the Export Data tab of the Export Project dialogue. In the tab you can choose to export: Imported Files Files used for imports via Project > Import or subtree import. After you have selected the data to be exported, a zip file with the name 'pp_project_<node name>' will be created and offered for download. Save Export File on Server If you choose the 'Export to Server' option during export of a project the export file is stored in the data directory of your PoolParty server and can be provided for download or included dynamically into your Linked Data Frontend. Selecting the option and clicking Export a message appears stating that the project has been successfully exported and providing a download link for the file. The file pattern for the download links is as follows: e.g. for our Social Semantic Web Thesaurus ( offers the RDF/XML export of the project the TriG export. 2014, Semantic Web Company (SWC) 90

91 Figure 94 Export project to server Find more information on how to make files available and including them in the Linked Data Frontend in the Admin Guide. Exporting Concept Schemes or Subtrees Besides exporting the complete project PoolParty offers the possibility to export single concept schemes of a project or a subtree in a concept scheme. A subtree in this case means a node and its sub-nodes in the hierarchy tree. To export a concept scheme or subtree right click on the respective node in the tree and select 'Export Subtree...' from the context menu to open the Export Concept Scheme or Subtree dialogue. Select the export format and click Export to save the export file. Per default the file name is 'pp_<scheme/subtree>_<node name>' but you can change the file name later. Figure 95 Export of a concept scheme or a subtree Related Linked Data, notes added to concepts and subproperty definitions for the project are only exported using the export formats Trix or TriG. Importing Projects or Concept Schemes You might have several projects that can make good use of a couple of thesauri that are more or less the same in each project, e.g. geographical areas. Thus, instead of creating a new thesaurus from scratch, you may want to simply import an existing SKOS compatible thesaurus from another project or other sources. You may also want to re-import a previously backed-up project or a concept scheme from another project. 2014, Semantic Web Company (SWC) 91

92 Select 'Import' from the Project menu to open the Import Project or Concept Scheme dialogue. Select the file you want to import and the format of the file. Click Import to upload the file and import the concept schemes and concepts included. If you import concept schemes or concepts which are already available in the project, they are not duplicated but the correct broader/narrower relationships are created. Imported concepts will keep the URI/URN they have in the import file. This prevents you from duplicating concepts published already as linked data and just embeds them in a new context. Figure 96 Importing a project If you click the Advanced Import Options link the respective options are displayed. You have to set the language settings according to the languages used in the thesaurus you want to import, e.g. if there are English and French labels in the thesaurus to be imported, make sure to set those as project languages. Especially the default language has to be the same because concepts with a different default language cannot be mapped to the hierarchy tree of a project. Data for languages available in the import file but not in the settings of the project will be imported nonetheless but will not be visible in the PoolParty GUI. Advanced Import Options Clicking the Advanced Import Options link in the Import dialogue the following options are made available: Overwrite existing data Selecting this option deletes all data in the project and replaces it by the imported data that way you can Skip Consistency Checks Selecting this option skips all consistency checks made at import speeding up the import process especially for large thesauri. Both settings can lead to invalid or incomplete data and even to loss of data and should be used with caution. 2014, Semantic Web Company (SWC) 92

93 Importing Subtrees Figure 97 Advanced import options Besides importing projects or concept schemes PoolParty offers the possibility to import subtrees of a concept scheme of another project. This opens up numerous possibilities for thesaurus managers to reuse concepts and hierarchies already available in other projects. Right click the node in the hierarchy tree that should be the root for the subtree you want to import and select 'Import Subtree' in the context menu to open the Import Subtree dialogue. Select the file you want to import and the import format. Click Import to upload the file and import the concepts included. If you import concepts which are already available in the project they are not duplicated but the correct broader/narrower relationships are created. Imported concepts will keep the URI/URN they have in the import file. This prevents you from duplicating concepts published already as linked data and just embeds them in a new context. Figure 98 Importing a subtree 2014, Semantic Web Company (SWC) 93

94 You have to set the language settings according to the languages used in the thesaurus you want to import, e.g. if there are English and French labels in the thesaurus to be imported, make sure to set those as project languages. Especially the default language has to be the same because concepts with a different default language cannot be mapped to the hierarchy tree of a project. Data for languages available in the import file but not in the settings of the project will be imported nonetheless but will not be visible in the PoolParty GUI. Backing Up a Project To prevent the loss of data and work it is important to back up your PoolParty projects regularly. This is done per default for the data in the triple store by the snapshot mechanism of PoolParty. All snapshots are stored to the snapshot directory of PoolParty. Additionally you can create manual snapshots to keep "defined" versions of your data and export your project regularly. Since any change you make will be committed immediately to the database (triple store), you run the risk of losing data when you delete concepts or thesauri. There is also the danger of accidentally creating a mess in case you unwittingly import thesauri into the wrong project, as it takes time to remove the added concepts. If this happens, it might be faster to restore a previous version from a snapshot file. We recommend to follow the backup strategy suggested in the developer guide. Available Formats for Import and Export For importing and exporting data PoolParty covers the most common notations for representing RDF data. The following table gives an overview of the available formats and their capabilities: Name Description PP* AD** NS*** RDF/XML XML serialization for RDF graphs. (Default) X X N-Triples Plain text format for encoding RDF graphs subset of N3. X Turtle Plain text format for encoding RDF graphs subset of N3. X X N3 (Notation 3) Plain text format for encoding RDF compact and human-readable. graphs that is more X X Trix XML serialization for RDF graphs adding the possibility to include named graphs. X X Trig Plain text format for encoding RDF graphs based on Turtle adding the possibility to include name graphs. * Support for import and export of PoolParty data. X X X 2014, Semantic Web Company (SWC) 94

95 ** Support for import and export of Linked Data, notes added to concepts, links to other PoolParty projects and subproperty definitions for the project. *** Support for namespaces in the export file. Prerequisites for Importing non-poolparty SKOS Thesauri or Zthes thesauri If you import SKOS thesauri which were not created with PoolParty, there are certain prerequisites a file should satisfy in order to be imported smoothly. You can verify the consistency of your imported data via PoolParties Quality Management. Additional SWC provides a free online services for checking quality of SKOS vocabularies ( Prerequisites for importing thesauri into PoolParty are: The file has to be valid RDF and should be valid SKOS. Alternatively PoolParty can import thesauri in Zthes XML format and convert them to SKOS. RDF validity can be checked at Several SKOS checks can be made at There has to be a skos:conceptscheme (which represents the thesaurus itself) and one or more concepts connected to it via skos:hastopconcept / skos:topconceptof (see details about SKOS definition and PoolParty). All skos:conceptschemes have to be labeled with one of the following properties in the default language of the project: dc:title dcterms:title rdfs:label skos:preflabel dcterms:title is the default property for labeling concept schemes in PoolParty. If one of the other properties is used a dcterms:title property is added. All concepts should be connected to a parent concept via skos:broader / skos:narrower or to a concept scheme via skos:hastopconcept / skos:topconceptof. URIs shouldn't contain space characters. Concepts must have a preferred label in the default language of the project. The labels of concepts and concept schemes should have language tags attached to denote which language the label is in. Concepts shouldn't have double quotes in their preferred label. Import Excel Taxonomies PoolParty offers the possibility to import taxonomies that have been created with Microsoft Excel. The taxonomies have to follow a predefined format that is specified below. Import can 2014, Semantic Web Company (SWC) 95

96 be done on project level and on subtree level. On project level, the import has to include a concept scheme. All common Excel formats are supported. The Excel import allows to create the following data for concepts: preflabel altlabel hiddenlabel definition scopenote The following rules apply to provide a valid import file: The first row of the Excel sheet has to be the header row defining/labeling the content in the respective column In the following rows the concept schemes and concepts of the taxonomy are defined Only one concept scheme or concept may be defined per row No empty rows are allowed The first column must be labeled "scheme" and will create a concept scheme The provided label will be used as a title in the default language of the project for this concept scheme If no scheme should be added (subtree import), the column is left empty The second column must be labeled "concept" without a language definition The provided label will be used as a preferred label in the default language of the project for this concept There can be multiple columns labeled "concept" to form a hierarchy After the concept columns, there can be one or more of the following columns in any order preflabel@lang Creates an alternative label in the specified language It is not allowed to specify more than one preferred label per language altlabel[@lang] Creates an alternative label in the specified language If no language is specified, the default language of the project will be used You can specify as many alternative labels per language as you like hiddenlabe[@lang] Creates one hidden label in the specified language If no language is specified, the default language of the project will be used You can specify as many hidden labels per language as you want scopenote[@lang] Creates one scope notes in the specified language If no language is specified, the default language of the project will be used You can specify as many scope notes per language as you want definition[@lang] Creates one definition in the specified language. If no language is specified, the default language of the project will be used You can specify as many definitions per language as you want 2014, Semantic Web Company (SWC) 96

97 Find a list of all language tags here: Find below an example for a valid Excel import file: scheme concept concept concept altlabel definition definition Scheme 1 TopConcept 1 Concept 1.1 Concept Concept 1.2 Alt 1.2 TopConcept 2 Concept 2.1 Concept Alt First Definition Second Definition Generating Reports with PoolParty Select 'Reports' from the Project menu to open PoolParty's Reports assistant. PoolParty offers different types of reports that display information for a project. The list of reports is available on the right. After having selectd a report, parameters depending on the report type are displayed (e.g. language). The following reports are available per default: Google Custom Synonyms Generates a synonym list which can be used to extend Google's Customized Search Engine (CSE). Full Details Report Generates a list of all concepts in alphabetical order along with their metadata and relations to other concepts. For multilingual thesauri you can choose the language for the report. Thesaurus Hierarchy Report Generates an overview of the thesauri in a project and their hierarchies displaying up to four levels. For multilingual thesauri you can choose the language for the report. MMS Thesaurus Creates a synonym list that can be imported into MS SharePoint to improve search ( 2014, Semantic Web Company (SWC) 97

98 You can download the reports or store reports on the server to make them available via a persistent URI. Figure 99 Reports in PoolParty PoolParty uses the Velocity Template Engine and the SPARQL endpoint to create reports. This offers the possibility to create customized reports easily. You can find an introduction on 'Creating Custom Reports based on the SPARQL Endpoint' in the PoolParty Developer Guide. Store Reports on the Server PoolParty offers the option to store reports on the server to make them available via a persistent URI. In the Stored Reports tab of the Reports dialogue you get the list of all currently stored reports including information about size and the creation date. Here you can also delete reports. The list is also available via the following URL on your server: , Semantic Web Company (SWC) 98

99 Figure 100 Store reports on your server Additional Information for the Project and its Concepts In the details view of a project, concept scheme or concept the information is grouped in tabs. In this chapter you find information on tabs containing additional information not described yet: Displaying the Concept Index Logging Information for a Project SPARQL enpoint of a project Displaying Triples Visualisation of a Project Displaying the Concept Index The concept index provides an alphabetically sorted index of all concepts in the project. It is available in the projects node Concept > Concept Index sub-tab. It can also be accessed via the Tools > Concept Index menu. 2014, Semantic Web Company (SWC) 99

100 Figure 101 Concept index Logging Information for a Project Selecting the Log tab in the details view of a project displays logging information for the project. You can filter the logging information per user and per date. The filter settings used for the displayed logging information is shown in the heading of the tab. Per default logging information is displayed for all users and the current month. PoolParty logs the following information: Creation of a concept. Modification of a concept. Merging a concept. Deletion of a concept. Figure 102 Project details - Log tab 2014, Semantic Web Company (SWC) 100

101 PoolParty only stores the last modification for a concept. SPARQL endpoint of a project For any thesaurus project there is an internal SPARQL endpoint available which is located in the SPARQL tab of the project node. The SPARQL endpoint can be used to query the projects data within the PoolParty backend. Displaying Triples Figure 103 Projects internal SPARQL endpoint The Triples tab allows you to display all triples in which a concept (or concept scheme) is part of. The tab is available for the whole project, for all concept schemes and concepts of your project. If you open the Triples tab for a concept or concept scheme the URN or URI of the concept or concept scheme is displayed in the search field of the RDF Triples Explorer and all triples of the concept or concept scheme are displayed. If you open the Triples tab for a project the search field is empty and no triples are displayed you have to search for a concept or concept scheme first. In the RDF Triples Explorer triples are grouped in two sets. The first set displays all triples in which the concept scheme or concept is used as a subject. You can see the related predicates and objects. The second set displays all triples in which the concept scheme or concept is used as an object. You can see the related subjects and predicates. For a concept, all triples are displayed including all triples created by linking the concept to Linked Data. For all objects and subjects again representing concepts or concept schemes a clickable URN or URI is displayed. Following those links, the triples of these concepts or concept schemes are displayed. You can also select different concepts in the RDF Triples Explorer by typing their name or using the autocomplete function and clicking the Get Triples button. 2014, Semantic Web Company (SWC) 101

102 Figure 104 Concept details - Triples tab Users which have the Super Administrator role can also delete individual triples. This can help to remove unwanted or unnecessary data which cannot be accessed directly via the SKOS tab or the Metadata tab. Visualisation of a Project PoolParty's Visual Mapper offers a way to browse through a project in an alternative way. Click on the Visualization tab of any concept and see all its relations at once. Navigate through your thesaurus by clicking on a relaged concept. Jump to the details view of a concept clicking the currently selected concept in the middle of the visualization. 2014, Semantic Web Company (SWC) 102

103 Figure 105 Visualizing concepts and relations Visual browsing helps thesaurus managers to get an overview over existing structures and to present concepts and their relations in an appealing way. It has an advantage over the regular tree view, where a concept's relation to only one broader can be depicted at once and no other connections to related concepts can be seen. In the Visual Mapper you can see all relations of a concept and even more you can get an idea of the size of the tree below the related concepts by the size of the bubble and also what types of relations will be available for the related concept. The legend in the right upper corner of the visualization shows the relations that are displayed in the visualization and the respective color code. 2014, Semantic Web Company (SWC) 103

104 Autopopulate your Thesaurus PoolParty offers the option to autopopulate a thesaurus based on the concept hierarchy provided by DBpedia which represents the semantic web version of Wikipedia. You can harvest linked data to start your project with a seed thesaurus or you categorize (link to DBpedia) already existing concepts and start auto-population of your thesaurus based on those mappings. Harvest Linked Data to Generate a Seed Thesaurus Categorize Concepts Autopopulate Based on Categories Harvest Linked Data to Generate a Seed Thesaurus The PoolParty Linked Data harvesting feature offers you the possibility to create seed thesauri as a starting project for your thesaurus project. Seed thesauri will be based on DBpedia, the semantic web version of the Wikipedia. PoolParty generates a first seed model for your thesaurus based on the category system and the respective resources available in this vast pool of information. Once you have created a new project, right click the project node and select the Linked Data Harvesting menu entry from the context menu. This opens the Generate Seed Thesaurus dialogue. Type a search string into Find Categories field and trigger the search by hitting enter or via the respective button. You will get a paginated list of categories matching your search string. You can lookup the categories clicking the Link icon next to the the category and select categories via double click. Once you have selected the categories you want to start from, you can select the following parameters to generate a seed model: Depth You can choose to what level of categories below the chosen categories you want to harvest data. Additional Information You can choose to include alternative labels, definitions and relations based on the information in DBpedia URI Generation You can choose to create URIs following the pattern defined for you project or keep the original URIs of the DBpedia resources. After selecting categories and defining the parameters for the harvesting process click the Generate button to start the process. 2014, Semantic Web Company (SWC) 104

105 Figure 106 Autopopulate project The generation of a seed model may take a while depending on the number of categories and the parameters you have defined. You can setup your own DBpedia Cache to improve performance of the seed model generation. If you need more information or support on that just contact support@poolparty.biz. Categorize Concepts When you right-click a concept you can select the Categorize menu entry in the context menu. It opens the categorization dialogue in which you get a list of possible categories of DBpedia based on the concept labels. You can also search for categories if the correct one is not displayed in the list of results. Select a category for your concept and click Save if you want to categorize other concepts. Click Autopopulate if you want to jump directly to the Autopopulate dialogue. 2014, Semantic Web Company (SWC) 105

106 Figure 107 Categorize concept Autopopulate Based on Categories The autopopulate dialogue is provided as a tab in the details view of your project. It shows all categories assigned to concepts in your thesaurus. You can search over the available categories and select one or more categories to be used for autopopulation. Figure 108 Autopopulate your thesaurus Once you have selected the proper categories you can set the parameters for autopopulation: 2014, Semantic Web Company (SWC) 106

107 Depth Defines if you want to import only the resources and sub-categories of the selected category/categories (1 level by default) or, if the crawler should go one level deeper (2 levels). Link as Defines the mapping type used for the linking of your newly created concepts to the corresponding DBpedia resources or categories from which it was derived. The following mappings are available exactmatch (skos:exactmatch, Default) seealso (rdfs:seealso) sameas (owl:sameas) Create Concepts for This option lets you define whether concepts are created only from DBpedia resources or also from DBpedia categories. The selection is only available when 'Level 1' is selected as depth. DBpedia Categories and Resources (Default) Only DBpedia Resources Only DBpedia Categories Additional information Defines if additional information is retrieved from DBpedia for concepts. Add Alternative Labels Add Definitions Add Relations Start Autopopulation by clicking on the respective button and a progress bar will be displayed until all concepts have been inserted into your thesaurus project automatically. SPARQL Lists and Collections PoolParty offers two ways to create defined lists of concepts: SPARQL lists Dynamic list of concepts defined by a SPARQL query. Collections Unordered and ordered list of concepts. Both types of lists offer the possibility to group concepts in a meaningful way independent of the hierarchy of your thesaurus or taxonomy. 2014, Semantic Web Company (SWC) 107

108 Collections PoolParty offers the possibility to group concepts as unordered lists of concepts (skos:collections) or ordered lists of concepts (swc:orderedcollection). In this section you can find information on how to work with collections: Create a collection Add new concepts to a collection Managing collections While ordered collections are created as skos:collections we decided not to use skos:orderedcollections that are built upon rdf:lists. This would produce an overhead of triples that we think is not necessary. Instead, we decided to introduce PoolParty specific swc:orderedcollection which is a subclass of skos:collection and has skos:concepts defined as skos:members. Additionally, this class has a property swc:position assigned to each member, that contains the index position within the list of the Concept as an integer value. Create a collection Double click the v or right-click the node and select the respective menu entry to create a collection. The Create Collection dialogue opens and you can specify the title of your collection. In addition, you can add a description, choose to make it an ordered collection and add concepts to your collection via autocomplete. Click Save to complete the task. Your collection will appear as a node below the Collections node in the tree. Figure 109 Create a collection 2014, Semantic Web Company (SWC) 108

109 Add new concepts to a collection As soon as one collection is defined the Add to Collection button is available in the details view of a concept. Clicking the button opens the respective dialogue that lets you assign the concept to one or more collections. Managing collections Figure 110 Add a concept to a collection Clicking the collections node you get to the details view of a collection. Per default the Members tab is active where you can view all members of a collection, remove members from a collection and change the ordering of members if you have defined a ordered collection. Figure 111 Managing the members of a collection. Switching to the Metadata tab you can edit the collections metadata. 2014, Semantic Web Company (SWC) 109

110 Figure 112 Manage the collections metadata Additional it is possible to delete a collection via the respective button in the details view. SPARQL lists SPARQL lists are a PoolParty specific way of getting a dynamic list of concepts based on a SPARQL query. For those lists different actions are available e.g. adding/changing labels, deleting items etc. The following lists are currently available: FreeConcepts List Approval list for concept candidates retrieved via the suggestnewconcept Method of the PPT-API Translation List (per language) List of concepts that have no preferred label in the language the list is provided for. Pick List List of narrower concepts of a given concept. Quality Management in PoolParty With PoolParty 4 qskos has been integrated as a suite for detecting quality issues in vocabularies imported into or created with PoolParty. qskos is also the basis for the PoolParty SKOS Quality Checker, an online service that lets you check your vocabularies and provides a detailed report with potential quality issues in your vocabularies. qskos offers 27 checks for potential quality issues in SKOS vocabularies. The following checks are integrated in PoolParty: SKOS Semi-Formal Consistency Issues Inconsistent preferred labels Relation clashes 2014, Semantic Web Company (SWC) 110

111 Non-Disjoint Labels Labeling and documentation issues Same label for different concepts (Overlapping labels) Omitted or invalid language tags Structural issues Hierarchical cycles No broader and not top concept* Valueless associative relations *this check has no direct relation to a check in qskos. It checks for concepts that have no broader concept and are not a top concept and by that not part of the hierarchy. In this chapter the quality management in PoolParty is described: Define Quality Settings Create a Quality Report Define Quality Settings During project creation the quality settings for your project are set to the default scenario unless you change it in the Advanced tab of the project creation dialogue. The defined setting is displayed in the projects details tab (1). You can change the scenario opening the Quality Settings dialogue via the edit icon in the details view (2) of via the Advanced > Quality Settings. The following scenarios are available: Default (Default) Automatic Indexing Classification Document Suggestions Restrictive Checks Disabled Figure 113 Quality settings 2014, Semantic Web Company (SWC) 111

112 Available Quality Scenarios Basically there are three different settings how issues can be handled in PoolParty: enforce During editing it is enforced that this issue cannot be produced. report The quality issue is reported in the quality report ignore The quality issue is ignored. The following table provides an overview what settings are available per quality issue: Inconsistent preferred labels Valueless associative relations Non-Disjoint Labels Hierarchical cycles No broader and not top concept Quality Issue Ignore (I) Report (R) Enforce (E) Same label for different concepts Relation clashes Omitted or invalid language tags In PoolParty different setting for the available checks for quality issues are grouped to different scenarios. The 'Custom' scenerio has no preset and allows defining a custom rules set. The following table gives an overview of the settings per scenario. Checks disabled Default Automatic Indexing Classification Document suggestions Restrictive Inconsistent preferred labels Valueless associative relations Non-Disjoint Labels Hierarchical cycles No broader and not top concept I R R R I R I I I I I E I E E R I E I E R E R E I R I I I R 2014, Semantic Web Company (SWC) 112

113 Checks disabled Default Automatic Indexing Classification Document suggestions Restrictive Same label for different concepts Relation clashes Omitted or invalid language tags I R E R I E I R R R R E I R R R R R Create a Quality Report You can calculate a quality report for a PoolParty project via the Tools > Quality Report menu entry or the respective button in the Quality Reports tab in the projects or concepts details view. The report will be opened in the Quality Reports tab and show you if any quality issues according to the selected quality settings for the project have been found. If issues have been found you will get detailed information about the issue. That way a projects can be regularly checked and potential quality issues can be solved. Approval Workflow Figure 114 Quality report Approval workflow allows you to manage thesauri in a collaborative way, control the status of the thesaurus and manage release cycles. The workflow supports two different concept states: Draft Assigned to a concept when it has been created, edited, imported or added via the suggest service. 2014, Semantic Web Company (SWC) 113

114 Approved Assigned to a concept on approval by a privileged user (Administrator) The following chart is a schematic overview of the review process. Figure 115 Review process The approval process does not cover deletion of concepts at the moment. This means a deleted concept cannot be rejected to bring back a deleted concept. Workflow Initialization Based on the full concept history, PoolParty offers an approval workflow that can be initialized per project at the time being created or also at a later point via the respective entry in the advanced menu. Initialize the Approval Workflow Using the Workflow Based on the role of the user, different actions can be conducted during the workflow process. Workflow in action Please note that the availability of Approval Processes & Workflow Management depends on your PoolParty Server type. See PoolParty price table for details. Initialize the Approval Workflow The approval workflow can be initialized during project creation or for existing projects in via the Initialize Workflow entry in the Advanced menu. 2014, Semantic Web Company (SWC) 114

115 Workflow initialization during project creation In the Advanced tab you can enable the approval workflow checking the respective checkbox during project creation. Figure 116 Advanced project settings Workflow initialization for an existing project In an existing project the administrator can initialize the workflow via the Initialize Workflow entry in the Advanced menu. This opens the respective dialogue. 2014, Semantic Web Company (SWC) 115

116 Figure 117 Initialize workflow in existing project In the Initialize Workflow dialogue you can select the initial state of the existing concepts. You can select Initial State 'Approved' if all concepts should have approved state at the beginning. When the initial state is set to 'Draft' you can select an assignee for review. The workflow process Figure 118 Initial state when initializing workflow This example shows the workflow process based on two users with different roles: PoolParty User PoolParty Administrator 1) Editing If the workflow is activated, after editing a concept status changes to status 'Draft'. Draft concepts are marked with in the tree view and in the details view. 2014, Semantic Web Company (SWC) 116

117 Figure 119 Draft indicator 2) Assignment A PoolParty User can assign concepts with status draft either to: an other PoolParty User to complete information of the concept, e.g. insert a definition or a reviewer which has PoolParty Administrator role for review After clicking the Assign field the assignment dialog allows you to select an assignee and to leave a note that describes the reason of assignment. Figure 120 Assignment dialog 2014, Semantic Web Company (SWC) 117

118 3) Review When you select a PoolParty project the workflow indicator beside your user name shows the number of concepts that are assigned to you. When you click on the user name you can directly open the workflow overview. Figure 121 My assignments In the workflow dashboard you get an overview over concepts with status draft that are assigned to you. 4) Approval / Rejection Figure 122 Approval workflow dashboard Draft concepts can be approved or rejected by the reviewer. If a reviewed concept is rejected, a note can be added that is presented to the user who has to rework the changes. In addition, the reviewer has the possibility to reassign a draft concept to another user / reviewer, e.g. for clarification. If the reviewer approves a draft concept, the concept is highlighted as approved. 2014, Semantic Web Company (SWC) 118

119 Figure 123 Approved concept 5) History The workflow overview provides a direct link to the History of a concept. The history shows previous editing steps of the respective concept. Figure 124 History workflow 2014, Semantic Web Company (SWC) 119

120 PoolParty History PoolParty History provides a full history of changes for all concepts of a project. The history includes all changes made to a concept and all status changes made by the Approval Workflow. The history can be accessed via the History tab in the details view of a concept or via the respective button in the workflow dashboard. PoolParty History allows reviewing all changes made to concepts. In the details view it is presented who made when what change to a concept. If a workflow is in place, the history can be used to monitor changes made to concepts between two approval states. History on the project level In the project details view you can select the History tab, which presents the latest changes of concepts in the project. History on the concept level Figure 125 Project history dashboard The history tab in the concept details view shows you the advance of a concept. 2014, Semantic Web Company (SWC) 120

121 Figure 126 Concept history dashboard PoolParty History is based on changesets. History data is stored in a named graph ( in the project repository. You can find some example SPARQL queries that cover different use cases when dealing with PoolParty History in the Developer Guide. Advanced PoolParty Configuration In this section you find information on advanced configuration features available for PoolParty: Linking PoolParty Projects Adding Linked Data Sources The User Administration Create an Autocomplete Index The Admin Dashboard The Advanced menu is only available for users in the PoolPartyAdmin group. 2014, Semantic Web Company (SWC) 121

122 Linking PoolParty Projects The creation and management of controlled vocabularies in e.g. companies often takes place in a distributed manner. Under certain circumstances it might be more appropriate to have several vocabularies holding different information for different purposes (technical, marketing) or domains in several projects instead of managing them in one central knowledge model. Dealing with several decentralized vocabularies will also lead to different representations and contextualizations of the same concepts in different vocabularies. With PoolParty's linking project feature you can create links between matching concepts in different vocabularies. To use this feature you have to: Link Projects on a PoolParty server Link Matching Concepts in Different Projects Link Projects on a PoolParty server You can link projects via the Linked Projects dialogue in the Advanced menu. Linked projects are defined per project so the dialogue is only available when a project is open. When you open the dialogue the Available projects tab is enabled. In this tab you can see all projects on this server which are available for linking. To be available for linking the project has to be 'Public'. The Advanced menu is only available for users in the PoolPartyAdmin group. Figure 127 Available projects 2014, Semantic Web Company (SWC) 122

123 To link projects select at least one project (1) and click the Save button (2). The Linked Projects tab is displayed showing all projects linked to this project. You can create relations to concepts in linked projects in the Project Linking view. View Linked Projects on a PoolParty Server You can view all projects linked to your project via the Linked Projects dialogue in the Advanced menu. When you open the dialogue the Available Projects tab is enabled. Select the Linked Projects tab to see all projects already linked to your project. As you can see in the image below for every linked project the title, UUID, base URL, project ID and the user groups defined for the project are displayed. You can create relations to concepts in linked projects in the SKOS tab of the details view of a concept. The Advanced menu is only available for users in the PoolPartyAdmin group. Figure 128 Linked projects Link Matching Concepts in Different Projects If you have linked your project to other projects on the PoolParty server you can create links between matching concepts in those projects. Click the Project Linking button (1) in the Project Details view to open the Project Linking view. 2014, Semantic Web Company (SWC) 123

124 Figure 129 Project Linking view In the Project Linking view you can switch between the Tree View tab where you can browse through the tree of your linked project and link concepts per drag and drop List View tab where you get a list of concepts of your project linked to other projects on the server. Project Linking - Tree View In the Tree View tab of the Project Linking view you can browse the tree of the linked project and also view information about the concept (1) by clicking the node in the tree of the linked project. Per drag and drop you can create relations between the concepts in the different projects (2). The type of relations can be selected per default the mapping relations of the SKOS model are available (exact match, close match, broader match, narrower match, related match). In addition all custom relations defined via a custom schema are available. 2014, Semantic Web Company (SWC) 124

125 Figure 130 Project Linking - Tree View Adding Linked Data Sources You can add new linked data sources in a dialogue in the Advanced > Linked Data Administration menu. Linked data sources are defined per project so the dialogue is only available when a project is open. When you open the dialogue the Available Sources tab is enabled showing all available sources not selected for the project yet. The Advanced menu is only available for users in the PoolPartyAdmin group. Figure 131 Add linked data sources 2014, Semantic Web Company (SWC) 125

126 When you have selected the sources you want to add to your project, click the Save button and the Selected Sources tab is displayed showing all linked data sources defined for the project including your newly selected sources. Now you can start to link the concepts of your project to resources from the selected Linked Data sources. View Available Linked Data Sources You can view all defined linked data soures assigned to your project via the Linked Data Sources dialogue which you access in the Advanced > Linked Data Administration menu. Linked data sources are defined per project so the dialogue is only available when a project is open. When you open the dialogue the Available Sources tab is enabled. Select the Selected Sources tab to see all sources already defined. For each source you get the following information Default Graph Graph where the data of this source is stored in the projects repository. Lookup Endpoint Source where the data of this source is retrieved from. Triples Number of triples of this source stored in the projects repository. Local Concepts Number of concepts in the project linked to this source. In front of each source a Delete icon is displayed. Deleting a source does not delete the data linked to your project from this source or copied to your project from this source. Figure 132 Selected linked data sources 2014, Semantic Web Company (SWC) 126

127 Create an Autocomplete Index For large projects with a huge number of concepts and labels PoolParty's default autocomplete function might become slow. In this case enabling the autocomplete index could increase performance and bring the speed of the autocomplete function back to normal. To enable the autocomplete index select Autocomplete Index in the Tools menu. The Autocomplete Index is based on the Extraction Model. Therefore it is checked, weather the Extraction Model is available and up to date. That means when no model is available or when you change your thesaurus (e.g. add concepts or labels) a message appears, saying that the Autocomplete Index is outdated. You can refresh the Extraction Model by simply clicking on the provided link in the message or by clicking Refresh Extraction Model in the Corpora menu. The Admin Dashboard Figure 133 Refresh autocomplete index You can access the Admin Dashboard by choosing "Dashboard" in the Advanced menu. It displays information for all projects on the PoolParty server. It displays 10 projects per page. You can switch pages via tabs. Also the autosave settings for all projects and a list of available snapshots per project are displayed in the Admin Dashboard. The Admin Dashboard is only available for users in the PoolPartyAdmin group. 2014, Semantic Web Company (SWC) 127

128 Figure 134 Admin Dashboard In the Admin Dashboard you can find the following information per project: Figure 135 Admin Dashboard - Project information Name (Context URI) Extraction model Concepts Languages History User groups The title of the project Yes, if an extraction model exists The number of concepts of the project The default language and all languages of the project The creator of the project All user groups assigned to the project. The internal project number The creation date of the project The repository type The date of the last modification 2014, Semantic Web Company (SWC) 128

129 Automatic Snapshots For all projects per default the autosave function is enabled during project creation and snapshots of the project are generated in a defined interval (default value is every 10 minutes). In the Admin Dashboard information about the snapshot settings and a list of available snapshots is displayed. All snapshots are saved to the snapshots directory under <PoolParty-Data>/snapshotRoot. This implies that the snapshots directory should be included in the backup strategy for a PoolParty server but also that if anything goes wrong you can restore projects from a snapshot. The snapshot information is grouped in two parts: Figure 136 Admin Dashboards - Snapshot information Snapshot Settings The following settings are available: interval Shows the autosave interval. (Default: 5min) onexit Shows if a snapshot is generated on exit. (Default: true) The recommended settings link sets all settings to default values Snapshots The following information is displayed: Number of snapshots for project For every snapshot the following information is displayed date snapshot / <user> User generated snapshots restore link offers the possibility to restore projects from a snapshot The make snapshot now link creates a new user generated manual snapshot. Manual snapshots are not overwritten by the autosave function. The snapshot information in the Admin Dashboard is displayed green as soon as automatically generated (system) snapshots are available. Restore Projects from a Snapshot When a project is opened, a check is made whether the data in the project is valid. If any changes in the data compared to the last status (status at last logout) is detected, PoolParty assumes that there is something wrong. A message is displayed and a control snapshot is created (suffix.ctrl) and stored in the snaphshot folder. In this case the autosave mechanism 2014, Semantic Web Company (SWC) 129

130 of PoolParty is disabled so that the snapshots of a project are not overwritten with outdated or corrupt data. Via the Admin Dashboard you can restore a project from a snapshot. Before restoring a snapshot, a manual snapshot should be triggered in the admin dashboard. Click the make snapshot now link to create a manual snapshot. 1. Compare the last snapshot against the control snapshot to see what changed. Also checking the log file at the time the two snapshots have been created can provide information on what has happened. See chapter PoolParty Directory Structure to find the log file and snapshots or contact your system administrator to do it. 2. To trigger the snapshot process again you have the following options: a. Create a manual snapshot (if you are absolutely sure your repository is OK) b. Choose the snapshot (by date or by checking the file or by importing snapshots in a test project and examining the data) and click the restore link. (1) 3. A message appears asking if you want to proceed. Click OK to proceed. (2) 4. A new snapshot is displayed in the list of available snapshots created by a user named "restored". (3) A message is displayed at the top of the Admin Dashboard informing you that the restore process was successful. (4) Of course you can also contact PoolParty support (support@poolparty.biz) if you have questions or if you are not sure what happened here. 2014, Semantic Web Company (SWC) 130

131 Figure 137 Restore from Snapshot When you restore a project in the Admin Dashboard, you have to reload the project in the PoolParty Backend to refresh the tree view and see the changes. Troubleshooting PPT Freezing If PPT isn't reacting to your input or doesn't seem to finish processing a task, it is recommended to use the browser's reload function and open your project again. You should be able to continue your work as usual. Unexpected Behaviour After PPT Upgrade When your PPT instance is upgraded to a new release it might cause unexpected behaviour, if you previously worked with an older version. This is a common issue for all applications using Ajax technology. To avoid this, you'll have to delete the PPT cookie and clear your browser's cache after each new release. To clear the cache in Firefox you have to choose 'Options' from the Tools menu. Click on the 'Privacy' icon in the options dialogue. Make sure the 'Ask me before clearing private data' box is checked and click on 2014, Semantic Web Company (SWC) 131