Isilon InsightIQ Version 2.5 User Gide
Pblished March, 2014 Copyright 2010-2014 EMC Corporation. All rights reserved. EMC believes the information in this pblication is accrate as of its pblication date. The information is sbject to change withot notice. The information in this pblication is provided as is. EMC Corporation makes no representations or warranties of any kind with respect to the information in this pblication, and specifically disclaims implied warranties of merchantability or fitness for a particlar prpose. Use, copying, and distribtion of any EMC software described in this pblication reqires an applicable software license. EMC², EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the United States and other contries. All other trademarks sed herein are the property of their respective owners. For the most p-to-date reglatory docment for yor prodct line, go to EMC Online Spport (https://spport.emc.com). For docmentation on EMC Data Domain prodcts, go to the EMC Data Domain Spport Portal (https://my.datadomain.com). EMC Corporation Hopkinton, Massachsetts 01748-9103 1-508-435-1000 In North America 1-866-464-7381 www.emc.com 2 InsightIQ 2.5 User Gide
CONTENTS Chapter 1 Introdction to InsightIQ 7 InsightIQ downsampling...9 Clster monitoring throgh reports...9 Performance reports...9 File-system reports...10 Report configration components...12 Data modle information...12 Filter rles and filters...15 Breakots...15 Breakot definitions...16 File System Analytics...17 File System Analytics snapshots...17 File System Analytics reslt sets...18 Clster-monitoring smmary...18 Read-only sers...18 Permalinks...19 Chapter 2 Configring InsightIQ 21 Managing monitored clsters...22 Add a new clster to monitor...22 Import a clster to monitor...23 Modify monitored-clster settings...24 Sspend or resme clster monitoring...24 Stop monitoring a clster and delete clster data...24 View monitored-clster settings...25 View clster-monitoring stats...25 Managing datastores...25 Specify a datastore...26 Delete a dataset...28 View datastore settings...28 Managing data-resoltion policies...28 View data-resoltion policy settings...29 Modify data-resoltion policy settings...29 Managing File System Analytics reslt sets...29 Pin or npin a File System Analytics reslt set...30 Delete a File System Analytics reslt set...30 View File System Analytics reslt sets...30 File System Analytics reslt set information...31 Configring File System Analytics settings...31 Configre File System Analytics settings...31 Enable or disable File System Analytics...32 View File System Analytics settings...32 Managing InsightIQ virtal appliance settings...33 Modify the InsightIQ virtal appliance time zone...33 Modify the InsightIQ virtal appliance administrator password...33 View InsightIQ virtal appliance network settings...34 View InsightIQ virtal appliance network settings...34 Configre the InsightIQ virtal appliance to monitor clsters throgh a proxy server...34 InsightIQ 2.5 User Gide 3
CONTENTS Managing read-only sers...35 Add a read-only ser accont...35 Modify the password of a read-only ser accont...35 Delete a read-only ser accont...35 Configre email settings...36 Create a permalink...36 Chapter 3 Monitoring clster stats smmaries 37 Monitor aggregated-clster stats...38 Monitor the stats of an individal clster...38 Chapter 4 Monitoring clster stats throgh reports 39 Managing live performance reports...40 Create a live performance report...40 View a live performance report...41 Schedle a live performance report...41 Modify a live performance report...42 Delete a live performance report...42 Managing performance report schedles...42 Create a performance report schedle...42 Disable a performance report schedle...44 Enable a performance report schedle...45 Modify a performance report schedle...45 Delete a performance report schedle...45 Generating performance reports...46 Generate a performance report on demand...46 Send a generated performance report...46 Delete a generated performance report...47 Modify the schedle of a generated performance report...48 View a generated performance report...48 View a live file-system report...48 Managing rles and filters...49 Create a filter...49 Modify a filter...49 Delete a filter...50 Chapter 5 Exporting InsightIQ data 51 Export InsightIQ data to a CSV file...52 Chapter 6 InsightIQ commands 53 iiq_data_export export...54 iiq_data_export list...58 iiq_data_export describe...60 iiq_restart...61 iiq_stop...62 iiq_start...62 iiq_network...62 Chapter 7 InsightIQ trobleshooting 63 Configration isses...64 4 InsightIQ 2.5 User Gide
CONTENTS Datastore isses...64 Application isses...65 OneFS Platform API isses...65 Report schedle isses...65 InsightIQ 2.5 User Gide 5
CONTENTS 6 InsightIQ 2.5 User Gide
CHAPTER 1 Introdction to InsightIQ InsightIQ enables yo to monitor and analyze the performance and file systems of Isilon clsters. With InsightIQ, yo can perform the following tasks: Determine whether a clster is performing optimally. Compare changes in performance across mltiple metrics, sch as CPU sage, network traffic, protocol operations, and client activity. Correlate critical clster events with performance changes. Determine the effect of workflows, software, and systems on clster performance over time. View and compare properties of the data on the file system. InsightIQ enables yo to monitor and analyze Isilon clster activity throgh flexible, cstomizable reports in the InsightIQ web-based application; yo can cstomize these reports to provide detailed information abot clster hardware, software, and protocol operations. InsightIQ transforms data into visal information that emphasizes any performance otliers, enabling yo to qickly and easily diagnose bottlenecks or optimize workflows. By transforming complicated data into relevant, visal information, yo can perform the following tasks: Determine a case or validate a theory Yo can create and view specific reports to identify or confirm the case of a performance isse. For example, if end sers were reporting client connectivity problems dring certain time periods, yo cold create an InsightIQ report that indicates whether the isse occrred at the clster level, the node level, the client level, the disk level, or the network level. InsightIQ enables yo to easily correlate seemingly nrelated data across both present and historical conditions. Measre the effects of configration changes If yo modify yor clster environment, yo can determine the effect of those changes by creating a report that compares the past, baseline performance with the performance since the changes were made. For example, if yo added 20 new clients, yo cold create a report that illstrates the before-andafter performance; this wold enable yo to determine whether the added clients had an effect on a specific aspect of system performance, sch as network throghpt or CPU sage. Optimize application workflows or performance Yo can create InsightIQ reports that help yo identify bottlenecks or inefficiencies in yor systems or workflows. For example, if yo wanted to ensre that all clients are able to access the clster qickly and efficiently, yo cold create a report that indicates whether some client connections are significantly faster or slower than others. Yo cold then modify the report by adding breakots and filters as needed to identify the root cases, which cold be related to specific files that the clients are working with or the operations that the clients are performing. Analyze detailed operations data Yo can cstomize InsightIQ reports to provide specific information abot general clster operations. For example, if yo recently deployed an Isilon clster, yo might want to view a cstomized report that illstrated how the clster and its individal components are performing. Introdction to InsightIQ 7
Introdction to InsightIQ Forecast ftre needs Reviewing past performance trends can help yo predict ftre trends and needs. For example, if yo deployed an Isilon clster for a data-archival project six months ago, yo might want to estimate when the clster will reach its maximm storage capacity. Yo cold cstomize a report to illstrate storage capacity sage by day, week, or month in order to determine approximately when the clster will reach capacity if crrent trends were to contine. InsightIQ downsampling...9 Clster monitoring throgh reports...9 Report configration components...12 File System Analytics...17 Clster-monitoring smmary...18 Read-only sers...18 Permalinks...19 8 InsightIQ 2.5 User Gide
Introdction to InsightIQ InsightIQ downsampling InsightIQ downsamples the data that it collects, meaning that higher-resoltion data is converted to lower-resoltion data by adding or averaging several high-resoltion samples to prodce a single lower-resoltion sample that represents an approximate aggregation of the data for the specified time period. Depending on the configred data-resoltion policy settings, InsightIQ collects highresoltion (five-second sample), medim-resoltion (30-second sample), or lowresoltion (two-minte sample) data from the monitored clster. From there, InsightIQ frther downsamples the data with previosly collected data to prodce aggregated lower-resoltion data. Dring the downsampling process, InsightIQ prges some data to accommodate the downsampling process and to limit the size of the datastore. The growth rate of the InsightIQ datastore slows over time de to the InsightIQ data-retention policies, which store limited amonts of the highest-resoltion data. Typically, charts that represent shorter or more recent periods of time are displayed in higher resoltion than charts that represent longer or earlier periods of time. Clster monitoring throgh reports Performance reports Yo can monitor clsters throgh cstomizable reports that display detailed data abot clsters over specific periods of time. InsightIQ enables yo to view two general types of reports: performance reports and filesystem reports. Performance reports inclde information abot clster activity and capacity. Performance reports can be sefl if, for example, yo want to determine whether clsters are performing as expected or yo want to investigate the specific case of a performance isse. File-system reports inclde data abot the files that are stored on a clster. File-system reports can be sefl if, for example, yo want to identify the types of data being stored and where on a clster that data is stored. Before yo can apply a file-system report to a clster, yo mst enable the InsightIQ File System Analytics featre for that clster. InsightIQ spports live versions of reports that are available only throgh the InsightIQ web application. Yo can create live versions of both performance and file-system reports. Yo can modify certain attribtes of live reports as yo are viewing the reports, inclding the time period, breakots, and filters. In addition to viewing performance reports live, yo can also access them throgh static PDF reports. PDF reports are generated based on a report schedle that yo configre, and cannot be modified to show different data after they are generated. However, yo can configre InsightIQ to send generated reports to email addresses when they are generated, making the same data available to mltiple people instantly. Yo can se generated reports to verify clster health periodically and distribte InsightIQ information to people who do not have access to the InsightIQ web application. Performance reports enable yo to view information abot the activity of the nodes, networks, clients, disks, and IFS cache of a clster. Yo can also view information abot CPU sage, available capacity and recent clster events. Yo can se performance reports to verify whether a clster is performing as expected, or identify the case of a performance isse. For example, yo can view performance reports that display information abot network throghpt dring a period of time. If yo find that throghpt is not as high as expected, yo can search for a case of the isse by viewing information abot any network throghpt errors. InsightIQ downsampling 9
Introdction to InsightIQ Performance reports can also be sefl when yo want to monitor clster capacity. For example, yo might create a performance report that shows the changes in available capacity over the past year. Yo might also create a report schedle that sends a weekly report that illstrates the clster capacity over the past week. Live performance reports Live performance reports enable yo to dynamically modify a report as yo view it. Yo can only view live performance reports throgh the InsightIQ web application. While viewing a live performance report, yo can modify the range of data that is displayed, as well as breakots and filters. Live performance reports can be sefl when yo want to investigate a performance isse that is crrently affecting a clster. For example, yo might notice throgh the InsightIQ dashboard that throghpt is higher than expected. Yo cold then view a live performance report to see the individal contribtions of specific components, sch as the direction in which the throghpt is traveling. In a live performance report, yo can view the crrent stats the monitored clster, inclding the crrent date and time as reported by the clster, the nmber of nodes in the clster, a client-activity overview, a network throghpt overview, the capacity sage of the clster, and the CPU sage of the clster. Schedled performance reports Yo can configre a report schedle that InsightIQ will generate static PDF reports from. Report schedles specify what is inclded in the reports, when the reports will be generated, and, optionally, one or more email addresses to send the reports to. For each schedle, yo specify when InsightIQ will generate the reports. Yo can also manally generate a report based on a report schedle at any time. All generated reports are archived and can be viewed and sent to email addresses. Generated reports are not atomatically deleted by the system bt can be manally deleted by a ser. InsightIQ generates PDF reports based on the time settings on the VM, not the time settings on the monitored clster. Yo can se performance report schedles to keep track of clster performance over a long period of time. For example, if yo wanted to keep track of the remaining nsed capacity on a clster, yo cold create a report schedle that InsightIQ wold se to send yo data abot the capacity of the clster. Yo cold also configre the report to send copies of the report to other people who might not have InsightIQ ser acconts. Generated performance reports InsightIQ generates static PDFs, otherwise referred to as generated performance reports, at intervals specified in report schedles. Yo can configre InsightIQ to send the reports to p to 10 specified email addresses, or yo can view the generated reports throgh the InsightIQ web application. File-system reports File-system reports inclde information abot the files stored on a clster, sch as the nmber of files stored on the clster, the types of files stored on the clster and where on the clster the files are located. InsightIQ spports two kinds of file-system reports: data-sage reports and data-property reports. Data-sage reports inclde data abot the individal files on a clster, sch as which files have remained nmodified for the longest amont of time. Data properties 10 InsightIQ 2.5 User Gide
Introdction to InsightIQ reports inclde data abot the overall clster file system, sch as how many files were last modified dring a specific period of time. Data properties reports can also be compared between two different points in time; for example, yo can view the relative changes in file cont by physical size. File-system reports can be sefl if yo are trying to identify the sorce of a performance isse on the file system. For example, if yo viewed a performance report that showed that a clster was almost ot of storage space, yo cold view the data sage report and find the largest files or directories on the clster. File-system reports can also be sefl if yo are managing storage space among mltiple clsters. For example, if yo have two clsters, one that is sed for development and one that is sed for archiving, yo cold view the data properties report to verify that the development-clster files were being modified often and the archive-clster files were only being modified periodically. Frthermore, if the data properties report revealed that a significant nmber of files on the development clster had not been accessed in a very long time, yo cold view the data sage report to identify the inactive files and consider transferring those inactive files to the archive clster. Live file-system reports Yo can view file-system reports in a live mode that enables yo to adjst the data displayed as yo view it. Yo can view live file-system reports throgh the InsightIQ web application, and can change the range of data that is displayed, as well as apply breakots and filters. Live file-system reports can be sefl when yo need to inspect the changes in file layot of yor system. For example, yo might want to view how the nmber of files being stored in different directories has changed recently. With the data properties file-system report, yo can compare the file system at a previos date with the most recent time that data was collected on the clster. Yo can se live file-system reports to verify that the file system of a clster is behaving as expected. For example, if yo had a clster that designated for archiving data, yo cold se the data properties file-system report to view the file cont by last modified file-system modle. This wold show yo the nmbers of files on yor clster organized by how recently they had last been modified. If the cont of files that had been modified was particlarly high, yo cold consider moving those files to a clster intended for development. Yo can also se live file-system reports to investigate files. For instance, if yo discovered from a performance report or InsightIQ Dashboard that yo had less capacity remaining than yo expected to, yo cold view the data sage file-system report for that clster. The data sage report incldes a file-system modle that can be cstomized to show the top 1000 largest files on the clster. Yo cold se this to verify which files were taking p the most space on the clster. At the top of each file-system report, yo can view a Crrent Smmary section that displays at-a-glance information that incldes the name of the monitored clster; the crrent date and time as reported by the clster; an overview of clster capacity verss sage, the nmber of files, directories, and other objects; the average nmber of files per directory; and the ratio of physical verss logical file size. The information displayed in the Crrent Smmary area represents the stats of the clster at the time displayed in the Crrent Smmary area; the information does not reflect the clster stats dring the time period that the report is displaying data abot. File-system reports 11
Introdction to InsightIQ Report configration components Data modle information The data that reports contain is determined by three configration components: data modles, breakots, and filter rles. A data modle is a section of a report that displays data abot the performance or file system of a clster. Yo can apply a breakot to a data modle to view the individal contribtions of separate components. A filter rle can be applied across an entire report, affecting the data displayed in all data modles. Filter rles can be combined into collections called filters, which can be applied to reports. Data modles display information abot the performance or file system of a clster, sch as the nmber of protocol operations per second or the changes in file cont organized by physical size. A data modle that appears in a performance report is referred to as a performance modle. A data modle that appears in a file-system report is referred to as a file-system modle. Performance modles Depending on which version of the OneFS operating system the monitored clster is rnning, certain InsightIQ featres may not be available. Active Clients Displays the nmber of niqe client addresses generating protocol traffic on the monitored clster. Clients that are connected bt not generating any traffic are not conted. Yo can optionally break ot this data by protocol or node. Some protocols might isse a type of ping message, which can case clients to appear active even if they are only sending these ping messages. Average Disk Hardware Latency Displays the average amont of time it takes for the physical disk hardware to service an operation or transfer. Yo can optionally break ot this data by node or disk. Average Disk Operation Size Displays the average size of the operations or transfers that the disks in the clster are servicing. Yo can optionally break ot this data by direction, node or disk. Average Pending Disk Operations Cont Displays the average nmber of operations or transfers that are in the processing qee for each disk in the clster. Yo can optionally break ot this data by node or disk. Blocking File System Events Rate Displays the nmber of file blocking events occrring in the file system per second. Yo can optionally break ot this data by path or node. CPU % Use Displays the average CPU sage for all nodes in the monitored clster. As some nodes may consme significantly more or less CPU resorces than others, the average reflects the sm of the individal CPU-sage averages for each node. Yo can optionally break ot this data by node; this breakot indicates the average CPU sage of each node. For example, at 10:52:22 AM on 2010-06-15, the specified node was sing 14.35% of the total available node CPU capacity. Cached Data Age Indicates how long the oldest data has been in the cache. The shorter the time, the faster data is moving throgh the cache and old data in the cache is being replaced with newer data. Yo can optionally break ot this data by node. Clients Smmary Displays clients that are crrently consming the most bandwidth. The list shows p to 64 clients, ordered from most to least active as determined by their combined inpt and otpt throghpt rates dring the specified time range. 12 InsightIQ 2.5 User Gide
Introdction to InsightIQ If the monitored clster is rnning the Isilon SyncIQ modle, the InsightIQ client list might inclde a client with an IP address of 0.0.0.0. This is expected behavior. Connected Client Displays the nmber of niqe client addresses with established TCP connections to the clster on known ports. Yo can optionally break ot this data by protocol or node. UDP connections do not appear as connected. In addition, some short-lived TCP connections might not appear as connected even thogh they are active. Contended File System Events Rate Displays the nmber of file contention events, sch as lock contention or read/write contention, occrring in the file system per second. Yo can optionally break ot this data by path or node. Deadlocked File System Events Rate Displays the nmber of file system deadlock events the file system is processing per second. This information can be sefl if yo want to identify a specific file state that might be contribting to performance isses. Deadlocked events occr reglarly dring normal clster operation, and the file system is designed to atomatically detect and break them. Yo can optionally break ot this data by path or node. Disk Activity Displays the average percentage of time that disks in the clster spend performing operations instead of sitting idle. Yo can optionally break ot this data by node or disk. Disk Operations Rate Displays the average rate at which the disks in the clster are servicing data read/write/change reqests, also referred to as operations or disk transfers. Yo can optionally break ot this data by disk, direction, or node. Disk Throghpt Rate Displays the total amont of data being read from and written to the disks in the clster. Yo can optionally break ot this data by disk, direction, or node. Event Smmary Displays events generated by the monitored clster dring the specified time range. Also incldes events that were started prior to bt ended dring the specified time range. The following list describes the specific colmns of the Events table. Event Timeline The horizontal red event timeline represents the same period of time that is crrently represented in the performance charts. A vertical red line on the event timeline indicates the start of an event. Yo can rest the pointer over specific sections of the horizontal timeline to view detailed information abot any time-specific events or alerts. Severity Indicates the severity level of the event. Start Indicates when the event started. End If applicable, indicates when the event ended. Instance Displays the niqe identifier of the event. Message Displays a description of the event. External Network Errors Displays the nmber of errors generated for the external network interfaces. Yo can optionally break ot this data by direction, interface, or node. Dring normal operations, this chart indicates an error cont of 0. Errors reported in this chart are often the reslt of network infrastrctre isses (for example, malformed frames or headers, handoff errors, or qeing errors) rather than OneFS isses. When investigating the case of these errors, first review the logs and reports for yor network switch and other network infrastrctre components. Data modle information 13
Introdction to InsightIQ External Network Packets Rate Displays the total nmber of packets that passed throgh the external network interfaces in the monitored clster. Yo can optionally break ot this data by direction, interface or node. External Network Throghpt Rate Displays the total amont of data that passed throgh the external network interfaces in the monitored clster. Yo can optionally break ot this data by interface, direction, client, operation class, protocol, or node. File System Events Rate Displays the nmber of file system events, or operations, (sch as read, write, lookp, or rename) that the file system is servicing per second. Yo can optionally break ot this data by direction, operation class, path, node, or event. File System Otpt Rate Displays the rate at which data is being read from the file system. Yo can optionally break ot this data by node. HDD Storage Capacity Displays the sed and total storage capacity for all hard-disk drives in the monitored clster. Yo can optionally break ot this data by node. L2 Cache Throghpt Rate Indicates how mch data was reqested from the level-two (L2) cache and how mch data matched the reqests. On the chart, the starts line indicates how mch data was reqested from the file system's L2 cache. The hits line indicates the amont of data in the L2 cache that matched those reqests. Yo can optionally break ot this data by node. The level-two cache is the cache on the storage node that contains the cached disk. This is in contrast to the level-one cache, which is the cache on the node that processes protocol reqests. Locked File System Events Rate Displays the nmber of file lock operations occrring in the file system per second. Yo can optionally break ot this data by path or node. Node Smmary Displays stats and performance metrics for all nodes in the monitored clster. Pending Disk Operations Latency Displays the average amont of time that disk operations spend in the inpt/otpt schedler. Protocol Operation Average Latency Displays the average amont of time reqired for protocols to process incoming operations. These vales are typically represented in fractions of seconds. Yo can optionally break ot this data by client, operation class, protocol, or node. Protocol Operations Rate Displays the total nmber of reqests that were originated by clients for all file data access protocols. Combined with data from the disk throghpt and disk operations rate data elements, this information can help yo identify specific clients that might be significantly contribting to clster load. Yo can optionally break ot this data by client, operation class, protocol, or node. SSD Storage Capacity Displays the sed and total storage capacity for all solid-state drives in the monitored clster. Yo can optionally break ot this data by node. Slow Disk Access Rate Displays the rate at which slow (long-latency) disk operations occr. Storage Capacity Displays the sed and total storage capacity for the monitored clster. Yo can optionally break ot this data by node. 14 InsightIQ 2.5 User Gide File-system modles Directories Displays disk-sage data and file conts per directory, recrsively. Yo can sort the information by clicking a colmn heading in the table view; this cases the chart on the left to reload and display a visal representation of the specified information. Yo can click path names to view more specific information abot any sbdirectories contained in the
Introdction to InsightIQ directory. Yo can also create a filter for a specific directory that yo can se to filter data in other InsightIQ views. File Cont by Last Modified Displays the total nmber of files that were last modified within a specified time range. For example, the monitored clster might contain 38,734 files that were last modified between 14 days and 21 days ago. File Cont by Logical Size Displays the total nmber of files in a specified logical-size range. For example, the monitored clster might contain 3,329,210 files that are between 1 GB and 10 GB in logical size. Yo can optionally break ot this data by modified time, disk pool extension, or path. File Cont by Physical Size Displays the total nmber of files in a specified physicalsize range. For example, the monitored clster might contain 23,724 files that are between 100 GB and 1 TB in physical size. Yo can optionally break ot this data by modified time, disk pool, extension, or path. Yo can optionally break ot this data by disk pool, logical size, extension, path, or physical size. Top <nmber> Files by <element> Displays the top files sorted by the specified element. Yo can configre the maximm nmber of top-contribting files to display. Top <nmber> Directories by <element> Displays the top directories sorted by the specified element. Yo can configre the maximm nmber of top-contribting directories to display. Filter rles and filters Yo can apply filter rles across live reports to isolate data relating to specific factors. While breakots specify a category of contribtors, filter rles specify an individal contribtor belonging to a category. For example, yo can breakot a data modle by protocol, and yo can apply a filter rle for iscsi. Breakots appear beneath data modles withot modifying the data modle; filter rles modify what data is displayed in data modles. Filters are cstomized collections of filter rles that yo can create, save, and apply to varios reports. If yo apply a filter rle to a report, all data modles in the report will only display data abot the filter rle. For example, yo cold apply a filter rle for a specific node in a clster. The data modles in the report that the filter rle was applied to wold display data abot that node. Yo can create and apply filters, which contain one or more filter rles. For example, a filter cold contain both a filter rle for a specific node in a clster and a filter rle for a specific client accessing that clster. Applying this filter wold case data modles to display information abot the interactions between only that node and client. Yo can save filter rles and then apply them to specific reports. Breakots Yo can apply breakots to data modles in order to view the individal contribtions of varios factors. Yo can apply only one breakot to a data modle at a time. Breakots are heat maps that display variations of color that visally represent each component's contribtion to overall performance. The darker the color on a heat map, the greater the associated component's contribtion to performance. Heat maps enable yo to track performance trends and to qickly identify hot spots where performance might be constrained by specific components. If yo rest the mose pointer over any point in a heat map, InsightIQ displays performance data for the specified component for that moment in time. Breakots are sorted in order of significance, with the most significant elements at the top of the list. Filter rles and filters 15
Introdction to InsightIQ For example, the following image illstrates the Average Transfer Size data modle, broken ot by Direction. Breakots can be sefl when trying to determine the case of a clster isse. For example, if yo broke ot a CPU sage data modle by node, yo cold then view the individal CPU sage of each node. The sm of individal breakots might not always match the total aggregate cont for a specified element. For example, not all network traffic is associated with a specific protocol. Therefore, the sm of the individal protocol-related breakots might not match the total reported protocol-related conts. Breakot definitions Each breakot displays the individal contribtions of specific factors. Each data modle spports specific breakots. The following list describes the factors that each breakot incldes. Accessed Time Breaks ot data by when a file was last accessed. Client Breaks ot data by individal client. Only the most active clients are represented in the data that is displayed. Disk Breaks ot data by individal disk. Disk Pool Breaks ot data by the size of files in each disk pool. Event Breaks ot data by individal network interface. Extension Breaks ot data by file extension. Direction Breaks ot data by inbond traffic. Interface Breaks ot data by individal network interface. Logical Size Breaks ot data by logical file size. Logical file size calclations inclde only data, and do not inclde data-protection overhead. Modified Time Breaks ot data by when a file was last modified. Node Breaks ot data by individal node. Nodes are identified by their logical node nmber (LNN). Operation Class Breaks ot data by the type of operation being performed. The following operation types are spported: Read File and stream reading. 16 InsightIQ 2.5 User Gide
Introdction to InsightIQ Write File and stream writing. Create File, link, node, stream, and directory creation. Delete File, link, node, stream, and directory deletion. Namespace Read Attribte, statistic, and ACL reading; lookps; and directory reading. Namespace Write Renaming; attribte setting; and permission, time, and ACL writing. File State Opening, closing, locking, acqiring, releasing, breaking, checking, and notifying. Session State Negotiating, inqiring, and maniplating protocol connections or sessions. Other File-system information and other operations that cannot be categorized. File System Analytics Path Breaks ot data by individal file name or directory name. Physical Size Breaks ot data by physical size. Physical size calclations inclde dataprotection overhead. Protocol Breaks ot data by protocol (for example, NFS or iscsi). Attribte Breaks ot data by a ser-defined attribte, if an attribte is defined. Yo can define attribtes throgh the OneFS command-line interface. The InsightIQ File System Analytics featre enables yo to create cstomizable reports that analyze data sage, data properties, and other performance data at the file-system level. For example, yo can create reports that show the distribtion of file sizes, ages, and locations. This type of data can be particlarly sefl if yo want to analyze capacity trends in order to plan for ftre storage needs. If yo want to enable the File System Analytics fnctionality, the monitored clster mst be rnning OneFS 6.0 or later. File System Analytics snapshots If File System Analytics is enabled, yo can configre InsightIQ to generate File System Analytics reslt sets from snapshots taken on a monitored clster. If yo enable snapshots for the File System Analytics job, OneFS takes snapshots initiated by InsightIQ on the monitored clster. InsightIQ then generates File System Analytics reslt sets from those snapshots. Generating reslt sets from snapshots enables yo to view data that represents an exact point in time. However, the process of taking a snapshot can negatively affect clster performance. The snapshots initiated by InsightIQ are sed only by InsightIQ and are not part of the Isilon SnapshotIQ modle. If yo disable snapshots for the File System Analytics job, InsightIQ generates File System Analytics reslt sets based on the crrent state of the monitored clster. Becase the state of the clster might change dring the data-collection process, generating reslt sets based on the crrent state of the clster prevents yo from viewing exact point-intime data. However, generating reslt sets based on the crrent state of the clster does File System Analytics 17
Introdction to InsightIQ File System Analytics reslt sets not reslt in the potential clster-performance isses that can occr from the snapshot method. If File System Analytics is enabled on a monitored clster, the clster generates File System Analytics reslt sets. InsightIQ generates file system reports from the File System Analytics reslt sets that it collects. One file-system report is generated from one reslt set. Reslt sets are named for the day and time that they were collected. By defalt, the monitored clster generates a reslt set once per day. Unlike InsightIQ data sets, which are stored on the InsightIQ datastore, File System Analytics reslt sets are stored on the monitored clster. The monitored clster rotinely deletes reslt sets to avoid any negative effects on system performance. Yo can specify the maximm nmber of reslt sets that are retained. If yo do not want a specific reslt set to be deleted, yo can pin a reslt set so that it cannot be deleted by the system. Clster-monitoring smmary InsightIQ incldes a clster-monitoring smmary page that enables yo to view overview information abot all monitored clsters. Yo can view the clster-monitoring smmary to verify the overall stats of all monitored clsters. The clster-monitoring smmary incldes overview information abot clster capacity, clients, throghpt, and CPU sage. Crrent information abot clsters appears alongside graphs that show the relative changes in these statistics over the past 12 hors. The clster-monitoring smmary incldes an aggregated-clster view that displays the total or average vales of monitored-clster stats information. The aggregated-clster view can be sefl when deciding what to inclde in a performance report. For example, if yo see that the total network throghpt of all monitored clsters is higher than anticipated for the crrent time and day, yo can create a cstomized performance report that incldes data abot network throghpt. Yo can then break ot network throghpt by direction in the report to determine whether one direction of throghpt is contribting to the total more than the other. The clster-monitoring smmary also incldes separate individal-clster views that displays information on a specific monitored clster. Individal-clster views can be sefl when deciding which clsters to apply a performance report to. For example, if yo identify a throghpt isse from the aggregated-clster view, yo can qickly review the individal-clster views to determine which clster is the sorce of the isse. Yo can then create a performance report in order to view more detailed information abot the problem. Yo might determine that the isse is isolated on one specific clster, and that yo therefore need to apply the report to only one clster. The individal-clster views cold also reveal that the problem is occrring on all clsters, and yo need to apply the report to all clsters individally in order to identify the sorce of the isse. Read-only sers A read-only ser can log in to the InsightIQ application and monitor clster activity bt cannot modify any configration settings. A read-only ser cannot create performance reports or add read-only ser acconts. Dring the initial InsightIQ setp process, yo configred the defalt administrator ser accont; the administrator ser can configre InsightIQ settings in addition to monitoring clster activity. The administrator can also create, modify, and delete acconts for read- 18 InsightIQ 2.5 User Gide
Introdction to InsightIQ Permalinks only sers. There is exactly one administrator ser accont. However, the administrator can configre an nlimited nmber of read-only sers. A permalink is a static link that enables yo to save or share an InsightIQ report in a specific configration. Permalinks can save time if yo want to freqently view the same data for a certain period of time, or want to share that data with other InsightIQ sers. If yo create a permalink, InsightIQ generates and displays a URL that represents a shortct to a configred report. Yo can then go to this URL at any time to view the report in that specific configration. For example, yo might want to share a report configred to display information abot the external network throghpt of Node 5 from 11:20:00 to 12:20:00 on 2011-02-15. Yo cold view, configre, and create a permalink of the report, and then send the generated URL to other InsightIQ sers to enable them to view that information. The high-resoltion data displayed in permalinks will degrade over time de to the InsightIQ data-retention and downsampling policies. Permalinks 19
Introdction to InsightIQ 20 InsightIQ 2.5 User Gide
CHAPTER 2 Configring InsightIQ Yo can manage InsightIQ monitored-clster, datastore, email and File System Analytics settings throgh the InsightIQ web application; these settings are not available in the command-line interface. Yo can also manage network and athentication settings of the InsightIQ virtal appliance. Depending on which version of the OneFS operating system the monitored clster is rnning, certain InsightIQ featres may not be available. Managing monitored clsters...22 Managing datastores...25 Managing data-resoltion policies...28 Managing File System Analytics reslt sets...29 Configring File System Analytics settings...31 Managing InsightIQ virtal appliance settings...33 Managing read-only sers...35 Configre email settings...36 Create a permalink...36 Configring InsightIQ 21
Configring InsightIQ Managing monitored clsters Add a new clster to monitor Yo can manage settings that control how InsightIQ accesses a monitored clster, and yo can add or remove monitored clsters. Yo can also import existing monitored clsters from other instances of InsightIQ, and yo can temporarily sspend clster monitoring. Yo can configre InsightIQ to monitor more than one Isilon clster simltaneosly. The maximm nmber of clsters that yo can simltaneosly monitor varies depending on the resorces available to the virtal machine. It is recommended that yo monitor no more than five clsters or 125 nodes at one time. If yo want to monitor more clsters or nodes than this, it is recommended that yo deploy an additional instance of InsightIQ. To enable InsightIQ to connect to a monitored clster, yo mst specify the host name or IP address of any node on the monitored clster, and the athentication credentials for the local InsightIQ or API ser as they are configred on the monitored clster. If the monitored clster is rnning OneFS 6.0 or later, the corresponding local ser on the monitored clster is the InsightIQ (insightiq) ser. If the monitored clster is rnning a version of OneFS earlier than 6.0, the corresponding local ser on the monitored clster is the OneFS Platform API (api) ser. Yo can import a monitored clster from another instance of the InsightIQ. This can be sefl if, for example, yo have pgraded the InsightIQ software and yo want to contine monitoring a clster that the older version of InsightIQ was monitoring. If yo import a monitored clster, InsightIQ collects the configration settings for the monitored clster, as well as all data previosly collected for the clster, and adds them to the datastore associated with the crrent instance of InsightIQ. Before yo can view data abot a clster throgh InsightIQ, yo mst configre InsightIQ to monitor that clster. Before yo begin Verify that a valid InsightIQ license is enabled on the monitored clster; for more information, contact yor Isilon representative. Verify that the local InsightIQ ser is enabled and configred with a password on the monitored clster. 1. Click Settings > Monitored Clsters, and then, on the Monitored Clsters page, click Add Clster. The Add Clster dialog box appears. If yo are installing InsightIQ for the first time, the Add Clster dialog box might already be displayed. 2. In the Add Clster dialog box, click I want to monitor a new clster. 3. In the Isilon clster field, type the host name or IP address of any node in the clster that yo want to monitor. Alternatively, yo can type the name of an Isilon SmartConnect zone. 22 InsightIQ 2.5 User Gide
Configring InsightIQ Import a clster to monitor In general, it is recommended that yo specify a monitored clster by a SmartConnect zone name. However, if the monitored clster is heavily loaded and yo rely on InsightIQ file-heat data, it is recommended that yo specify the monitored clster by the IP address or host name of a specific node in the clster; avoid specifying an IP address that can be transferred from node to node. If yo choose to identify the monitored clster by a SmartConnect zone, specify a SmartConnect zone that incldes a CPU load-balancing policy. By balancing connections to nodes with lower CPU sage, the monitored clster can respond to InsightIQ data-collection qeries more qickly and efficiently. 4. In the Username field, type the ser name of the monitored clster's InsightIQ ser: If the clster is rnning OneFS 6.0 or later, type insightiq If the clster is rnning a version of OneFS earlier than 6.0, type api 5. In the Password field, type the password of the monitored clster's InsightIQ ser. 6. Click OK. InsightIQ begins monitoring the clster. If yo import a monitored clster from another instance of InsightIQ, InsightIQ immediately begins monitoring that clster. In addition, InsightIQ initiates a one-time process that imports data from the other instance of InsightIQ. Depending on the amont of data being imported, this import process can take a long time to complete. InsightIQ merges the imported data with the existing monitored-clster data and stores it in the datastore associated with the new instance of InsightIQ. Dring the import process, in order to ensre data integrity, the remote virtal machine (VM) that InsightIQ is importing clster data from might briefly sspend service, sht down, and then restart. Yo can import more than one monitored clster simltaneosly. However, doing so can significantly slow down the import process and affect overall performance. It is recommended that yo import no more than one monitored clster at a time. 1. Click Settings > Monitored Clsters, and then, on the Monitored Clsters page, click Add Clster. The Monitored Clsters page appears. If yo are installing InsightIQ for the first time, the Add Clster dialog box might have already appeared. 2. Click Add Clster. The Add Clster dialog box appears. 3. Click I want to monitor a clster already being monitored by... 4. In the InsightIQ VM host field, type the host name or IP address of InsightIQ. 5. In the Administrator password field, type the administrator password for InsightIQ. 6. Click OK. The Import Clster dialog box appears. 7. In the Password field for the clster that yo want to import, type the password that is sed to log in to the monitored clster and then press ENTER. InsightIQ validates the password. Import a clster to monitor 23
Configring InsightIQ Modify monitored-clster settings Sspend or resme clster monitoring 8. Select the check box for the clster that yo want to monitor, and then click Import. The clster is added to the list of monitored clsters. If yo modify the host name of IP address of a monitored clster, or its local InsightIQ ser credentials, yo mst also modify those settings accordingly in the InsightIQ application. InsightIQ ses these vales to connect to the monitored clster. 1. Click Settings > Monitored Clsters. The Monitored Clsters page appears and displays a list of all clsters that InsightIQ is configred to monitor. 2. For the clster whose settings yo want to view, in the Actions colmn, click Configre. The Configration page appears. 3. Modify the monitored-clster settings as needed, sbmitting changes on each tab. As an alternative to permanently deleting a monitored-clster entry, yo can instead temporarily sspend monitoring for the clster and then resme monitoring later. If yo sspend monitoring for a clster, InsightIQ completes any data collection qeries that are crrently in process bt does not start any new qeries ntil yo resme monitoring. The datastore remains intact, bt InsightIQ does not collect or store any new data. Depending on how long monitoring is sspended, reports for the affected clster might display periods of missing data. 1. Click Settings > Monitored Clsters. The Monitored Clsters page appears and displays a list of all clsters that InsightIQ is configred to monitor. The crrent monitoring state of each clster is indicated in the Actions colmn. If the Sspend link is displayed, InsightIQ is crrently monitoring the clster. If the Resme link is displayed, InsightIQ is not monitoring the clster. 2. For the clster whose monitoring state yo want to modify, click Sspend or Resme. Stop monitoring a clster and delete clster data If yo no longer want to collect new data or view historical data for a clster, yo can permanently stop monitoring the clster and delete all historical data for that clster. If yo stop monitoring a clster, InsightIQ deletes all data that was previosly collected from that clster; yo cannot ndo the deletion. As an alternative to this procedre, if yo want to retain previosly collected data for a clster bt want to temporarily stop monitoring the clster, yo can temporarily sspend monitoring and then resme monitoring later. 1. Click Settings > Monitored Clsters. The Monitored Clsters page appears and displays a list of all clsters that InsightIQ is configred to monitor. 2. In the Actions colmn, click the Delete link for the clster that yo want to permanently stop monitoring. A confirmation dialog box appears. 3. Click OK. 24 InsightIQ 2.5 User Gide