Troubleshooting and Monitoring ARX v6.1.1

Transcription

1 Troubleshooting and Monitoring ARX v6.1.1 Table of Contents Module1: Introduction COURSE OBJECTIVES... 1 COURSE OVERVIEW... 1 PREREQUISITES... 2 COURSE AGENDA... 2 F5 PRODUCT SUITE OVERVIEW... 4 BIG-IP PRODUCT FAMILY... 4 ARX SERIES... 6 OTHER PRODUCTS... 7 HARDWARE... 7 VIPRION AND BIG-IP HARDWARE... 7 ARX HARDWARE... 9 ENTERPRISE MANAGER HARDWARE VIRTUAL EDITIONS F5 SERVICES GETTING STARTED TECHNICAL SUPPORT SERVICES PROFESSIONAL SERVICES GLOBAL TRAINING SERVICES Module 2: Troubleshooting Methodology and F5 Resources TROUBLESHOOTING METHODOLOGY... 2 INTRODUCTION... 2 LOGICAL TROUBLESHOOTING STEPS... 2 Data Sources and Collection... 2 Data Analysis and Problem Isolation... 4 Execution and Damage Control Plan... 4 Systematic Plan Execution... 4 Problem Resolution and Verification... 5 Preventive Measures and Disaster Recovery... 5 F5 RESOURCES AND TOOLS... 6

2 F5 RESOURCE AUTHENTICATION... 6 F5 UNIVERSITY... 7 ASKF5 KNOWLEDGE BASE... 8 ARX MANUAL MATRIX Module 3: ARX Manager Monitoring HEALTH INDICATORS... 2 STATUS ICONS... 2 STATE OR STATUS DESCRIPTORS... 2 REPORTS... 2 LOG FILES STATISTICS MONITORING... 3 ARX MANAGER MONITORING... 3 LICENSE INFORMATION AND STATUS... 3 HARDWARE SYSTEMS STATUS... 4 REDUNDANCY STATUS... 5 SYSTEM HEALTH STATUS INFORMATION... 5 STORAGE STATUS... 6 VOLUME GROUPS... 6 Destage Volume Group... 6 VIRTUAL SERVICES STATUS... 7 EXPORT STATUS... 8 VOLUME STATUS... 9 CHASSIS HARDWARE STATUS... 9 Power... 9 TEMPERATURE DISK STATUS FAN STATUS NTP STATUS NETWORK MONITORING Viewing Interface Statistics Summary Viewing Logical Channel Statistics Viewing Physical Interface Statistics Viewing Physical Interface Details RON STATISTICS Viewing Health of other Switches in the RON Viewing Active Routes in the ARX Manager NAMESPACE MONITORING Monitoring Metadata Free Space in the ARX Manager Monitoring Share Free Space with the ARX Manager USING THE ARX MANAGER TO VIEW REPORTS... 14

3 MODULE 4: COMMAND LINE INTERFACE (CLI) MONITORING NETWORK MONITORING... 2 MONITORING TOOLS... 2 MONITORING THE NETWORK LINKS... 2 Link Status... 2 Showing Interface Details... 3 Link Status - Port Details... 3 Showing Channel Details... 4 Link/Channel Statistics... 6 Viewing Link/Channel Statistics... 6 Link/Channel Counters... 6 MONITORING THE RESILIENT OVERLAY NETWORK (RON)... 9 RON Statistics... 9 Monitoring RON Statistics... 9 Viewing RON Statistics Viewing RON Statistics for a Tunnel MONITORING NETWORK ROUTING ARX Routing Overview ARX Gateway Overview Showing Routes Showing Status of Installed/Active Routes Showing when a Route Transitioned Network Monitoring Summary USING TRACEROUTE TRACING NSM PROCESSES Changing Logging Levels Disabling Logging Accessing the fastpath Log NAMESPACE MONITORING OVERVIEW CHECKING NAMESPACE HEALTH MONITORING PROCESSORS MONITORING FILER STATISTICS High Level Filer Statistics Filer Statistics Per Filer Filer Statistics Per Share Show Filer Connection Counts MONITORING VIRTUAL SERVER STATISTICS Global Server Statistics Monitoring Service Stats CIFS Users Monitoring Kerberos Tickets... 29

4 MONITORING CIFS AUTHENTICATION STATISTICS Verbose Output Clearing CIFS Authentication Statistics MONITORING NETWORK LOCK MANAGER (NLM) Monitoring NLM Locks MONITORING IMPORTS Monitoring Import Progress with CLI Monitoring Import Progress with Scripts Monitoring Imports with syslog Monitoring Imports with SNMP Traps / Reports MONITORING THE NAMESPACE Monitoring Files in a Managed Volume Monitoring Metadata Free Space with CLI Monitoring Share Free Space with CLI Monitoring CIFS Path Cache Namespace Monitoring Summary METADATA UTILITIES Monitoring nsck and sync Jobs Showing Metadata Cancelling a Report Warning Signs for Metadata Inconsistencies METADATA SYNCHRONIZATION Synchronizing Files Synchronizing Directories MONITORING VOLUMES Showing Share Statistics Managing Namespace Collisions Finding Collisions with CIFS 8.3 Names Module 5: File Maintenance WORKING WITH FILES... 2 SHOWING ARX DIRECTORIES AND THEIR CONTENTS... 2 CLI Show syntax... 2 PAGING THROUGH A FILE... 2 SEARCHING FILES FOR CONTENT... 3 Applying a second filter to the grep output... 3 Searching the end of a file... 4 Examples... 4 USING TAIL TO DISPLAY THE END OF A FILE... 4

5 CLI tail syntax... 4 Examples... 5 MANAGING REPORTS... 7 REPORT SOURCES... 7 VIEWING REPORTS... 7 CLI show reports syntax... 7 Examples... 8 REPORT FORMATS... 8 VIEWING REPORT OUTPUT... 9 Filtering the Report Output... 9 TERMINAL LOGGING CLI terminal logging syntax SCHEDULING REPORTING JOBS Scheduling a CLI command or script to run Displaying all scheduled CLI jobs Removing one or more scheduled CLI jobs MANAGING LOGS ABOUT SYSLOG Logging Levels VIEWING SYSLOG Configuring External syslog Destination CONFIGURATION FILES BASICS CONFIGURATION FILES OVERVIEW VIEWING CONFIGURATION FILES BACKING UP CONFIGURATION FILES Scheduling Backups SAVING THE RUNNING CONFIGURATION LOCAL CONFIG Saving to an FTP server Saving to an SCP server Saving to an ARX volume GLOBAL CONFIG SHOW COMMAND RESTORING THE CONFIGURATION ERASING CURRENT CONFIGURATION RESTORING THE ARX CONFIGURATION (SINGLE ARX) RESTORING A REDUNDANT PAIR Peer A Peer B Peer A Restoring to one peer... 23

6 ARX MANAGER OFFSITE BACKUP / RESTORE GLOBAL CLEAR REINTEGRATING SNAPSHOTS SNAPSHOT RECONSTITUTION REPLICA SNAPSHOT SHARES Module 6: Global Server Access Troubleshooting CHECKING MOUNT PATH/PERMISSIONS... 2 CHECKING NFS ACLS... 3 TROUBLESHOOTING CIFS SERVICES... 4 OVERVIEW... 4 SHOWING CLIENT-CONNECTION STATISTICS... 4 Showing Statistics from One NSM Processor... 5 SHOWING CLIENT SESSIONS... 6 Showing Client Sessions at One NSM Processor... 7 GETTING DETAILS ON A SINGLE CLIENT... 7 DROPPING A CIFS CLIENT... 8 LISTING OPEN FILES IN A CIFS SERVICE... 9 Focusing on One NSM Processor CLOSING AN OPEN FILE LISTING KERBEROS TICKETS GRANTED TO CLIENTS Listing Tickets Granted to a Particular Principal SHOWING CIFS WORK QUEUES SHOWING STATISTICS Module 7: ARX Configuration Troubleshooting INTRODUCTION... 1 MODULE OBJECTIVES... 1 INITIAL TROUBLESHOOTING... 2 INITIAL ASSESSMENT... 2 SYSTEM WIDE TRIAGE... 2 CHECKING SYSTEM STATUS... 2 System Wide Triage Summary... 4 NETWORK CONNECTIVITY... 5 OVERVIEW... 5 PHYSICAL LINKS CHECK... 5 Late Collisions check... 6 CORRECT MAC ADDRESSES... 6

7 CORRECT VLAN... 7 CORRECT VLAN (ARX-500)... 7 CORRECT NETWORK... 8 IP Route... 8 VIEWING IP TRAFFIC IN ARX MANAGER... 9 CHANGING THE SIZE AND NUMBER OF CAPTURE FILES STOPPING THE CAPTURE CAPTURING ALL PROXY-IP TRAFFIC LISTING ALL CAPTURE FILES Viewing the Capture File Showing All Capture Sessions COPYING THE CAPTURE FILE TO AN FTP SERVER COPYING THE CAPTURE FILE TO AN SCP SERVER DIAGNOSTICS AUTO DIAGNOSTICS COLLECT DIAGNOSTIC INFORMATION COLLECTING DIAGNOSTIC INFORMATION (CLI) Partial Collect SENDING THROUGH SCP PLACING THE DIAGNOSTICS FILE INTO AN ARX VOLUME COLLECTING THE INFORMATION LOCALLY VIEWING THE STATE FILE ASYNCHRONOUS COLLECTION REMOTE HOST EXECUTION POLICY MONITORING AND TROUBLESHOOTING SHOWING POLICY HISTORY Showing Detailed Status for a Particular Rule SHOWING ANY OR ALL PENDING MIGRATIONS Showing Auto-Closed Files (CIFS) Canceling All Pending Migrations Canceling the Migration of a Single File MONITORING MIGRATIONS Migrations Job History Migrations Statistics View Migration Statistics in ARX Manager SHARE FARMS ACTIVE MIGRATIONS Monitoring the Queuing Source Data Mover Engine (DME) Statistics on Migration Viewing File Migration Activity ADVANCED POLICY TROUBLESHOOTING Troubleshooting Precedence Issues... 34

8 Viewing Policy action messages in syslog Finding Out What a Rule Is Doing File Scans Migrations Module 8: File Server Troubleshooting VALIDATING ARX SERVER CONNECTIVITY... 2 VALIDATING SERVER CONNECTIVITY TO SHARES... 2 VALIDATING CONNECTIVITY TO MULTI-HOMED SERVER... 3 NFS BACK-END FILERS... 4 Protocols... 4 NFS Share Name... 5 NFS Share Paths... 6 NFS Share Resources... 8 CIFS BACK-END SERVERS... 9 Protocols... 9 Share Name Share Access Share Resources Checking the Clock Skew Module 9: Disaster Prevention and Recovery DISASTER PREVENTION... 2 Disaster Recovery Planning... 2 High Availability Requirements... 3 Data Protection Planning and Regulations... 3 Planning Steps... 3 DISASTER RECOVERY... 3 Top Level Conflict Resolution... 5 Namespace Conflict Resolution... 5