A High Performance, High Reliability Perforce Server. Shiv Sikand, IC Manage Marc Lewert, Angela Thomas, TiVo

Transcription

1 A High Performance, High Reliability Perforce Server Shiv Sikand, IC Manage Marc Lewert, Angela Thomas, TiVo

2 Advanced Perforce Solutions Semiconductor design companies Design tool plug-ins Cadence, Synopsys, Mentor, Magma Enterprise Solutions High Performance Servers Sync Engine Caching Accelerator

3 Loss of interactive performance User complaints Build system slowdown Long checkpoint times Long verify times

4 Server demands Large number of build clients running sync every 15 minutes Complex build system Large file counts, complex mappings

5 Server Environment Sun 420R Hitachi 9200 Storage Array Veritas VXFS RAID5 Storage Area Network

6 Uptime issues Server hardware failures VXFS problems

7 SAN Advantages Protect against hardware failures Decoupled storage Easy storage scalability Consolidated backup and disaster recovery for all data

8 SAN Disadvantages Increased latency Hardware wires Kernel & I/O subsystem distance to disk drives Software wires Network and switching protocols

9 Performance Considerations Large DB s are disk seek limited Random and Sequential I/O performance is key SAN s can turn sequential I/O into random I/O

10 IC Manage Solution High performance, high availability server Sync Engine

11 Linux IC Manage Servers Low cost x86 hardware Direct attached disks High MTBF High performance kernels Asynchronous directory updates Next generation XFS filesystem Journalled, RAID optimized, scalable

12 Pros Direct Attach Arrays Performance Ease of use Monitoring utilities, configurable RAID levels Logical volume management Web based management interfaces

13 Cons Direct Attach Arrays System failures can result in long downtimes Motherboard, controllers, network interfaces

14 Linux High Availability Dual hosts with failover heartbeat package Serial pulse Ethernet pulse IP address takeover Service stop/start

15 Linux High Availability Dual active-active controllers RAID10 volume Redundant power

16 Linux High Availability Performance and reliability are always tradeoffs Active-active controllers offer less performance than single controllers

17 Sync Engine Designed for Automated Syncing Avoid interval based syncs Eliminate continual db lookups Prevent excessive read locks Prevent write starvation Use sync optimisation automatically p4 sync No need to modify build system

18 Method of operation MySQL based QT GUI front end Register whole clients or views Two operating modes Active Automated scheduling Managed Query based

19 Method of operation Monitor change counter Parse change descriptions and match against registered mappings Multi-threaded scheduler RSH or SSH based execution Hosts or groups Store change number on success p4 sync [spec]

20 TiVo Data Analysis Angela Thomas

21 FigureOldServer

22

23

24

25

26

27

28

29

30

31 Command execution time time 8 Old New describe dirs filelog fstat have changes

32 Command execution time time 3 Pre Post edit open opened reopen add delete

33 Command execution times time Pre Post diff2 integ revert review reviews

34 Command execution times time verify Pre Post

35

36 Enterprise Storage Requirements Data consolidation from multiple sites Network storage %, 24x7 Availability Backup, archiving, disaster recovery Scalability

37 Caching Accelerator Block diagram Fader Enterprise Storage Replicator Disk Cache Server

38 p4jrep based Change driven Replicator Near real time replication of both db and archive files Supports scp, rcp or rsync

39 Fades old data Two modes Fader Removes from local storage Uses link replacement to replica Custom p4 client/api class Traps librarian errors and signals fader for recovery Retries failed operation

40 Conclusion IC Manage high performance servers Demonstrate significant performance advantages Offer high availability

41 Sync Engine Conclusion Scalable alternative to interval based syncing Suit complex build environments

42 Conclusion Caching Accelerator Best of both worlds for enterprises Performance and Reliability

43 Thank you!