Internet2 Webinar: Confluence BoF. April 28, 2009

Size: px

Start display at page:

Download "Internet2 Webinar: Confluence BoF. April 28, 2009"

Eleanore Griffin
6 years ago
Views:

1 Internet2 Webinar: Confluence BoF April 28, 2009

2 Ques=ons to answer How massively can Confluence scale? What are its limita=ons? How does clustering help Confluence scale? What are some guidelines in tuning and configuring Confluence for large # s of users? What is Atlassian doing to improve Confluence performance and scalability over =me and in what =me period?

3 Confluence Scalability Guidelines Volume/Size User Management Clustering Availability Performance

4 Confluence out of the box: Volume/Size Guidelines <40K ac=ve pages, <200K revisions Reordering <300 pages in a space, or hierarchy of spaces Thousands of azachments (mbpf) Not a document management system Does not replace large disk storage array 10K+ spaces, but <500 manageable on user dashboard, <2000 filter by space dropdown

5 User Management Guidelines User Management for tens of thousands of users in mul=ple groups can be difficult Use Crowd Crowd LDAP connector for Confluence targeted early 2010 Crowd in large user environments (>10K users) University of Michigan (target: 300K users)

6 Clustering in Confluence Clustering is meant to increase capacity, not for high availability Addresses concurrent transac=on load Spreads load for parallel tasks across 2 4 nodes Not for single request performance in low load scenarios

7 Availability Scheduled down=me required for User management changes Patches Bug & Security fixes Upgrade to a new release Unscheduled down=me Bugs, or third party plugins can cause down=me Have a test server when installing plugins or tes=ng compa=bility with a new version of Confluence

8 Internal Performance Test Confluence Server Dell PowerEdge GB RAM 1 x 15K 72G disk Xeon Quad Core processors, 2GHz Tomcat 6 Java 1.6 Confluence 3.0 (latest build) Database Server Dell PowerEdge GB RAM 3 x 15K 72G disk in RAID5 config Xeon Quad Core processors, 2GHz Postgres 8.2

9 Performance Test: Confluence Install Environment 82 global spaces 68 personal spaces 20K pages 90K revisions 19K users Bundled plugins, very few non bundled plugins

10 Performance Test Scenarios Test simulates 100 concurrent users making btw requests per second (~1M hits/day) ~ to few days traffic compressed down to about 30 minutes, considered reasonably high load Usage pazern derived from real use cases on our public facing site All scenarios run in parallel

11 Performance Tes=ng Results Scenario Avg page views per second Avg response 7me for page views 95% percen7le Standalone, high load s 2s Standalone, Max load 17 3s 10s 2 node cluster, high load s 5.7s 2 node cluster, max load 15 9s 28s 95% percentile indicates how much time it takes for 95% of all actions w/in a scenario to finish. All the time used for all the scenario actions except for the worst 5%. 12 page views per second is a decent performance benchmark, 50K users on a system, only a certain % use the system regularly, and even fewer use it at the same time. Larger customers report 500K page views per day, which is about 6 page views per second

12 Performance Test your system Performance test your system with our scripts: hzp://confluence.atlassian.com/display/doc/ Performance+Tes=ng+Scripts

13 Resources Tips on opera=ng large Confluence instances hzp://confluence.atlassian.com/display/doc/ Opera=ng+Large+or+Mission Cri=cal+Confluence +Installa=ons Clustering on Confluence Tips and Advice hzp://confluence.atlassian.com/display/doc/ Cluster+Checklist Performance Tuning Tips hzp://confluence.atlassian.com/display/doc/ Performance+Tuning

14 Roadmap for Enterprise Features Feature BeZer responsiveness on UI 3.0 BeZer security (XSRF and cross site scrip=ng protec=on) Release Timeframe 3.0 BeZer stability in PDF export capabili=es (faster, looks bezer) 3.0 Add ability to tune caches from the UI 3.0 Improve Cluster Performance (60% bezer cluster performance and 40% performance bezer standalone) Improve usability of page tree for moving and ordering pages Solve some Space Management problems (>500 spaces on dashboard & search by space for >2000 spaces) 3.0 & Ongoing Q Q4 2009

15 Long term Enterprise Feature Direc=on Feature Category Stability Performance under high load Scalability Documenta=on Direc7on Bugs that cause memory leaks, db connec=on usage will be inves=gated and addressed Con=nued performance load tes=ng and incremental improvements per release Incremental improvements on clustering. We may refer customers to partners for customisa=on and alterna=ve scalability solu=ons Improve documenta=on to help administra=on and training (improved during every release) Blue: Short Term (within 1 year) Purple: Incremental Improvements (ongoing) Grey: Long Term (beyond 1 year)

16 Long term Enterprise Feature Direc=on Feature Category Security Usability Availability User Management Direc7on Address high priority security issues immediately, incremental security improvements based on regular security audit assessments Improve discoverability and ease of use for features Small incremental improvements to reduce down=me for certain configura=on changes Use Crowd for enterprise user management scenarios. Looking at offering Crowd LDAP connector in early 2010 for Confluence. Blue: Short Term (within 1 year) Purple: Incremental Improvements (ongoing) Grey: Long Term (beyond 1 year)

17 Partner Solu=ons If your Confluence installa=on plans to go beyond the stated guidelines, contact partners to: Size the system, planning a large installa=on Ongoing tuning the system for general improved performance Deep customisa=on for specific performance scalability improvements Poten=al lock in to the version that has been customised

18 Partner breakdown CustomWare Dedicated support for large Confluence instances Basic tuning and configura=on planning Plugin support and development Adaptavist Deep dive technical assistance and tuning Plugin support and development

19 Partner Solu=ons (Examples) Avono (Germany) has successfully scaled Confluence for a large wikipedia style installa=on CustomWare (APAC, US) has successfully managed Adobe for their large instance of Confluence hzp:// SUCCESS/Customer+Stories

20 Ques=ons? Download the early release of 3.0 for tes=ng here: hzp://confluence.atlassian.com/display/doc/ Development+Releases

@ COUCHBASE CONNECT. Using Couchbase. By: Carleton Miyamoto, Michael Kehoe Version: 1.1w LinkedIn Corpora3on

@ COUCHBASE CONNECT. Using Couchbase. By: Carleton Miyamoto, Michael Kehoe Version: 1.1w LinkedIn Corpora3on @ COUCHBASE CONNECT Using Couchbase By: Carleton Miyamoto, Michael Kehoe Version: 1.1w Overview The LinkedIn Story Enter Couchbase Development and Opera3ons Clusters and Numbers Opera3onal Tooling Carleton