Creating a large, scalable, and redundant voic cluster using OpenSIPS and FreeSWITCH

Transcription

1 OpenSIPS Summit 2018 Amsterdam Alex Goulis Creating a large, scalable, and redundant voic cluster using OpenSIPS and FreeSWITCH OpenSIPS Summit Amsterdam 1

2 My experience Designing multi-tenant business VoIP platforms since 2009 Lead developer for Ratetel's Virtual PBX and trunking platform First certified OpenSIPS professional OpenSIPS Summit Amsterdam 2

3 Advantages of using OpenSIPS Highly scalable Stable code base Can handle tens of thousands of registrations Central point for presence and billing Dynamic routing Packet mangling to alter packets for custom purposes Highly available OpenSIPS Summit Amsterdam 3

4 Advantages of using Freeswitch Supports more concurrent calls than most other open source PBXs (asterisk) Rich media handling capabilities Many different config methods (flat xml, lua, dynamic xml, Direct ESL, many others) Stable code base and long time affinity with Opensips So many class 5 features, even ones you didn't think you needed OpenSIPS Summit Amsterdam 4

5 Tenants of a highly available system Network Sip edge should involve HA for OpenSIPS for both inside the DC and Cross DC VM servers should be split across redundant network and power connections Database layer should be replicated and available across all Dcs Storage layer should be replicated and available across all DCs OpenSIPS Summit Amsterdam 5

6 Network choices Use clustering with OpenSIPS to distribute your SIP edge Use hot/cold standby via vrrp or similar ip sharing tools inside the DC Use BGP, DNS SRV, or Anycast to geo distribute OpenSIPS Summit Amsterdam 6

7 VM / Freeswitch Layer Maintain enough servers behind each edge to easily handle the average load Keep plenty of resources in reserve when traffic converges after DC failures Exist only in the private network using public to private bridging, thus reducing chances of network events that can affect their load XML data fed from xml_curl connection to the web servers OpenSIPS Summit Amsterdam 7

8 Database Layer First handle replication inside the DC Based on your choice of DB backend, your replication techniques could be different. Tackle the challenge of Geo-distributing your data with consistency in mind In some cases can be used as the storage layer as well. (databases that support object store) OpenSIPS Summit Amsterdam 8

9 Storage Layer It's not just replicating, it's replicating A LOT of data! Biggest challenges in Geo-distributing voic usually don't arrive until your data footprint gets big. Plan for the future from the start, choose software that was built with geo-distribution in mind from the beginning. GlusterFS, S3, Ceph OpenSIPS Summit Amsterdam 9

10 Opensips configuration (multitenant) Use load balancer module to catalog your freeswitch servers Will automatically remove servers when down, and add them when available again. Can fetch Freeswitch load stats to do more accurate load balancing Easy to add/edit servers to the pool OpenSIPS Summit Amsterdam 10

11 What we use... OpenSIPS in HA using vrrp and shared IP Redundant network connections inside the DC DNS SRV for Geo failover Mysql Master-Master between Dcs GlusterFS for Geo distributing the storage OpenSIPS Summit Amsterdam 11

12 Inside the DC Opensips a Internet shared IP Ucarp or vrrp using shared ip Opensips b Rtp proxy 1 MDB 1 Web a Fs 1 Rtp proxy 2 MDB2 Web b Fs 2 OpenSIPS Summit Amsterdam 12

13 Between DCs DNSSRV DC 1 DC 2 MARIADB / Galera Cluster Gluster FS OpenSIPS Summit Amsterdam 13

14 Freeswitch mod_xml_curl Freeswitch module to feed realtime xml data to freeswitch including configuration data Simple to implement using many languages (php, python, java, etc) fs_curl available in fs contrib, great primer Using fs_curl can be configured using included db tables or via custom xml hooks We will use PHP with xml writer for our custom extensions OpenSIPS Summit Amsterdam 14

15 MariaDB & Galera Synchronous replication Active-active multi-master topology Read and write to any cluster node Automatic membership control, failed nodes drop from the cluster Automatic node joining True parallel replication, on row level No learning curve from mysql OpenSIPS Summit Amsterdam 15

16 Apache web server Most widely used http server Built in support for PHP Resilient and easy to scale with nginx Easy to configure Used to serve XML configuration files to Freeswitch for VM configuration OpenSIPS Summit Amsterdam 16

17 Php xml writer Shipped with PHP Easy to understand and simple to use Builds structured XML for Freeswitch to consume OpenSIPS Summit Amsterdam 17

18 Freeswitch voic example $obj -> xmlw -> startelement('section'); $obj -> xmlw -> writeattribute('name', 'dialplan'); $obj -> xmlw -> writeattribute('description', 'FreeSWITCH Dialplan'); $obj -> xmlw -> startelement('context'); $obj -> xmlw -> writeattribute('name', 'voic '); $obj -> xmlw -> startelement('extension'); $obj -> xmlw -> startelement('condition'); $obj -> xmlw -> startelement('action'); $obj -> xmlw -> writeattribute('application', 'voic '); $obj -> xmlw -> writeattribute('data', 'default $${domain} ${dialed_extension}'); $obj -> xmlw -> endelement(); $obj -> xmlw -> endelement(); //</extension> $obj -> xmlw -> endelement(); //</context> $obj -> xmlw -> endelement(); //</section> OpenSIPS Summit Amsterdam 18

19 OpenSIPS Summit Amsterdam 19