Splitting and Merging. Down and Dirty Made Easy

Transcription

1 Splitting and Merging Down and Dirty Made Easy

2 Splitting WebGUI Sites E unus pluribum

3 Splitting WebGUI Sites Two possible ways Duplicate and cut-down No need for messy rewrite rules Entirely separate site to spread over server load Easier to accomplish

4 Splitting WebGUI Sites Two possible ways Make a "Virtual" site Using Apache's mod_rewrite No duplication of assets or files Simplifies tricks between sites like SSO

5 Duplicate + Cut-Down A site divided against itself

6 Duplicate and Cut-Down Far easier than any messy database / file operations to physically split a WebGUI site Not as flexible as Virtual sites Do as much inside WebGUI as possible Keep only the assets and files we need Complete copy of everything else

7 Set the Stage Change into

8 Setting Up Make a new Page Layout to hold our entire site Cut and paste our new site's content into this Layout

9 Duplicate and Cut-Down Create a new site to copy over addsite.pl ---adminpassword=<> --sitename= wreconsole.pl

10 Duplicate Database mysqldump -u<> -p<> www_plainblack_com mysql -u<> -p<> www_webgui_org Files cp -r /data/domains/ /data/domains/ Clear the Cache whenever raw changes to the database are made rm -rf /tmp/webguicache Restart and test

11 and Cut-Down Delete all the assets we don't need from both sites Set our Home page for the new site DONE!

12 Making a Virtual Site A Little Slight of Regex

13 Making a Virtual Site Two domains, One database / files Apache mod_rewrite Makes setup invisible to end-user Additional Benefits No duplication of shared assets / files SSO using new Operation ssoviasessionid

14 Making a Virtual Site Disadvantages More complicated to set up Shared statistics

15 Set the Stage Change into

16 Making a Virtual Site First: Create a new, toplevel Page Layout asset Will act as our "Home" page for our new site Will hold everything for URL:

17 Making a Virtual Site Move all our content to our new Page Layout Use existing "cut" and "paste" operations All content from webgui is now under /webgui

18 Normalize URLs Ensure all our new site's asset's URLs begin with /webgui Necessary for the mod_rewrite rules Edit Branch

19 Normalize URLs Parent URL is required Menu Title or Title creates a new URL Current URL will keep the old URL with the new domain Change recursively: Yes!

20 Making a Virtual Site Site cleanup Commit our changes Test our new site Change style template / other things with Edit Branch Prepare to write our mod_rewrite rules

21 Configure Apache <VirtualHost *:80> ServerName ServerAlias plainblack.com DocumentRoot /data/domains/ RewriteEngine On # block IIS related attacks from getting to WebGUI RewriteRule ^/scripts/ - [L] RewriteRule ^/default.ida - [L] RewriteRule ^/_vti_bin - [L] RewriteRule ^/_mem_bin - [L] # proxy webgui pages RewriteRule ^/(.*) [P] </VirtualHost>

22 Configure Apache Add domain to ServerAlias <VirtualHost *:80> ServerName ServerAlias plainblack.com webgui.org DocumentRoot /data/domains/ Whitespace-separated list of domain names Only necessary for modproxy under WRE Now Apache knows it's serving for two, but both point to the same place

23 Configure Apache RewriteEngine On RewriteEngine On Inside the <VirtualHost *:80> block Turns on mod_rewrite Only needed once per VirtualHost

24 Configure Apache RewriteRule <match> <replace> [options] Exchange any <match> in the URL with <replace> Only matches against the path section of the full URL RewriteCond <value> <match> [options] Only perform the next RewriteRule if the RewriteCond passes Many special variables to match against

25 Add Rewrite Rules Add these rules after other RewriteRules and Redirects # Handle webgui.org URLs RewriteCond ${HTTP_HOST} ^( RewriteRule ^/(.*)$ /webgui/$1 # proxy webgui pages RewriteRule ^/(.*) [P] It may take some tweaking to get the order of your RewriteRules correct Use RewriteLog and RewriteLogLevel to debug

26 Configure Apache Restart and Test May have to add our new hostname to /etc/hosts localhost plainblack.com webgui.org should now bring us to our new site

27 Configure Apache... but shows our new site too! We can redirect all calls to the new site RewriteCond ${HTTP_HOST} ^( RewriteRule ^/webgui/(.*)$ [RL]... but bookmarks to the old URL will all be broken! We can redirect the old URL to the new URL RewriteCond ${HTTP_HOST} ^( RewriteRule ^/software/webgui [RL]

28 Merging WebGUI Sites E pluribus unum

29 Merging WebGUI Sites Easier to split than to merge Thank GUIDs 1 in 64^22 or 5.4 * 10^39 or 54,000,000,000, 000,000,000,000,000,000,000,000,000,000 Better chance of hitting the multi-millions lottery trillions upon trillions of times Abstractions don't do it justice

30 Set up Two sites: and Merge to form Create a blank site to hold our merger Can move the merged site to replace one of our old sites later All we need to do to start over is delete the merged site addsite.pl --adminpassword=<> --sitename=

31 Make a base Start with a base of one of the sites Database mysqldump -u<> -p<> www_plainblack_com mysql -u<> -p<> www_plaingui_com Files cp -r /data/domains/ /data/domains/

32 Prepare to Merge Prepare the other site to be merged in Users and Groups Groups with the same groupid should be merged Users with the same username should have the same userid

33 Fix User IDs #!/data/wre/prereqs/perl/bin/perl use strict; use DBI; my $main = DBI->connect("DBI:mysql:dbname=www_plaingui_com","root","password",{RaiseError=>1}); my $merge = DBI->connect("DBI:mysql:dbname=www_webgui_org","root","password",{RaiseError=>1}); # Get all the users from the main db my $users = $main->selectall_hashref("select username,userid from users","username"); for my $username (keys %{$users}) { my $newuserid = $users->{$username}->{"userid"}; # See if this username exists in this db my ($olduserid) = $db->selectrow_array(q{select userid from users where username="$username"}); next unless $olduserid; print "Found overlap for user '$username' -- old ID: $olduserid -- new ID: $newuserid\n"; # Now we have an old user ID and a new user ID

34 Fix User IDs #!/data/wre/prereqs/perl/bin/perl use strict; use DBI; my $main = DBI->connect("DBI:mysql:dbname=www_plaingui_com","root","password",{RaiseError=>1}); my $merge = DBI->connect("DBI:mysql:dbname=www_webgui_org","root","password",{RaiseError=>1}); # Get all the users from the main db my $users = $main->selectall_hashref("select username,userid from users","username"); for my $username (keys %{$users}) { my $newuserid = $users->{$username}->{"userid"}; # See if this username exists in this db my ($olduserid) = $db->selectrow_array(q{select userid from users where username="$username"}); next unless $olduserid; print "Found overlap for user '$username' -- old ID: $olduserid -- new ID: $newuserid\n"; # Now we have an old user ID and a new user ID

35 Fix User IDs # Get all the users from the main db my $users = $main->selectall_hashref("select username,userid from users","username"); for my $username (keys %{$users}) { my $newuserid = $users->{$username}->{"userid"}; # See if this username exists in this db my ($olduserid) = $db->selectrow_array(q{select userid from users where username="$username"}); next unless $olduserid; print "Found overlap for user '$username' -- old ID: $olduserid -- new ID: $newuserid\n"; # Now we have an old user ID and a new user ID $db->do(qq{update $_ SET userid="$newuserid" WHERE userid="$olduserid"}) for (qw{ users userprofiledata groupings authentication }); } }

36 Fix User IDs # Get all the users from the main db my $users = $main->selectall_hashref("select username,userid from users","username"); for my $username (keys %{$users}) { my $newuserid = $users->{$username}->{"userid"}; # See if this username exists in this db my ($olduserid) = $db->selectrow_array(q{select userid from users where username="$username"}); next unless $olduserid; print "Found overlap for user '$username' -- old ID: $olduserid -- new ID: $newuserid\n"; # Now we have an old user ID and a new user ID $db->do(qq{update $_ SET userid="$newuserid" WHERE userid="$olduserid"}) for (qw{ users userprofiledata groupings authentication }); } }

37 Fix User IDs # Get all the users from the main db my $users = $main->selectall_hashref("select username,userid from users","username"); for my $user (values %{$users}) { my $newuserid = $user->{"userid"}; # See if this username exists in this db my ($olduserid) = $db->selectrow_array(q{select userid from users where username="$username"}); next unless $olduserid; print "Found overlap for user '$username' -- old ID: $olduserid -- new ID: $newuserid\n"; # Now we have an old user ID and a new user ID $db->do(qq{update $_ SET userid="$newuserid" WHERE userid="$olduserid"}) for (qw{ users userprofiledata groupings authentication }); } }

38 Merging Assets Asset IDs are GUIDs (the same improbability applies) Asset Lineage is the main problem WebGUI/sbin/rebuildLineage.pl Rebuilds the lineage from the asset's parentid Fixes any problems we might introduce by our next step

39 Everything Else Uses GUIDs for the sensitive bits GUIDs are assumed to be unique

40 The Final Act Merge the files cp -r /data/domains/ /data/domains/ Merge the database mysqldump -u<> -p<> --insert-ignore --skip-add-drop-table www_webgui_org mysql -u<> -p<> www_plaingui_com Rebuild the lineage cd /data/webgui/sbin perl rebuildlineage.pl --configfile=

41 The Final Act Clear the Cache rm -rf /tmp/webguicache Restart and test Pay attention to Navigation assets, they may need to be adjusted Once everything is working properly, we can exchange our merged site for one of our old sites if desired.

42 Wrapping Up

43 Conclusion Split WebGUI sites Two separate sites by duplicating and cutting down Two virtual sites sharing the same files/database Merge WebGUI sites Making one where once was two

44 Questions?