This upgrade will start at approximately 2:00am on Wednesday, August 8th. It should be completed before end of day on Thursday, August 9th.
Read-only mode outline - in progress 2:20am, 8/8
- (before that night) modify firewall rules as needed between production and test to allow test to work as production - completed 7/28
- Confirm backup completed successfully - completed 2:29am, 8/8
- Take down production - completed 2:29am, 8/8
- Re-do backup manually if needed - completed 2:29am, 8/8
- Copy backup volumes to test instances with latest production data - completed 3:30am, 8/8
- Make sure endeavor group still exists for old definitions of Global_bin service
- Make sure /m1/voyager/xxxdb mount point isn't pointing to old data/volume
- Add lines to ipf.conf to block traffic into read-only oracle listener from test IP addresses
- Bring up test instances with production IP addresses, and with Oracle tablespace(s) set to read-only completed 3:30am, 8/8
- Verify and test/fix that test instances are working, and looking like production completed 3:30am, 8/8
- Destroy and copy backup database data files to production instance (after re-verifying backup) - to take advantage of proper ZFS block size completed 3:25am, 8/8
- Modify production zones as needed to come up on test IP addresses - completed 3:45am, 8/8
- Verify that production zones are working using the test IP addresses - completed 3:45am, 8/8
- Modify production firewall rules needing to be updated for the "*upg" IP addresses to work on the production servers
Upgrade
bw - 4:30am, Taking a break - status = After the successful disk space expansion, things look to be on track. Need to get a password for ILL extension download.
bw - 10am, all set, getting going.
- (before that night) put VIK on the production DB and web zones, and use it to download all installation files - completed 3:45am, 8/8
- (before that night) copy the DB server's xxxdb/ini/voyager.env to web server and update as needed - completed 3:45am, 8/8
- Expanding disk space to allow for upgrade - completed 4:20am, 8/8
- Getting password for ILL extension module - completed 9:30am, 8/8
- Run the VIK steps on DB server to menu 5 step 16 (Oracle catalog upgrade) - completed 10:35am, 8/8
- Run Oracle catalog upgrade on DB server, that will take a while, so while it's running... - completed 12:30pm, 8/8
- Run through up to Menu 5 on web server (and app server on shared instances) - completed 12:30pm, 8/8
- Finish menu 5 on DB server, and go to index gen - completed 2pm, 8/8
- After index regen is 'setup' by script, manually login to host, move and symlink from /m1/voyager/utility to /m1/incoming as needed to provide disk space - completed 2pm, 8/8
- Modify the REGEN.xxxdb files as needed to enable all indexes to be regenerated instead of the short list - completed 2pm, 8/8
- Run menu 6 and start the regen on the DB server - running at 2:37pm, 8/8
- On web server, run through menu 6, skipping steps 9 and 14-17 (steps 3 and 6 will try to access Oracle) - started 2:37pm, completed 4:05pm, 8/8 ~1.5 hours
- Once regens are done, bring DB server through menu 7 step 2 - completed 4:30pm, 8/8
- Bring web server through menu 7 step 2 - completed 4:30pm, 8/8
- Finish steps on DB server then web server - completed 4:30pm, 8/8
- Modify the /m1/voyager/xxxdb/tomcat/conf/server.xml file on DB server to allow all appropriate IP ranges to access VXWS. - completed 4:30pm, 8/8
- Put the new services under TCP wrappers - completed 4:30pm, 8/8
Test
- bw 5pm, 8/8, upgrade looks complete - header image doesn't seem to be showing up on the webvoyage classic screen, hmmm, not sure why yet.
- At this point the upgraded production zones will be named 'laclibupg.wisconsin.edu' and 'lacvoydbupg.wisconsin.edu' with the same port range, so the OPAC should be tested as needed, and so should at least one set of clients if desired.
Switch Back production - scheduling - 2pm 8/9
- Reconfigure zone files so that the prod IP addresses will come up on prod after a reboot - completed 2pm, 8/9
- Reconfigure Oracle listener config and hosts file for production to come up correctly - completed 2pm, 8/9
- Reconfigure firewall if needed - completed 2pm, 8/9
- Shut down test/read-only instances - completed 2pm, 8/9
- Reboot the production zones to come up with production IPs - completed 2pm, 8/9
- Verify/fix anything needed - completed 2pm, 8/9
- Bring up test zone as 7.2.3 as needed
- Install newBooks on new instance (not tab, just files and script) and test script - completed 2:30pm, 8/9
- Reconfigure and/or test Shelflister on new instance - completed 3pm, 8/9