Upgrade Exadata ibswitches


root@anarexadatatest02:~# /u01/app/11.2.0.3/grid/bin/crsctl stat res -t







--------------------------------------------------------------------------------







NAME TARGET STATE SERVER STATE_DETAILS







--------------------------------------------------------------------------------




Local Resources




--------------------------------------------------------------------------------

ora.DATAC1.dg




ONLINE ONLINE anarexadatatest01




ONLINE ONLINE anarexadatatest02




ora.DBFS_DG.dg




ONLINE ONLINE anarexadatatest01




ONLINE ONLINE anarexadatatest02




ora.LISTENER.lsnr




ONLINE ONLINE anarexadatatest01




ONLINE ONLINE anarexadatatest02




ora.RECOC1.dg




ONLINE ONLINE anarexadatatest01




ONLINE ONLINE anarexadatatest02




ora.asm




ONLINE ONLINE anarexadatatest01 Started




ONLINE ONLINE anarexadatatest02 Started




ora.gsd




OFFLINE OFFLINE anarexadatatest01




OFFLINE OFFLINE anarexadatatest02




ora.net1.network




ONLINE ONLINE anarexadatatest01




ONLINE ONLINE anarexadatatest02




ora.ons




ONLINE ONLINE anarexadatatest01




ONLINE ONLINE anarexadatatest02




ora.registry.acfs




ONLINE ONLINE anarexadatatest01

ONLINE ONLINE anarexadatatest02







-------------------------------------------------------------------------------







Cluster Resources

--------------------------------------------------------------------------------




EMCagent




1 ONLINE ONLINE anarexadatatest01




ora.LISTENER_SCAN1.lsnr




1 ONLINE ONLINE anarexadatatest02




ora.LISTENER_SCAN2.lsnr







1 ONLINE ONLINE anarexadatatest01







ora.LISTENER_SCAN3.lsnr




1 ONLINE ONLINE anarexadatatest01




ora.anarexadatatest01.vip







1 ONLINE ONLINE anarexadatatest01







ora.anarexadatatest02.vip







1 ONLINE ONLINE anarexadatatest02




ora.cvu




1 ONLINE ONLINE anarexadatatest01







ora.ANARDEV.db

1 ONLINE ONLINE anarexadatatest01 Open




2 ONLINE ONLINE anarexadatatest02 Open







ora.ANARLIVE.db







1 ONLINE ONLINE anarexadatatest01 Open

2 ONLINE ONLINE anarexadatatest02 Open







ora.ANARTEST.db




1 ONLINE ONLINE anarexadatatest01 Open













 2 ONLINE ONLINE anarexadatatest02 Open










ora.misuat.db










 1 ONLINE ONLINE anarexadatatest01 Open













 2 ONLINE ONLINE anarexadatatest02 Open













ora.oc4j







 1 ONLINE ONLINE anarexadatatest01




ora.scan1.vip








































 1 ONLINE ONLINE anarexadatatest02








































ora.scan2.vip








































 1 ONLINE ONLINE anarexadatatest01








































ora.scan3.vip








































 1 ONLINE ONLINE anarexadatatest01








































root@anarexadatatest02:~# su - oracle








































Oracle Corporation SunOS 5.11 11.1 April 2014








































oracle@anarexadatatest02:~$








































oracle@anarexadatatest02:~$








































oracle@anarexadatatest02:~$ cd /u01/app/oracle/product/11.2.0.3/dbhome_1/log/anarexadatatest0








































anarexadatatest01/ anarexadatatest02/








































oracle@anarexadatatest02:~$ cd /u01/app/oracle/product/11.2.0.3/dbhome_1/log/








































oracle@anarexadatatest02:/u01/app/oracle/product/11.2.0.3/dbhome_1/log$ ls -ltrh








































total 9








































drwxr-xr-x 3 oracle oinstall 3 Nov 6 2014 anarexadatatest01








































drwxr-xr-x 2 oracle dba 3 Nov 7 2014 diag








































drwxr-x--- 3 oracle oinstall 3 Nov 26 2014 anarexadatatest02








































oracle@anarexadatatest02:/u01/app/oracle/product/11.2.0.3/dbhome_1/log$ ls -ltrh *








































anarexadatatest01:








































total 3








































drwxr-xr-x 2 oracle oinstall 2 Nov 6 2014 client

























































































































diag:








































total 2








































-rw-r----- 1 oracle dba 16 May 5 12:13 adrci_dir.mif

























































































































anarexadatatest02:








































total 3








































drwxr-x--- 2 oracle oinstall 2 Nov 26 2014 client








































oracle@anarexadatatest02:/u01/app/oracle/product/11.2.0.3/dbhome_1/log$ ls -ltrh anarexadatatest01/*








































total 0








































oracle@anarexadatatest01:~$ logout








































root@anarexadatatest01:/u01/staging/upgrade# echo $consoletype

























































































































root@anarexadatatest01:/u01/staging/upgrade# dcli -g cell_group -l root "cellcli -e list griddisk attributes name, status, asmmodestatus;"








































anarexadatatest01: DATAC1_CD_00_anarexadatatest01 active ONLINE








































anarexadatatest01: DATAC1_CD_01_anarexadatatest01 active ONLINE








































anarexadatatest01: DATAC1_CD_02_anarexadatatest01 active ONLINE








































anarexadatatest01: DATAC1_CD_03_anarexadatatest01 active ONLINE








































anarexadatatest01: DATAC1_CD_04_anarexadatatest01 active ONLINE








































anarexadatatest01: DATAC1_CD_05_anarexadatatest01 active ONLINE








































anarexadatatest01: DBFS_DG_CD_02_anarexadatatest01 active ONLINE








































anarexadatatest01: DBFS_DG_CD_03_anarexadatatest01 active ONLINE








































anarexadatatest01: DBFS_DG_CD_04_anarexadatatest01 active ONLINE








































anarexadatatest01: DBFS_DG_CD_05_anarexadatatest01 active ONLINE








































anarexadatatest01: RECOC1_CD_00_anarexadatatest01 active ONLINE








































anarexadatatest01: RECOC1_CD_01_anarexadatatest01 active ONLINE








































anarexadatatest01: RECOC1_CD_02_anarexadatatest01 active ONLINE








































anarexadatatest01: RECOC1_CD_03_anarexadatatest01 active ONLINE








































anarexadatatest01: RECOC1_CD_04_anarexadatatest01 active ONLINE








































anarexadatatest01: RECOC1_CD_05_anarexadatatest01 active ONLINE








































anarexadatatest02: DATAC1_CD_00_anarexadatatest02 active ONLINE








































anarexadatatest02: DATAC1_CD_01_anarexadatatest02 active ONLINE








































anarexadatatest02: DATAC1_CD_02_anarexadatatest02 active ONLINE








































anarexadatatest02: DATAC1_CD_03_anarexadatatest02 active ONLINE








































anarexadatatest02: DATAC1_CD_04_anarexadatatest02 active ONLINE








































anarexadatatest02: DATAC1_CD_05_anarexadatatest02 active ONLINE








































anarexadatatest02: DBFS_DG_CD_02_anarexadatatest02 active ONLINE








































anarexadatatest02: DBFS_DG_CD_03_anarexadatatest02 active ONLINE








































anarexadatatest02: DBFS_DG_CD_04_anarexadatatest02 active ONLINE








































anarexadatatest02: DBFS_DG_CD_05_anarexadatatest02 active ONLINE








































anarexadatatest02: RECOC1_CD_00_anarexadatatest02 active ONLINE








































anarexadatatest02: RECOC1_CD_01_anarexadatatest02 active ONLINE








































anarexadatatest02: RECOC1_CD_02_anarexadatatest02 active ONLINE








































anarexadatatest02: RECOC1_CD_03_anarexadatatest02 active ONLINE








































anarexadatatest02: RECOC1_CD_04_anarexadatatest02 active ONLINE








































anarexadatatest02: RECOC1_CD_05_anarexadatatest02 active ONLINE








































anarexadatatest03: DATAC1_CD_00_anarexadatatest03 active ONLINE








































anarexadatatest03: DATAC1_CD_01_anarexadatatest03 active ONLINE








































anarexadatatest03: DATAC1_CD_02_anarexadatatest03 active ONLINE








































anarexadatatest03: DATAC1_CD_03_anarexadatatest03 active ONLINE








































anarexadatatest03: DATAC1_CD_04_anarexadatatest03 active ONLINE








































anarexadatatest03: DATAC1_CD_05_anarexadatatest03 active ONLINE








































anarexadatatest03: DBFS_DG_CD_02_anarexadatatest03 active ONLINE








































anarexadatatest03: DBFS_DG_CD_03_anarexadatatest03 active ONLINE








































anarexadatatest03: DBFS_DG_CD_04_anarexadatatest03 active ONLINE








































anarexadatatest03: DBFS_DG_CD_05_anarexadatatest03 active ONLINE








































anarexadatatest03: RECOC1_CD_00_anarexadatatest03 active ONLINE








































anarexadatatest03: RECOC1_CD_01_anarexadatatest03 active ONLINE








































anarexadatatest03: RECOC1_CD_02_anarexadatatest03 active ONLINE








































anarexadatatest03: RECOC1_CD_03_anarexadatatest03 active ONLINE








































anarexadatatest03: RECOC1_CD_04_anarexadatatest03 active ONLINE








































anarexadatatest03: RECOC1_CD_05_anarexadatatest03 active ONLINE








































root@anarexadatatest01:/u01/staging/upgrade# dcli -g cell_group -l root 'imageinfo -all'








































anarexadatatest01:








































anarexadatatest01: Kernel version: 2.6.39-400.128.17.el5uek #1 SMP Tue May 27 13:20:24 PDT 2014 x86_64








































anarexadatatest01: Cell version: OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest01: Cell rpm version: cell-12.1.1.1.1_LINUX.X64_140712-1








































anarexadatatest01:








































anarexadatatest01: Active image version: 12.1.1.1.1.140712








































anarexadatatest01: Active image created: 2014-07-15 15:51:29 -0700








































anarexadatatest01: Active image activated: 2014-10-04 15:02:40 -0700








































anarexadatatest01: Active image type: production








































anarexadatatest01: Active image status: success








































anarexadatatest01: Active image label: OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest01: Active node type: STORAGE








































anarexadatatest01: Active system partition on device: /dev/md5








































anarexadatatest01: Active software partition on device: /dev/md7








































anarexadatatest01:








































anarexadatatest01: In partition rollback: Impossible








































anarexadatatest01:








































anarexadatatest01: Cell boot usb partition: /dev/sdm1








































anarexadatatest01: Cell boot usb version: 12.1.1.1.1.140712








































anarexadatatest01:








































anarexadatatest01: Inactive image version: undefined








































anarexadatatest01: Rollback to the inactive partitions: Impossible








































anarexadatatest02:








































anarexadatatest02: Kernel version: 2.6.39-400.128.17.el5uek #1 SMP Tue May 27 13:20:24 PDT 2014 x86_64








































anarexadatatest02: Cell version: OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest02: Cell rpm version: cell-12.1.1.1.1_LINUX.X64_140712-1








































anarexadatatest02:








































anarexadatatest02: Active image version: 12.1.1.1.1.140712








































anarexadatatest02: Active image created: 2014-07-15 15:51:29 -0700








































anarexadatatest02: Active image activated: 2014-10-04 15:20:29 -0700








































anarexadatatest02: Active image type: production








































anarexadatatest02: Active image status: success








































anarexadatatest02: Active image label: OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest02: Active node type: STORAGE








































anarexadatatest02: Active system partition on device: /dev/md5








































anarexadatatest02: Active software partition on device: /dev/md7








































anarexadatatest02:








































anarexadatatest02: In partition rollback: Impossible








































anarexadatatest02:








































anarexadatatest02: Cell boot usb partition: /dev/sdm1








































anarexadatatest02: Cell boot usb version: 12.1.1.1.1.140712








































anarexadatatest02:








































anarexadatatest02: Inactive image version: undefined








































anarexadatatest02: Rollback to the inactive partitions: Impossible








































anarexadatatest03:








































anarexadatatest03: Kernel version: 2.6.39-400.128.17.el5uek #1 SMP Tue May 27 13:20:24 PDT 2014 x86_64








































anarexadatatest03: Cell version: OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest03: Cell rpm version: cell-12.1.1.1.1_LINUX.X64_140712-1








































anarexadatatest03:








































anarexadatatest03: Active image version: 12.1.1.1.1.140712








































anarexadatatest03: Active image created: 2014-07-15 15:51:29 -0700








































anarexadatatest03: Active image activated: 2014-10-04 15:20:32 -0700








































anarexadatatest03: Active image type: production








































anarexadatatest03: Active image status: success








































anarexadatatest03: Active image label: OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest03: Active node type: STORAGE








































anarexadatatest03: Active system partition on device: /dev/md5








































anarexadatatest03: Active software partition on device: /dev/md7








































anarexadatatest03:








































anarexadatatest03: In partition rollback: Impossible








































anarexadatatest03:








































anarexadatatest03: Cell boot usb partition: /dev/sdm1








































anarexadatatest03: Cell boot usb version: 12.1.1.1.1.140712








































anarexadatatest03:








































anarexadatatest03: Inactive image version: undefined








































anarexadatatest03: Rollback to the inactive partitions: Impossible








































root@anarexadatatest01:/u01/staging/upgrade# dcli -g cell_group -l root 'imagehistory -all'








































anarexadatatest01: Version : 12.1.1.1.1.140712








































anarexadatatest01: Image activation date : 2014-10-04 15:02:40 -0700








































anarexadatatest01: Imaging mode : fresh








































anarexadatatest01: Imaging status : success








































anarexadatatest01: Imaging type : image








































anarexadatatest01: Image creation date : 2014-07-15 15:51:29 -0700








































anarexadatatest01: Image type : production








































anarexadatatest01: Image node : STORAGE








































anarexadatatest01: Internal label : OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest01: Internal cell rpm version : OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest01: Internal cell software version : OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest01: Image id : 1405464689








































anarexadatatest01:








































anarexadatatest02: Version : 12.1.1.1.1.140712








































anarexadatatest02: Image activation date : 2014-10-04 15:20:29 -0700








































anarexadatatest02: Imaging mode : fresh








































anarexadatatest02: Imaging status : success








































anarexadatatest02: Imaging type : image








































anarexadatatest02: Image creation date : 2014-07-15 15:51:29 -0700








































anarexadatatest02: Image type : production








































anarexadatatest02: Image node : STORAGE








































anarexadatatest02: Internal label : OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest02: Internal cell rpm version : OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest02: Internal cell software version : OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest02: Image id : 1405464689








































anarexadatatest02:








































anarexadatatest03: Version : 12.1.1.1.1.140712








































anarexadatatest03: Image activation date : 2014-10-04 15:20:32 -0700








































anarexadatatest03: Imaging mode : fresh








































anarexadatatest03: Imaging status : success








































anarexadatatest03: Imaging type : image








































anarexadatatest03: Image creation date : 2014-07-15 15:51:29 -0700








































anarexadatatest03: Image type : production








































anarexadatatest03: Image node : STORAGE








































anarexadatatest03: Internal label : OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest03: Internal cell rpm version : OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest03: Internal cell software version : OSS_12.1.1.1.1_LINUX.X64_140712








































anarexadatatest03: Image id : 1405464689








































anarexadatatest03:








































root@anarexadatatest01:/u01/staging/upgrade# date








































Friday, May 6, 2016 11:32:49 AM AZT








































root@anarexadatatest01:/u01/staging/upgrade# ls -ltrh








































total 2926091








































-rw-r--r-- 1 root root 51 May 6 11:17 cell_group








































-rw-r--r-- 1 root root 34 May 6 11:18 ibswitches.lst








































-rw-r--r-- 1 root root 1.4G May 6 11:38 XXX_UPGRADE.tar








































root@anarexadatatest01:/u01/staging/upgrade# tar -xvf XXX_UPGRADE.tar








































x XXX_UPGRADE/, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/11_2_2_1_0.pm, 43240 bytes, 85 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/12.1.2.2.1.160119.iso, 1260595200 bytes, 2462100 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/upgradeIBSwitch.sh, 114855 bytes, 225 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/preconfig.pm, 41891 bytes, 82 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/plugins, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/plugins/010-check_17854520.sh, 14235 bytes, 28 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/plugins/000-check_dummy_perl, 5770 bytes, 12 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/plugins/000-check_dummy_bash, 6362 bytes, 13 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/plugins/020-check_22468216.sh, 4151 bytes, 9 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ExadataSendNotification.pm, 1570 bytes, 4 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/11_2_1_2_1.pm, 32529 bytes, 64 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/exadata.img.env, 2343 bytes, 5 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/dostep.sh.tmpl, 111833 bytes, 219 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/dostep.sh, 111833 bytes, 219 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/md5sum_files.lst, 3155 bytes, 7 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ExadataImageNotification.pl, 56712 bytes, 111 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/sundcs_36p_repository_2.1.5_1.pkg, 116010429 bytes, 226583 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/patchmgr.stdout, 88 bytes, 1 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/11_2_1_2_2.pm, 33620 bytes, 66 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ExaXMLNode.pm, 6133 bytes, 12 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/11_1_3_2_0.pm, 10769 bytes, 22 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck/remoteScriptGenerator.pm, 12969 bytes, 26 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck/OSAdapter.pm, 1931 bytes, 4 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck/SolarisAdapter.pm, 10191 bytes, 20 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck/remoteConfig.pm, 16174 bytes, 32 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck/CommonUtils.pm, 3725 bytes, 8 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck/remoteLauncher.pm, 3607 bytes, 8 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck/runDiagnostics.pm, 33393 bytes, 66 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck/spawnProc.pm, 8488 bytes, 17 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/netcheck/LinuxAdapter.pm, 8103 bytes, 16 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/tar_ibdiagtools, 621 bytes, 2 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/setup-ssh, 4874 bytes, 10 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/monitord, 18779 bytes, 37 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/xmonib.sh, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/cable_check.pl, 20625 bytes, 41 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/verify-topology, 22660 bytes, 45 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/VERSION_FILE, 19 bytes, 1 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/dcli, 49094 bytes, 96 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/README, 1343 bytes, 3 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/topology-zfs, 10361 bytes, 21 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/SampleOutputs.txt, 15571 bytes, 31 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/topologies, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/topologies/Rack.pm, 31350 bytes, 62 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/topologies/verifylib.pm, 3641 bytes, 8 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/topologies/Group.pm, 25378 bytes, 50 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/topologies/VerifyTopologyUtility.pm, 5432 bytes, 11 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/topologies/Switch.pm, 9286 bytes, 19 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/topologies/Node.pm, 11244 bytes, 22 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/ibping_test, 1974 bytes, 4 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/checkbadlinks.pl, 3343 bytes, 7 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ibdiagtools/infinicheck, 76698 bytes, 150 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/exadataLogger.pm, 53996 bytes, 106 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/patchmgr, 187138 bytes, 366 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/dcli, 49094 bytes, 96 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/exadata.img.hw, 16815 bytes, 33 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/12.1.2.2.1.160119.patch.tar, 2170880 bytes, 4240 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/patchmgr.stderr, 88 bytes, 1 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/ipconf.pl, 521794 bytes, 1020 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/imageLogger, 42778 bytes, 84 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/etc, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/etc/config, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/etc/config/inventory.xml, 226 bytes, 1 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/sundcs_36p_repository_2.1.6_2.pkg, 116051693 bytes, 226664 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/linux.db.rpms, 0 bytes, 0 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/linux.db.rpms/perl-XML-Parser-2.34-6.1.2.2.1.x86_64.rpm, 214345 bytes, 419 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/11_2_1_1_0.pm, 29096 bytes, 57 tape blocks








































x XXX_UPGRADE//patch_12.1.2.2.1.160119/sgutil.pm, 47458 bytes, 93 tape blocks








































root@anarexadatatest01:/u01/staging/upgrade# ls -ltrh








































total 2926094








































drwxrwxrwx 3 60022 other 3 May 6 02:28 XXX_UPGRADE








































-rw-r--r-- 1 root root 51 May 6 11:17 cell_group








































-rw-r--r-- 1 root root 34 May 6 11:18 ibswitches.lst








































-rw-r--r-- 1 root root 1.4G May 6 11:38 XXX_UPGRADE.tar








































root@anarexadatatest01:/u01/staging/upgrade# ls -ltrh XXX_UPGRADE/








































total 5








































drwxr-xr-x 6 60022 other 33 May 6 07:41 patch_12.1.2.2.1.160119








































root@anarexadatatest01:/u01/staging/upgrade# mv XXX_UPGRADE/patch_12.1.2.2.1.160119 .








































root@anarexadatatest01:/u01/staging/upgrade# ls -ltrh








































total 2926099








































drwxr-xr-x 6 60022 other 33 May 6 07:41 patch_12.1.2.2.1.160119








































-rw-r--r-- 1 root root 51 May 6 11:17 cell_group








































-rw-r--r-- 1 root root 34 May 6 11:18 ibswitches.lst








































-rw-r--r-- 1 root root 1.4G May 6 11:38 XXX_UPGRADE.tar








































drwxrwxrwx 2 60022 other 2 May 6 11:49 XXX_UPGRADE








































root@anarexadatatest01:/u01/staging/upgrade# rm -rf XXX_UPGRADE








































root@anarexadatatest01:/u01/staging/upgrade# ls -ltrh








































total 2926096








































drwxr-xr-x 6 60022 other 33 May 6 07:41 patch_12.1.2.2.1.160119








































-rw-r--r-- 1 root root 51 May 6 11:17 cell_group








































-rw-r--r-- 1 root root 34 May 6 11:18 ibswitches.lst








































-rw-r--r-- 1 root root 1.4G May 6 11:38 XXX_UPGRADE.tar








































root@anarexadatatest01:/u01/staging/upgrade# mv cell_group patch_12.1.2.2.1.160119/








































root@anarexadatatest01:/u01/staging/upgrade# mv ibswitches.lst patch_12.1.2.2.1.160119/








































root@anarexadatatest01:/u01/staging/upgrade# cd patch_12.1.2.2.1.160119/








































root@anarexadatatest01:/u01/staging/upgrade/patch_12.1.2.2.1.160119# ls -ltrh








































total 2925379








































-rw-r--r-- 1 60022 other 6.0K Oct 9 2013 ExaXMLNode.pm








































-rw-r--r-- 1 60022 other 33K Oct 9 2013 11_2_1_2_2.pm








































-rw-r--r-- 1 60022 other 32K Oct 9 2013 11_2_1_2_1.pm








































-rw-r--r-- 1 60022 other 28K Oct 9 2013 11_2_1_1_0.pm








































-rw-r--r-- 1 60022 other 11K Oct 9 2013 11_1_3_2_0.pm








































-rw-r--r-- 1 60022 other 42K Apr 19 2014 11_2_2_1_0.pm








































-rw-r--r-- 1 60022 other 2.3K Dec 2 2014 exadata.img.env








































-rw-r--r-- 1 60022 other 41K Jul 29 2015 preconfig.pm








































-rw-r--r-- 1 60022 other 46K Sep 3 2015 sgutil.pm








































-rw-r--r-- 1 60022 other 53K Nov 24 23:49 exadataLogger.pm








































-rw-r--r-- 1 60022 other 510K Dec 3 22:21 ipconf.pl








































-rw-r--r-- 1 60022 other 16K Jan 12 16:22 exadata.img.hw








































-rw-r--r-- 1 60022 other 42K Jan 17 22:12 imageLogger








































-rw-r--r-- 1 60022 other 1.5K Jan 19 21:15 ExadataSendNotification.pm








































-rw-r--r-- 1 60022 other 55K Jan 19 21:15 ExadataImageNotification.pl








































-rw-r--r-- 1 60022 other 48K Jan 19 21:15 dcli








































-rw-r--r-- 1 60022 other 111M Jan 19 21:15 sundcs_36p_repository_2.1.5_1.pkg








































-rw-r--r-- 1 60022 other 112K Jan 19 21:15 upgradeIBSwitch.sh








































-rw-r--r-- 1 60022 other 111M Jan 19 21:15 sundcs_36p_repository_2.1.6_2.pkg








































-rw-r--r-- 1 60022 other 2.1M Jan 19 21:24 12.1.2.2.1.160119.patch.tar








































-rw-r--r-- 1 60022 other 1.2G Jan 19 21:24 12.1.2.2.1.160119.iso








































-rw-r--r-- 1 60022 other 183K Jan 19 21:24 patchmgr








































-rw-r--r-- 1 60022 other 109K Jan 19 21:24 dostep.sh.tmpl








































-rw-r--r-- 1 60022 other 109K Jan 19 21:24 dostep.sh








































-rw-r--r-- 1 60022 other 3.1K Jan 19 21:24 md5sum_files.lst








































-rw-r--r-- 1 60022 other 88 May 6 02:33 patchmgr.stdout








































-rw-r--r-- 1 60022 other 88 May 6 02:33 patchmgr.stderr








































drwxr-xr-x 3 60022 other 3 May 6 06:52 etc








































drwxr-xr-x 4 60022 other 18 May 6 06:52 ibdiagtools








































drwxr-xr-x 2 60022 other 3 May 6 06:52 linux.db.rpms








































drwxr-xr-x 2 60022 other 6 May 6 06:53 plugins








































-rw-r--r-- 1 root root 51 May 6 11:17 cell_group








































-rw-r--r-- 1 root root 34 May 6 11:18 ibswitches.lst








































root@anarexadatatest01:/u01/staging/upgrade/patch_12.1.2.2.1.160119# ./patchmgr -cells cell_group -cleanup

























































































































2016-05-06 11:54:08 +0400 :Working: DO: Cleanup ...








































2016-05-06 11:54:10 +0400 :SUCCESS: DONE: Cleanup

























































































































root@anarexadatatest01:/u01/staging/upgrade/patch_12.1.2.2.1.160119#

























































































































root@anarexadatatest01:/u01/staging/upgrade/patch_12.1.2.2.1.160119# ./patchmgr -ibswitches ibswitches.lst -upgrade -ibswitch_precheck

























































































































2016-05-07 01:16:26 +0400 1 of 1 :SUCCESS: DO: Initiate pre-upgrade validation check on InfiniBand switch(es).








































 ----- InfiniBand switch update process started 2016-05-07 01:16:26 +0400 -----








































[NOTE ] Log file at /u01/staging/upgrade/patch_12.1.2.2.1.160119/upgradeIBSwitch.log

























































































































[INFO ] List of InfiniBand switches for upgrade: ( bakuexa1sw-iba01 bakuexa1sw-ibb01 )








































[SUCCESS ] Verifying Network connectivity to bakuexa1sw-iba01








































[SUCCESS ] Verifying Network connectivity to bakuexa1sw-ibb01








































[SUCCESS ] Validating verify-topology output








































[INFO ] Master Subnet Manager is set to "bakuexa1sw-iba01" in all Switches

























































































































[INFO ] ---------- Starting with IBSwitch bakuexa1sw-iba01








































[WARNING ] Infiniband switch meets minimal version requirements, but rollback is only available to 2.1.5-1 with the current package.








































 To rollback to other versions:








































 - Manually download the InfiniBand switch firmware package to the patch directory








































 - Set export variable "EXADATA_IMAGE_IBSWITCH_ROLLBACK_VERSION" to the appropriate version








































 - Run patchmgr command to initiate rollback.








































[SUCCESS ] Verifying that /tmp has 120M in bakuexa1sw-iba01, found 249M








































[SUCCESS ] Verifying that / has 80M in bakuexa1sw-iba01, found 200M








































[WARNING ] Service ntpd is not enabled on bakuexa1sw-iba01








































 ACTION: Enable ntpd service by issuing '/sbin/chkconfig ntpd on' on the InfiniBand Switch bakuexa1sw-iba01








































[SUCCESS ] Service ntpd is running on InfiniBand Switch bakuexa1sw-iba01








































[SUCCESS ] Verifying that bakuexa1sw-iba01 has at least 1 NTP Server, found 1








































[SUCCESS ] opensm.conf passed all validations








































[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2016-05-07 Time:(HH:MM:SS) 01:16:56








































[SUCCESS ] Execute plugin check for Patch Check Prereq on bakuexa1sw-iba01








































[SUCCESS ] Pre-update validation on bakuexa1sw-iba01

























































































































[INFO ] ---------- Starting with InfiniBand Switch bakuexa1sw-ibb01








































[WARNING ] Infiniband switch meets minimal version requirements, but rollback is only available to 2.1.5-1 with the current package.








































 To rollback to other versions:








































 - Manually download the InfiniBand switch firmware package to the patch directory








































 - Set export variable "EXADATA_IMAGE_IBSWITCH_ROLLBACK_VERSION" to the appropriate version








































 - Run patchmgr command to initiate rollback.








































[SUCCESS ] Verifying that /tmp has 120M in bakuexa1sw-ibb01, found 249M








































[SUCCESS ] Verifying that / has 80M in bakuexa1sw-ibb01, found 201M








































[WARNING ] Service ntpd is not enabled on bakuexa1sw-ibb01








































 ACTION: Enable ntpd service by issuing '/sbin/chkconfig ntpd on' on the InfiniBand Switch bakuexa1sw-ibb01








































[SUCCESS ] Service ntpd is running on InfiniBand Switch bakuexa1sw-ibb01








































[SUCCESS ] Verifying that bakuexa1sw-ibb01 has at least 1 NTP Server, found 1








































[SUCCESS ] opensm.conf passed all validations








































[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2016-05-07 Time:(HH:MM:SS) 01:17:11








































[SUCCESS ] Execute plugin check for Patch Check Prereq on bakuexa1sw-ibb01








































[SUCCESS ] Pre-update validation on bakuexa1sw-ibb01








































[SUCCESS ] Overall status

























































































































 ----- InfiniBand switch update process ended 2016-05-07 01:17:11 +0400 -----








































2016-05-07 01:17:11 +0400 1 of 1 :SUCCESS: DONE: Initiate pre-upgrade validation check on InfiniBand switch(es).

























































































































root@anarexadatatest01:/u01/staging/upgrade/patch_12.1.2.2.1.160119# ./patchmgr -ibswitches ibswitches.lst -upgrade -ibswitch_precheck

























































































































2016-05-07 01:23:37 +0400 1 of 1 :SUCCESS: DO: Initiate pre-upgrade validation check on InfiniBand switch(es).








































 ----- InfiniBand switch update process started 2016-05-07 01:23:37 +0400 -----








































[NOTE ] Log file at /u01/staging/upgrade/patch_12.1.2.2.1.160119/upgradeIBSwitch.log

























































































































[INFO ] List of InfiniBand switches for upgrade: ( bakuexa1sw-iba01 bakuexa1sw-ibb01 )








































[SUCCESS ] Verifying Network connectivity to bakuexa1sw-iba01








































[SUCCESS ] Verifying Network connectivity to bakuexa1sw-ibb01








































[SUCCESS ] Validating verify-topology output








































[INFO ] Master Subnet Manager is set to "bakuexa1sw-iba01" in all Switches

























































































































[INFO ] ---------- Starting with IBSwitch bakuexa1sw-iba01








































[WARNING ] Infiniband switch meets minimal version requirements, but rollback is only available to 2.1.5-1 with the current package.








































 To rollback to other versions:








































 - Manually download the InfiniBand switch firmware package to the patch directory








































 - Set export variable "EXADATA_IMAGE_IBSWITCH_ROLLBACK_VERSION" to the appropriate version








































 - Run patchmgr command to initiate rollback.








































[SUCCESS ] Verifying that /tmp has 120M in bakuexa1sw-iba01, found 249M








































[SUCCESS ] Verifying that / has 80M in bakuexa1sw-iba01, found 200M








































[SUCCESS ] Service ntpd is running on InfiniBand Switch bakuexa1sw-iba01








































[SUCCESS ] Verifying that bakuexa1sw-iba01 has at least 1 NTP Server, found 1








































[SUCCESS ] opensm.conf passed all validations








































[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2016-05-07 Time:(HH:MM:SS) 01:24:08








































[SUCCESS ] Execute plugin check for Patch Check Prereq on bakuexa1sw-iba01








































[SUCCESS ] Pre-update validation on bakuexa1sw-iba01

























































































































[INFO ] ---------- Starting with InfiniBand Switch bakuexa1sw-ibb01








































[WARNING ] Infiniband switch meets minimal version requirements, but rollback is only available to 2.1.5-1 with the current package.








































 To rollback to other versions:








































 - Manually download the InfiniBand switch firmware package to the patch directory








































 - Set export variable "EXADATA_IMAGE_IBSWITCH_ROLLBACK_VERSION" to the appropriate version








































 - Run patchmgr command to initiate rollback.








































[SUCCESS ] Verifying that /tmp has 120M in bakuexa1sw-ibb01, found 249M








































[SUCCESS ] Verifying that / has 80M in bakuexa1sw-ibb01, found 201M








































[SUCCESS ] Service ntpd is running on InfiniBand Switch bakuexa1sw-ibb01








































[SUCCESS ] Verifying that bakuexa1sw-ibb01 has at least 1 NTP Server, found 1








































[SUCCESS ] opensm.conf passed all validations








































[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2016-05-07 Time:(HH:MM:SS) 01:24:23








































[SUCCESS ] Execute plugin check for Patch Check Prereq on bakuexa1sw-ibb01








































[SUCCESS ] Pre-update validation on bakuexa1sw-ibb01








































[SUCCESS ] Overall status

























































































































 ----- InfiniBand switch update process ended 2016-05-07 01:24:23 +0400 -----








































2016-05-07 01:24:23 +0400 1 of 1 :SUCCESS: DONE: Initiate pre-upgrade validation check on InfiniBand switch(es).












































































































































































































































































































































































root@anarexadatatest01:/u01/staging/upgrade/patch_12.1.2.2.1.160119# ./patchmgr -ibswitches ibswitches.lst -upgrade -ibswitch_precheck

























































































































2016-05-07 01:16:26 +0400 1 of 1 :SUCCESS: DO: Initiate pre-upgrade validation check on InfiniBand switch(es).








































 ----- InfiniBand switch update process started 2016-05-07 01:16:26 +0400 -----








































[NOTE ] Log file at /u01/staging/upgrade/patch_12.1.2.2.1.160119/upgradeIBSwitch.log

























































































































[INFO ] List of InfiniBand switches for upgrade: ( bakuexa1sw-iba01 bakuexa1sw-ibb01 )








































[SUCCESS ] Verifying Network connectivity to bakuexa1sw-iba01








































[SUCCESS ] Verifying Network connectivity to bakuexa1sw-ibb01








































[SUCCESS ] Validating verify-topology output








































[INFO ] Master Subnet Manager is set to "bakuexa1sw-iba01" in all Switches

























































































































[INFO ] ---------- Starting with IBSwitch bakuexa1sw-iba01








































[WARNING ] Infiniband switch meets minimal version requirements, but rollback is only available to 2.1.5-1 with the current package.








































 To rollback to other versions:








































 - Manually download the InfiniBand switch firmware package to the patch directory








































 - Set export variable "EXADATA_IMAGE_IBSWITCH_ROLLBACK_VERSION" to the appropriate version








































 - Run patchmgr command to initiate rollback.








































[SUCCESS ] Verifying that /tmp has 120M in bakuexa1sw-iba01, found 249M








































[SUCCESS ] Verifying that / has 80M in bakuexa1sw-iba01, found 200M








































[WARNING ] Service ntpd is not enabled on bakuexa1sw-iba01








































 ACTION: Enable ntpd service by issuing '/sbin/chkconfig ntpd on' on the InfiniBand Switch bakuexa1sw-iba01








































[SUCCESS ] Service ntpd is running on InfiniBand Switch bakuexa1sw-iba01








































[SUCCESS ] Verifying that bakuexa1sw-iba01 has at least 1 NTP Server, found 1








































[SUCCESS ] opensm.conf passed all validations








































[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2016-05-07 Time:(HH:MM:SS) 01:16:56








































[SUCCESS ] Execute plugin check for Patch Check Prereq on bakuexa1sw-iba01








































[SUCCESS ] Pre-update validation on bakuexa1sw-iba01

























































































































[INFO ] ---------- Starting with InfiniBand Switch bakuexa1sw-ibb01








































[WARNING ] Infiniband switch meets minimal version requirements, but rollback is only available to 2.1.5-1 with the current package.








































 To rollback to other versions:








































 - Manually download the InfiniBand switch firmware package to the patch directory








































 - Set export variable "EXADATA_IMAGE_IBSWITCH_ROLLBACK_VERSION" to the appropriate version








































 - Run patchmgr command to initiate rollback.








































[SUCCESS ] Verifying that /tmp has 120M in bakuexa1sw-ibb01, found 249M








































[SUCCESS ] Verifying that / has 80M in bakuexa1sw-ibb01, found 201M








































[WARNING ] Service ntpd is not enabled on bakuexa1sw-ibb01








































 ACTION: Enable ntpd service by issuing '/sbin/chkconfig ntpd on' on the InfiniBand Switch bakuexa1sw-ibb01








































[SUCCESS ] Service ntpd is running on InfiniBand Switch bakuexa1sw-ibb01








































[SUCCESS ] Verifying that bakuexa1sw-ibb01 has at least 1 NTP Server, found 1








































[SUCCESS ] opensm.conf passed all validations








































[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2016-05-07 Time:(HH:MM:SS) 01:17:11








































[SUCCESS ] Execute plugin check for Patch Check Prereq on bakuexa1sw-ibb01








































[SUCCESS ] Pre-update validation on bakuexa1sw-ibb01








































[SUCCESS ] Overall status

























































































































 ----- InfiniBand switch update process ended 2016-05-07 01:17:11 +0400 -----








































2016-05-07 01:17:11 +0400 1 of 1 :SUCCESS: DONE: Initiate pre-upgrade validation check on InfiniBand switch(es).

























































































































root@anarexadatatest01:/u01/staging/upgrade/patch_12.1.2.2.1.160119# ./patchmgr -ibswitches ibswitches.lst -upgrade -ibswitch_precheck

























































































































2016-05-07 01:23:37 +0400 1 of 1 :SUCCESS: DO: Initiate pre-upgrade validation check on InfiniBand switch(es).








































 ----- InfiniBand switch update process started 2016-05-07 01:23:37 +0400 -----








































[NOTE ] Log file at /u01/staging/upgrade/patch_12.1.2.2.1.160119/upgradeIBSwitch.log

























































































































[INFO ] List of InfiniBand switches for upgrade: ( bakuexa1sw-iba01 bakuexa1sw-ibb01 )








































[SUCCESS ] Verifying Network connectivity to bakuexa1sw-iba01








































[SUCCESS ] Verifying Network connectivity to bakuexa1sw-ibb01








































[SUCCESS ] Validating verify-topology output








































[INFO ] Master Subnet Manager is set to "bakuexa1sw-iba01" in all Switches

























































































































[INFO ] ---------- Starting with IBSwitch bakuexa1sw-iba01








































[WARNING ] Infiniband switch meets minimal version requirements, but rollback is only available to 2.1.5-1 with the current package.








































 To rollback to other versions:








































 - Manually download the InfiniBand switch firmware package to the patch directory








































 - Set export variable "EXADATA_IMAGE_IBSWITCH_ROLLBACK_VERSION" to the appropriate version








































 - Run patchmgr command to initiate rollback.








































[SUCCESS ] Verifying that /tmp has 120M in bakuexa1sw-iba01, found 249M








































[SUCCESS ] Verifying that / has 80M in bakuexa1sw-iba01, found 200M








































[SUCCESS ] Service ntpd is running on InfiniBand Switch bakuexa1sw-iba01








































[SUCCESS ] Verifying that bakuexa1sw-iba01 has at least 1 NTP Server, found 1








































[SUCCESS ] opensm.conf passed all validations








































[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2016-05-07 Time:(HH:MM:SS) 01:24:08








































[SUCCESS ] Execute plugin check for Patch Check Prereq on bakuexa1sw-iba01








































[SUCCESS ] Pre-update validation on bakuexa1sw-iba01

























































































































[INFO ] ---------- Starting with InfiniBand Switch bakuexa1sw-ibb01








































[WARNING ] Infiniband switch meets minimal version requirements, but rollback is only available to 2.1.5-1 with the current package.








































 To rollback to other versions:








































 - Manually download the InfiniBand switch firmware package to the patch directory








































 - Set export variable "EXADATA_IMAGE_IBSWITCH_ROLLBACK_VERSION" to the appropriate version








































 - Run patchmgr command to initiate rollback.








































[SUCCESS ] Verifying that /tmp has 120M in bakuexa1sw-ibb01, found 249M








































[SUCCESS ] Verifying that / has 80M in bakuexa1sw-ibb01, found 201M








































[SUCCESS ] Service ntpd is running on InfiniBand Switch bakuexa1sw-ibb01








































[SUCCESS ] Verifying that bakuexa1sw-ibb01 has at least 1 NTP Server, found 1








































[SUCCESS ] opensm.conf passed all validations








































[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2016-05-07 Time:(HH:MM:SS) 01:24:23








































[SUCCESS ] Execute plugin check for Patch Check Prereq on bakuexa1sw-ibb01








































[SUCCESS ] Pre-update validation on bakuexa1sw-ibb01








































[SUCCESS ] Overall status

























































































































 ----- InfiniBand switch update process ended 2016-05-07 01:24:23 +0400 -----








































2016-05-07 01:24:23 +0400 1 of 1 :SUCCESS: DONE: Initiate pre-upgrade validation check on InfiniBand switch(es).


 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: