Start and use storage cell software to configure cell disks, flash disks, grid disks

To start the software (correctly) and use it to configure cell/grid/flash disks the number of open file descriptors must be increased (a very clear error will be raised otherwise).

As it found googling edit the /etc/sysctl.ctl and add/set

fs.file-max = 65536

and edit the /etc/security/limit.conf files and add/set

* soft nofile 65536 * hard nofile 65536

To communicate over InfiniBand Oracle uses rds protocol. All the modules of rds must be loaded (and configured to be loaded over machine restarts)

[root@stocell1 ~]# modprobe rds [root@stocell1 ~]# modprobe rds_tcp [root@stocell1 ~]# modprobe rds_rdma

and permanently editing/creating rds.conf

[root@stocell1 ~]# vi /etc/modprobe.d/rds.conf

insert line

install rds /sbin/modprobe –ignore-install rds && /sbin/modprobe rds_tcp && /sbin/modprobe rds_rdma

[EDIT: pay attention to double “–” that sometimes became a single char “–”]
Now, as celladmin user the storage cell software could be started

[root@stocell1 ~]# su – celladmin [celladmin@stocell1 ~]$ cellcli -e alter cell restart services allStopping the RS, CELLSRV, and MS services… CELL-01509: Restart Server (RS) not responding. Starting the RS, CELLSRV, and MS services… Getting the state of RS services… running Starting CELLSRV services… The STARTUP of CELLSRV services was not successful. CELL-01547: CELLSRV startup failed due to unknown reasons. Starting MS services… The STARTUP of MS services was successful.

The error in not unknown (as stated) but well known and expected

[Required IP parameters missing]

🙂

So, set the interconnect (= InfiniBand connection) and …

[celladmin@stocell1 ~]$ cellcli -e create cell stocell1 interconnect1=eth1 Cell stocell1 successfully created Starting CELLSRV services… The STARTUP of CELLSRV services was successful. Flash cell disks, FlashCache, and FlashLog will be created… CellDisk FD_00_stocell1 successfully created CellDisk FD_01_stocell1 successfully created CellDisk FD_02_stocell1 successfully created CellDisk FD_03_stocell1 successfully created CellDisk FD_04_stocell1 successfully created CellDisk FD_05_stocell1 successfully created Flash log stocell1_FLASHLOG successfully created Flash cache stocell1_FLASHCACHE successfully created

(I’m not sure why Flash components are auto configured, but it can be modified later if needed)
Configure cell disks

[celladmin@stocell1 ~]$ cellcli -e create celldisk all CellDisk CD_DISK01_stocell1 successfully created CellDisk CD_DISK02_stocell1 successfully created CellDisk CD_DISK03_stocell1 successfully created CellDisk CD_DISK04_stocell1 successfully created CellDisk CD_DISK05_stocell1 successfully created CellDisk CD_DISK06_stocell1 successfully created CellDisk CD_DISK07_stocell1 successfully created CellDisk CD_DISK08_stocell1 successfully created CellDisk CD_DISK09_stocell1 successfully created CellDisk CD_DISK10_stocell1 successfully created CellDisk CD_DISK11_stocell1 successfully created CellDisk CD_DISK12_stocell1 successfully created

and grid disks

[celladmin@stocell1 ~]$ cellcli -e create griddisk all harddisk prefix=DATA GridDisk DATA_CD_DISK01_stocell1 successfully created GridDisk DATA_CD_DISK02_stocell1 successfully created GridDisk DATA_CD_DISK03_stocell1 successfully created GridDisk DATA_CD_DISK04_stocell1 successfully created GridDisk DATA_CD_DISK05_stocell1 successfully created GridDisk DATA_CD_DISK06_stocell1 successfully created GridDisk DATA_CD_DISK07_stocell1 successfully created GridDisk DATA_CD_DISK08_stocell1 successfully created GridDisk DATA_CD_DISK09_stocell1 successfully created GridDisk DATA_CD_DISK10_stocell1 successfully created GridDisk DATA_CD_DISK11_stocell1 successfully created GridDisk DATA_CD_DISK12_stocell1 successfully created

Work done!

Thanks to Steven Lee. His post on the same issue gave me the solution for 2 problems:
– the needed path /var/log/oracle found using the method suggested by Lee
– a strange memory problem with 4GB RAM that was solved simply resizing RAM to 2GB (according with some answers of Lee)
Furthermore the differences between my VM ad his VM helped me to fix the problem related to rds modules (that probably evolved in the meantime)

/*+ esp */