Extending/Resizing the Griddisk/ASM diskgroup in Exadata Environment

You may also refer the MOS (Doc ID 2176737.1)

  • Objective is to add 3000 GB more diskspace to the already existing ASM Diskgroup.
  • Storage Configuration is 12 disks/cell * 3 cells/storage servers
  • Current ASM Diskgroup Total_MB is 9216000
  • Current Griddisk size is 250G each

Therefore Target Griddisk size would be 500G each, That is to add additional 250GB*12 Disks * 3 Storage servers

ASM Diskgroup size before extending the disks:

ASMCMD> lsdg
State    Type    Rebal  Sector  Logical_Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  

Name
MOUNTED  HIGH    N         512             512   4096  4194304   9216000  1435572           512000          307857              0             N  

DATA19/
ASMCMD>

SQL> select name,total_mb,free_mb from v$asm_diskgroup;

NAME                             TOTAL_MB    FREE_MB
------------------------------ ---------- ----------
DATA19                         9216000    1435572

SQL>

On the Storage Cell server query the griddisk size pertaining to the diskgroup supposed to be extended, in My case ASM diskgroup name is DATA19

[root@scxxxxxxx01 ~]# cellcli -e "list griddisk where name like 'DATA19.*' attributes name, size"
         DATA19_CD_00_scxxxxxxx01    250G
         DATA19_CD_01_scxxxxxxx01    250G
         DATA19_CD_02_scxxxxxxx01    250G
         DATA19_CD_03_scxxxxxxx01    250G
         DATA19_CD_04_scxxxxxxx01    250G
         DATA19_CD_05_scxxxxxxx01    250G
         DATA19_CD_06_scxxxxxxx01    250G
         DATA19_CD_07_scxxxxxxx01    250G
         DATA19_CD_08_scxxxxxxx01    250G
         DATA19_CD_09_scxxxxxxx01    250G
         DATA19_CD_10_scxxxxxxx01    250G
         DATA19_CD_11_scxxxxxxx01    250G
[root@scxxxxxxx01 ~]#

Resize the griddisks on all storage cells as follows: (output is trimmed to reduce the screenspace)
On storage cell 1:

[root@scxxxxxxx01 ~]# cellcli -e alter griddisk DATA19_CD_00_scxxxxxxx01,DATA19_CD_01_scxxxxxxx01,DATA19_CD_02_scxxxxxxx01,DATA19_CD_03_scxxxxxxx01,DATA19_CD_04_scxxxxxxx01,DATA19_CD_05_scxxxxxxx01,DATA19_CD_06_scxxxxxxx01,DATA19_CD_07_scxxxxxxx01,DATA19_CD_08_scxxxxxxx01,DATA19_CD_09_scxxxxxxx01,DATA19_CD_10_scxxxxxxx01,DATA19_CD_11_scxxxxxxx01 size=500G;
GridDisk DATA19_CD_00_scxxxxxxx01 successfully altered
.
.
GridDisk DATA19_CD_11_scxxxxxxx01 successfully altered
[root@scxxxxxxx01 ~]#

Repeat the above resize on all storage cells

On storage cell 2:

root@scxxxxxxx02 ~]# cellcli -e alter griddisk DATA19_CD_00_scxxxxxxx02,DATA19_CD_01_scxxxxxxx02,DATA19_CD_02_scxxxxxxx02,DATA19_CD_03_scxxxxxxx02,DATA19_CD_04_scxxxxxxx02,DATA19_CD_05_scxxxxxxx02,DATA19_CD_06_scxxxxxxx02,DATA19_CD_07_scxxxxxxx02,DATA19_CD_08_scxxxxxxx02,DATA19_CD_09_scxxxxxxx02,DATA19_CD_10_scxxxxxxx02,DATA19_CD_11_scxxxxxxx02 size=500G;
GridDisk DATA19_CD_00_scxxxxxxx02 successfully altered
.
.
GridDisk DATA19_CD_11_scxxxxxxx02 successfully altered
[root@scxxxxxxx02 ~]#

On storage cell 3:

[root@scxxxxxxx03 ~]# cellcli -e alter griddisk DATA19_CD_00_scxxxxxxx03,DATA19_CD_01_scxxxxxxx03,DATA19_CD_02_scxxxxxxx03,DATA19_CD_03_scxxxxxxx03,DATA19_CD_04_scxxxxxxx03,DATA19_CD_05_scxxxxxxx03,DATA19_CD_06_scxxxxxxx03,DATA19_CD_07_scxxxxxxx03,DATA19_CD_08_scxxxxxxx03,DATA19_CD_09_scxxxxxxx03,DATA19_CD_10_scxxxxxxx03,DATA19_CD_11_scxxxxxxx03 size=500G;
GridDisk DATA19_CD_00_scxxxxxxx03 successfully altered
.
.
GridDisk DATA19_CD_11_scxxxxxxx03 successfully altered
[root@scxxxxxxx03 ~]#

Check the alertlog and ensure there are no warning/errors, in my case the location is /opt/oracle/cell/log/diag/asm/cell/<Cellserver_hostname>/trace

2019-03-11T09:19:20.478091+03:00
Griddisk DATA19_CD_00_scxxxxxxx01 (guid: a44946cb-b3c9-4962-95fc-ca02bb84ef88) size,  successfully altered
2019-03-11T09:19:20.755676+03:00
Griddisk DATA19_CD_01_scxxxxxxx01 (guid: 62133888-6bd3-4202-aee7-c5d12b025281) size,  successfully altered
2019-03-11T09:19:20.980395+03:00
Griddisk DATA19_CD_02_scxxxxxxx01 (guid: 2ae4c930-c329-487d-a8eb-6b00de71e5b9) size,  successfully altered
2019-03-11T09:19:21.193198+03:00
Griddisk DATA19_CD_03_scxxxxxxx01 (guid: 882201df-92b3-401d-8078-4323f4c90e0c) size,  successfully altered
2019-03-11T09:19:21.414314+03:00
Griddisk DATA19_CD_04_scxxxxxxx01 (guid: 815fb80a-78ac-4744-a625-b8f3225da33a) size,  successfully altered
2019-03-11T09:19:21.601234+03:00
Griddisk DATA19_CD_05_scxxxxxxx01 (guid: fca67088-71a2-4280-8610-5147e615dd10) size,  successfully altered
2019-03-11T09:19:21.838495+03:00
Griddisk DATA19_CD_06_scxxxxxxx01 (guid: ef357611-94c6-41b6-a604-16779d385f53) size,  successfully altered
2019-03-11T09:19:22.079630+03:00
Griddisk DATA19_CD_07_scxxxxxxx01 (guid: 999b5113-3749-49c6-8604-766b0acb825a) size,  successfully altered
2019-03-11T09:19:22.286507+03:00
Griddisk DATA19_CD_08_scxxxxxxx01 (guid: 470ade23-4180-4099-bc4f-67319e53d1af) size,  successfully altered
2019-03-11T09:19:22.449122+03:00
Griddisk DATA19_CD_09_scxxxxxxx01 (guid: 6c639a1e-a204-4f0b-9a8c-971cee37f35a) size,  successfully altered
2019-03-11T09:19:22.648035+03:00
Griddisk DATA19_CD_10_scxxxxxxx01 (guid: 3a4cf228-cdd3-4f97-883e-b8a2b75a6ddc) size,  successfully altered
2019-03-11T09:19:22.839986+03:00
Griddisk DATA19_CD_11_scxxxxxxx01 (guid: cd5c04f1-a3fc-4158-9088-537ad610d75a) size,  successfully altered

Now Login to the ASM instance using sysasm and Alter the diskgroup to  resize the DATA19 ASM diskgroup

SQL> alter diskgroup DATA19 resize all rebalance power 16;

Diskgroup altered.

SQL> 

Confirm the ASM diskgroup size is increased as expected:

SQL> select name,total_mb,free_mb from v$asm_diskgroup;

NAME                             TOTAL_MB    FREE_MB
------------------------------ ---------- ----------
DATA19                           18432000   10651572

SQL>

ASMCMD> lsdg
State    Type    Rebal  Sector  Logical_Sector  Block       AU  Total_MB   Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH    N         512             512   4096  4194304  18432000  10651572          1024000         3209190              0             N  DATA19/
Advertisement

ASM scoped security

In Oracle supper cluster environment where the same set of Exadata Storage Servers are shared among multiple grid infrastructures/RAC clusters, It’s good to have ASM Scoped Security configured.
ASM scope security is a precautionary measure to prevent the accidental use of one cluster’s diskgroups by another cluster.
For example preventing use of production RAC cluster diskgroups from test RAC clusters within the same supper cluster.

1. Stop cluster on both DB zone cluster node members by running following command as root user on each DB zone cluster node member:

# /u01/app/12.1.0.2/grid/bin/crsctl stop crs

2. Create key on any of the cell storage servers:
CELLCLI> create key
8f2f23ecc48031f48b775f02f050dba2
CELLCLI>

3. Using the dcli command, assign the newly created ASM authentication key to the ASM cluster identified by cluster name (special characters are not accepted so it should be removed
from the cluster name used below):
In this scenario “sclu16” is the name of RAC Cluster to which ASM disks/Diskgroup are only supposed to be available.

# dcli -l root -g /root/cell_group “cellcli -e ASSIGN KEY FOR ‘sclu16’=’8f2f23ecc48031f48b775f02f050dba2′”
cladm01: Key for sclu16 successfully created
cladm02: Key for sclu16 successfully created
cladm03: Key for sclu16 successfully created

4. On both cluster nodes create the cluster cellkey.ora file, and ammend to it the key generated in
previous step 2 and assign the cluster name used in step 3:

# vi /etc/oracle/cell/network-config/cellkey.ora
key=fa6f73e518c98af2d8be97ad93997a30
asm=sclu16

5. On both cluster nodes, set correct permissions for the cellkey.ora file created in previous step:
# chmod 600 /etc/oracle/cell/network-config/cellkey.ora
# chown grid:oinstall /etc/oracle/cell/network-config/cellkey.ora

6. Update relevant griddisks “availableTo” attribute for this cluster diskgroups griddisks only, with
the cluster unique name chosen in step 3, as follows:
Note: make sure to update correct griddisks and cells with the correct command as can be seen below.

To get the list of griddisks member in this cluster:
# cellcli -e list griddisk | grep OCR16
# cellcli -e list griddisk | grep DM16
# cellcli -e list griddisk | grep RECO16

On Cell1:
CELLCLI> alter griddisk OCR16_CD_00_cladm01, OCR16_CD_01_cladm01, OCR16_CD_02_cladm01,
OCR16_CD_03_cladm01, OCR16_CD_04_cladm01, OCR16_CD_05_cladm01,
OCR16_CD_06_cladm01, OCR16_CD_07_cladm01, OCR16_CD_08_cladm01,
OCR16_CD_09_cladm01, OCR16_CD_10_cladm01, OCR16_CD_11_cladm01,
DATA16_CD_00_cladm01, DATA16_CD_01_cladm01, DATA16_CD_02_cladm01,
DATA16_CD_03_cladm01, DATA16_CD_04_cladm01, DATA16_CD_05_cladm01,
DATA16_CD_06_cladm01, DATA16_CD_07_cladm01, DATA16_CD_08_cladm01,
DATA16_CD_09_cladm01, DATA16_CD_10_cladm01, DATA16_CD_11_cladm01,
RECO16_CD_00_cladm01, RECO16_CD_01_cladm01, RECO16_CD_02_cladm01,
RECO16_CD_03_cladm01, RECO16_CD_04_cladm01, RECO16_CD_05_cladm01,
RECO16_CD_06_cladm01, RECO16_CD_07_cladm01, RECO16_CD_08_cladm01,
RECO16_CD_09_cladm01, RECO16_CD_10_cladm01, RECO16_CD_11_cladm01 availableTo=’sclu16′

On Cell2:
CELLCLI> alter griddisk OCR16_CD_00_cladm02, OCR16_CD_01_cladm02, OCR16_CD_02_cladm02,
OCR16_CD_03_cladm02, OCR16_CD_04_cladm02, OCR16_CD_05_cladm02,
OCR16_CD_06_cladm02, OCR16_CD_07_cladm02, OCR16_CD_08_cladm02,
OCR16_CD_09_cladm02, OCR16_CD_10_cladm02, OCR16_CD_11_cladm02,
DATA16_CD_00_cladm02, DATA16_CD_01_cladm02, DATA16_CD_02_cladm02,
DATA16_CD_03_cladm02, DATA16_CD_04_cladm02, DATA16_CD_05_cladm02,
DATA16_CD_06_cladm02, DATA16_CD_07_cladm02, DATA16_CD_08_cladm02,
DATA16_CD_09_cladm02, DATA16_CD_10_cladm02, DATA16_CD_11_cladm02,
RECO16_CD_00_cladm02, RECO16_CD_01_cladm02, RECO16_CD_02_cladm02,
RECO16_CD_03_cladm02, RECO16_CD_04_cladm02, RECO16_CD_05_cladm02,
RECO16_CD_06_cladm02, RECO16_CD_07_cladm02, RECO16_CD_08_cladm02,
RECO16_CD_09_cladm02, RECO16_CD_10_cladm02, RECO16_CD_11_cladm02
availableTo=’sclu16′

On Cell3:
CELLCLI> alter griddisk OCR16_CD_00_cladm03, OCR16_CD_01_cladm03, OCR16_CD_02_cladm03,
OCR16_CD_03_cladm03, OCR16_CD_04_cladm03, OCR16_CD_05_cladm03,
OCR16_CD_06_cladm03, OCR16_CD_07_cladm03, OCR16_CD_08_cladm03,
OCR16_CD_09_cladm03, OCR16_CD_10_cladm03, OCR16_CD_11_cladm03,
DATA16_CD_00_cladm03, DATA16_CD_01_cladm03, DATA16_CD_02_cladm03,
DATA16_CD_03_cladm03, DATA16_CD_04_cladm03, DATA16_CD_05_cladm03,
DATA16_CD_06_cladm03, DATA16_CD_07_cladm03, DATA16_CD_08_cladm03,
DATA16_CD_09_cladm03, DATA16_CD_10_cladm03, DATA16_CD_11_cladm03,
RECO16_CD_00_cladm03, RECO16_CD_01_cladm03, RECO16_CD_02_cladm03,
RECO16_CD_03_cladm03, RECO16_CD_04_cladm03, RECO16_CD_05_cladm03,
RECO16_CD_06_cladm03, RECO16_CD_07_cladm03, RECO16_CD_08_cladm03,
RECO16_CD_09_cladm03, RECO16_CD_10_cladm03, RECO16_CD_11_cladm03 availableTo=’sclu16’

7. Once all above commands executes successfully restart the CRS on both cluster nodes:

Thats it.

**In addition You may click here to one of my post to have a look on how to create the ASM Diskgroup/Griddisk**

ASM Diskgroup and Grid Disks creation on M7 Supper cluster with Exadata storage

Creating a ASM Diskgroup of 3000GB usable size and the Grid disks:

    Machine Configuration:

R2: Two M7 Chassis, 4 PDoms, 2 PDoms per Chassis, Truss
Type: 2 x 4s

R2-1: 1 CMIOU per PDom
3 Storage Cells high capacity disks (8Tb, 7200rpm, 288 Tb total raw capacity)

Requirement is to create High redundancy ASM Diskgroup with 3000GB usable space, There are 3 exadata storage server having 12 disks each, So I would be creating 250GB * 12 grid disk on each storage server.

Storage server 1 celadm01
250 GB grid disk * 12 =3000GB

Storage server 2 celadm02
250 GB grid disk * 12 =3000GB

Storage server 3 celadm03
250 GB grid disk * 12 =3000GB

Login to the 1st cell server celadm01 using root and initiate the create griddisk command:

[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_00_celadm01 celldisk = CD_00_celadm01 ,size=250G
GridDisk DATA_01_CD_00_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_01_celadm01 celldisk = CD_01_celadm01 ,size=250G
GridDisk DATA_01_CD_01_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_02_celadm01 celldisk = CD_02_celadm01 ,size=250G
GridDisk DATA_01_CD_02_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_03_celadm01 celldisk = CD_03_celadm01 ,size=250G
GridDisk DATA_01_CD_03_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_04_celadm01 celldisk = CD_04_celadm01 ,size=250G
GridDisk DATA_01_CD_04_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_05_celadm01 celldisk = CD_05_celadm01 ,size=250G
GridDisk DATA_01_CD_05_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_06_celadm01 celldisk = CD_06_celadm01 ,size=250G
GridDisk DATA_01_CD_06_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_07_celadm01 celldisk = CD_07_celadm01 ,size=250G
GridDisk DATA_01_CD_07_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_08_celadm01 celldisk = CD_08_celadm01 ,size=250G
GridDisk DATA_01_CD_08_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_09_celadm01 celldisk = CD_09_celadm01 ,size=250G
GridDisk DATA_01_CD_09_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_10_celadm01 celldisk = CD_10_celadm01 ,size=250G
GridDisk DATA_01_CD_10_celadm01 successfully created
[root@celadm01 ~]# cellcli -e create griddisk DATA_01_CD_11_celadm01 celldisk = CD_11_celadm01 ,size=250G
GridDisk DATA_01_CD_11_celadm01 successfully created
[root@celadm01 ~]#

Login to the 2nd cell server celadm02 using root and initiate the create griddisk command:

[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_00_celadm02 celldisk = CD_00_celadm02 ,size=250G
GridDisk DATA_01_CD_00_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_01_celadm02 celldisk = CD_01_celadm02 ,size=250G
GridDisk DATA_01_CD_01_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_02_celadm02 celldisk = CD_02_celadm02 ,size=250G
GridDisk DATA_01_CD_02_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_03_celadm02 celldisk = CD_03_celadm02 ,size=250G
GridDisk DATA_01_CD_03_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_04_celadm02 celldisk = CD_04_celadm02 ,size=250G
GridDisk DATA_01_CD_04_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_05_celadm02 celldisk = CD_05_celadm02 ,size=250G
GridDisk DATA_01_CD_05_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_06_celadm02 celldisk = CD_06_celadm02 ,size=250G
GridDisk DATA_01_CD_06_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_07_celadm02 celldisk = CD_07_celadm02 ,size=250G
GridDisk DATA_01_CD_07_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_08_celadm02 celldisk = CD_08_celadm02 ,size=250G
GridDisk DATA_01_CD_08_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_09_celadm02 celldisk = CD_09_celadm02 ,size=250G
GridDisk DATA_01_CD_09_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_10_celadm02 celldisk = CD_10_celadm02 ,size=250G
GridDisk DATA_01_CD_10_celadm02 successfully created
[root@celadm02 ~]# cellcli -e create griddisk DATA_01_CD_11_celadm02 celldisk = CD_11_celadm02 ,size=250G
GridDisk DATA_01_CD_11_celadm02 successfully created
[root@celadm02 ~]#

Login to the 3rd cell server celadm03 using root and initiate the create griddisk command:

[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_00_celadm03 celldisk = CD_00_celadm03 ,size=250G
GridDisk DATA_01_CD_00_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_01_celadm03 celldisk = CD_01_celadm03 ,size=250G
GridDisk DATA_01_CD_01_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_02_celadm03 celldisk = CD_02_celadm03 ,size=250G
GridDisk DATA_01_CD_02_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_03_celadm03 celldisk = CD_03_celadm03 ,size=250G
GridDisk DATA_01_CD_03_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_04_celadm03 celldisk = CD_04_celadm03 ,size=250G
GridDisk DATA_01_CD_04_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_05_celadm03 celldisk = CD_05_celadm03 ,size=250G
GridDisk DATA_01_CD_05_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_06_celadm03 celldisk = CD_06_celadm03 ,size=250G
GridDisk DATA_01_CD_06_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_07_celadm03 celldisk = CD_07_celadm03 ,size=250G
GridDisk DATA_01_CD_07_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_08_celadm03 celldisk = CD_08_celadm03 ,size=250G
GridDisk DATA_01_CD_08_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_09_celadm03 celldisk = CD_09_celadm03 ,size=250G
GridDisk DATA_01_CD_09_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_10_celadm03 celldisk = CD_10_celadm03 ,size=250G
GridDisk DATA_01_CD_10_celadm03 successfully created
[root@celadm03 ~]# cellcli -e create griddisk DATA_01_CD_11_celadm03 celldisk = CD_11_celadm03 ,size=250G
GridDisk DATA_01_CD_11_celadm03 successfully created
[root@celadm03 ~]#

    SQL> select name,total_mb/3072 from v$asm_diskgroup where NAME=’DATA_01′;

    NAME TOTAL_MB/3072
    —————————— ————-
    DATA_01 3000

    SQL>

    SQL> create diskgroup DATA_01 HIGH redundancy disk
    2 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_00_celadm01’,
    3 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_01_celadm01’,
    4 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_02_celadm01’,
    5 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_03_celadm01’,
    6 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_04_celadm01’,
    7 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_05_celadm01’,
    8 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_06_celadm01’,
    9 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_07_celadm01’,
    10 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_08_celadm01’,
    11 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_09_celadm01’,
    12 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_10_celadm01’,
    13 ‘o/10.x.x.73;10.x.x.74/DATA_01_CD_11_celadm01’,
    14 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_00_celadm02’,
    15 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_01_celadm02’,
    16 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_02_celadm02’,
    17 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_03_celadm02’,
    18 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_04_celadm02’,
    19 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_05_celadm02’,
    20 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_06_celadm02’,
    21 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_07_celadm02’,
    22 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_08_celadm02’,
    ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_09_celadm02’,
    ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_10_celadm02’,
    23 24 25 ‘o/10.x.x.75;10.x.x.76/DATA_01_CD_11_celadm02’,
    26 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_00_celadm03’,
    ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_01_celadm03’,
    27 28 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_02_celadm03’,
    29 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_03_celadm03’,
    30 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_04_celadm03’,
    31 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_05_celadm03’,
    32 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_06_celadm03’,
    33 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_07_celadm03’,
    34 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_08_celadm03’,
    35 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_09_celadm03’,
    36 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_10_celadm03’,
    37 ‘o/10.x.x.77;10.x.x.78/DATA_01_CD_11_celadm03’ attribute ‘cell.smart_scan_capable’=’TRUE’, ‘au_size’ = ‘4M’, ‘compatible.asm’ = ‘12.1.0.2’, ‘compatible.rdbms’ = ‘11.2.0.3’, ‘appliance.mode’ = ‘true’;

    Diskgroup created.

    SQL>

    Storage server Alert log
    =========================
    celadm01:

2018-08-05T13:09:00.824014+03:00
create GRIDDISK DATA_01_CD_00_celadm01 on CELLDISK CD_00_celadm01 type 0
GridDisk name=DATA_01_CD_00_celadm01 guid=a44946cb-b3c9-4962-95fc-ca02bb84ef88 ( 221701780) status=GDISK_ACTIVE
2018-08-05T13:09:08.349926+03:00
create GRIDDISK DATA_01_CD_01_celadm01 on CELLDISK CD_01_celadm01 type 0
GridDisk name=DATA_01_CD_01_celadm01 guid=62133888-6bd3-4202-aee7-c5d12b025281 (3446671180) status=GDISK_ACTIVE
2018-08-05T13:09:14.934362+03:00
create GRIDDISK DATA_01_CD_02_celadm01 on CELLDISK CD_02_celadm01 type 0
GridDisk name=DATA_01_CD_02_celadm01 guid=2ae4c930-c329-487d-a8eb-6b00de71e5b9 (1294035396) status=GDISK_ACTIVE
2018-08-05T13:09:21.469203+03:00
create GRIDDISK DATA_01_CD_03_celadm01 on CELLDISK CD_03_celadm01 type 0
GridDisk name=DATA_01_CD_03_celadm01 guid=882201df-92b3-401d-8078-4323f4c90e0c (3249925372) status=GDISK_ACTIVE
2018-08-05T13:09:28.346717+03:00
create GRIDDISK DATA_01_CD_04_celadm01 on CELLDISK CD_04_celadm01 type 0
GridDisk name=DATA_01_CD_04_celadm01 guid=815fb80a-78ac-4744-a625-b8f3225da33a (2792194100) status=GDISK_ACTIVE
2018-08-05T13:09:35.146340+03:00
create GRIDDISK DATA_01_CD_05_celadm01 on CELLDISK CD_05_celadm01 type 0
GridDisk name=DATA_01_CD_05_celadm01 guid=fca67088-71a2-4280-8610-5147e615dd10 ( 94191836) status=GDISK_ACTIVE
2018-08-05T13:09:44.085049+03:00
create GRIDDISK DATA_01_CD_06_celadm01 on CELLDISK CD_06_celadm01 type 0
GridDisk name=DATA_01_CD_06_celadm01 guid=ef357611-94c6-41b6-a604-16779d385f53 ( 498227676) status=GDISK_ACTIVE
2018-08-05T13:09:49.361472+03:00
create GRIDDISK DATA_01_CD_07_celadm01 on CELLDISK CD_07_celadm01 type 0
GridDisk name=DATA_01_CD_07_celadm01 guid=999b5113-3749-49c6-8604-766b0acb825a ( 714782452) status=GDISK_ACTIVE
2018-08-05T13:09:55.155277+03:00
create GRIDDISK DATA_01_CD_08_celadm01 on CELLDISK CD_08_celadm01 type 0
GridDisk name=DATA_01_CD_08_celadm01 guid=470ade23-4180-4099-bc4f-67319e53d1af (1514447732) status=GDISK_ACTIVE
2018-08-05T13:10:02.488574+03:00
create GRIDDISK DATA_01_CD_09_celadm01 on CELLDISK CD_09_celadm01 type 0
GridDisk name=DATA_01_CD_09_celadm01 guid=6c639a1e-a204-4f0b-9a8c-971cee37f35a (1568374508) status=GDISK_ACTIVE
2018-08-05T13:10:09.420709+03:00
create GRIDDISK DATA_01_CD_10_celadm01 on CELLDISK CD_10_celadm01 type 0
GridDisk name=DATA_01_CD_10_celadm01 guid=3a4cf228-cdd3-4f97-883e-b8a2b75a6ddc (1272401412) status=GDISK_ACTIVE
2018-08-05T13:10:16.668349+03:00
create GRIDDISK DATA_01_CD_11_celadm01 on CELLDISK CD_11_celadm01 type 0
GridDisk name=DATA_01_CD_11_celadm01 guid=cd5c04f1-a3fc-4158-9088-537ad610d75a (3106012820) status=GDISK_ACTIVE

    celadm02

2018-08-05T13:11:15.800985+03:00
create GRIDDISK DATA_01_CD_00_celadm02 on CELLDISK CD_00_celadm02 type 0
GridDisk name=DATA_01_CD_00_celadm02 guid=d221f04f-b8fd-42da-8d50-8d7de441f466 (1179418300) status=GDISK_ACTIVE
2018-08-05T13:11:24.503616+03:00
create GRIDDISK DATA_01_CD_01_celadm02 on CELLDISK CD_01_celadm02 type 0
GridDisk name=DATA_01_CD_01_celadm02 guid=287f9d0f-2704-44af-a275-52f15a6e7072 ( 869970876) status=GDISK_ACTIVE
2018-08-05T13:11:27.441757+03:00
create GRIDDISK DATA_01_CD_02_celadm02 on CELLDISK CD_02_celadm02 type 0
GridDisk name=DATA_01_CD_02_celadm02 guid=3a86ae87-4585-4499-ad24-8a5c0c9bd65d ( 643685268) status=GDISK_ACTIVE
2018-08-05T13:11:32.101003+03:00
create GRIDDISK DATA_01_CD_03_celadm02 on CELLDISK CD_03_celadm02 type 0
GridDisk name=DATA_01_CD_03_celadm02 guid=edff7234-6dc0-4f01-a758-22eeef73c0a6 (1882795388) status=GDISK_ACTIVE
2018-08-05T13:11:37.934223+03:00
create GRIDDISK DATA_01_CD_04_celadm02 on CELLDISK CD_04_celadm02 type 0
GridDisk name=DATA_01_CD_04_celadm02 guid=6a2e1799-5363-4bc2-a35b-7ac5da3a92aa (1843936044) status=GDISK_ACTIVE
2018-08-05T13:11:43.248367+03:00
create GRIDDISK DATA_01_CD_05_celadm02 on CELLDISK CD_05_celadm02 type 0
GridDisk name=DATA_01_CD_05_celadm02 guid=3bb84c53-a950-4249-b286-6e8bfb39e447 (3798015588) status=GDISK_ACTIVE
2018-08-05T13:11:48.712418+03:00
create GRIDDISK DATA_01_CD_06_celadm02 on CELLDISK CD_06_celadm02 type 0
GridDisk name=DATA_01_CD_06_celadm02 guid=d90ba73c-0a89-444a-864a-4f42182ec7c1 (2905789724) status=GDISK_ACTIVE
2018-08-05T13:11:54.015639+03:00
create GRIDDISK DATA_01_CD_07_celadm02 on CELLDISK CD_07_celadm02 type 0
GridDisk name=DATA_01_CD_07_celadm02 guid=5be28d29-07ef-43ad-a3d1-fe9957b7826e (3773269004) status=GDISK_ACTIVE
2018-08-05T13:12:01.483644+03:00
create GRIDDISK DATA_01_CD_08_celadm02 on CELLDISK CD_08_celadm02 type 0
GridDisk name=DATA_01_CD_08_celadm02 guid=25e10fca-b028-4d77-933e-6e0952974dad (3313228484) status=GDISK_ACTIVE
2018-08-05T13:12:06.758823+03:00
create GRIDDISK DATA_01_CD_09_celadm02 on CELLDISK CD_09_celadm02 type 0
GridDisk name=DATA_01_CD_09_celadm02 guid=50bc7f3f-7099-4529-8397-bb31c7eb98b9 ( 579409268) status=GDISK_ACTIVE
2018-08-05T13:12:11.221648+03:00
create GRIDDISK DATA_01_CD_10_celadm02 on CELLDISK CD_10_celadm02 type 0
GridDisk name=DATA_01_CD_10_celadm02 guid=f6abbb9b-bc4c-4c91-8110-49b125ac0728 (2379805132) status=GDISK_ACTIVE
2018-08-05T13:12:17.961402+03:00
create GRIDDISK DATA_01_CD_11_celadm02 on CELLDISK CD_11_celadm02 type 0
GridDisk name=DATA_01_CD_11_celadm02 guid=4fab02de-13ec-4d23-a327-109b0bba1a8e (2795514364) status=GDISK_ACTIVE

    celadm03

2018-08-05T13:12:41.585801+03:00
create GRIDDISK DATA_01_CD_00_celadm03 on CELLDISK CD_00_celadm03 type 0
GridDisk name=DATA_01_CD_00_celadm03 guid=2e36e6d5-d252-4169-8972-f9c9f28bfa6a ( 680614884) status=GDISK_ACTIVE
2018-08-05T13:12:48.863998+03:00
create GRIDDISK DATA_01_CD_01_celadm03 on CELLDISK CD_01_celadm03 type 0
GridDisk name=DATA_01_CD_01_celadm03 guid=e1ef3810-da94-4ddb-8fc6-3cbc0cee3285 (3172933308) status=GDISK_ACTIVE
2018-08-05T13:12:51.464953+03:00
create GRIDDISK DATA_01_CD_02_celadm03 on CELLDISK CD_02_celadm03 type 0
GridDisk name=DATA_01_CD_02_celadm03 guid=a4466f9c-55e2-4546-a6f1-a7fcaca57eae ( 450619804) status=GDISK_ACTIVE
2018-08-05T13:12:56.954730+03:00
create GRIDDISK DATA_01_CD_03_celadm03 on CELLDISK CD_03_celadm03 type 0
GridDisk name=DATA_01_CD_03_celadm03 guid=8b9386b8-58b8-4191-beed-93fb20035e43 (3843505172) status=GDISK_ACTIVE
2018-08-05T13:13:01.974499+03:00
create GRIDDISK DATA_01_CD_04_celadm03 on CELLDISK CD_04_celadm03 type 0
GridDisk name=DATA_01_CD_04_celadm03 guid=76e15f55-077c-49a0-be7f-a887ecbbd9f2 (2994259868) status=GDISK_ACTIVE
2018-08-05T13:13:07.315805+03:00
create GRIDDISK DATA_01_CD_05_celadm03 on CELLDISK CD_05_celadm03 type 0
GridDisk name=DATA_01_CD_05_celadm03 guid=acdf53cb-b1eb-45f5-a55e-6cdb6b83c20c (1648582636) status=GDISK_ACTIVE
2018-08-05T13:13:13.451496+03:00
create GRIDDISK DATA_01_CD_06_celadm03 on CELLDISK CD_06_celadm03 type 0
GridDisk name=DATA_01_CD_06_celadm03 guid=961067e8-6fc6-4011-9c70-7bb73f2644d3 (1681493276) status=GDISK_ACTIVE
2018-08-05T13:13:20.936986+03:00
create GRIDDISK DATA_01_CD_07_celadm03 on CELLDISK CD_07_celadm03 type 0
GridDisk name=DATA_01_CD_07_celadm03 guid=f8db9e3e-9e1e-434c-a124-fbd52912c0b7 ( 272672068) status=GDISK_ACTIVE
2018-08-05T13:13:26.282307+03:00
create GRIDDISK DATA_01_CD_08_celadm03 on CELLDISK CD_08_celadm03 type 0
GridDisk name=DATA_01_CD_08_celadm03 guid=3ba56b42-0bf7-469e-bdd8-a24d15a132bc ( 359204612) status=GDISK_ACTIVE
2018-08-05T13:13:30.968826+03:00
create GRIDDISK DATA_01_CD_09_celadm03 on CELLDISK CD_09_celadm03 type 0
GridDisk name=DATA_01_CD_09_celadm03 guid=0bbb2246-3253-474d-bc2c-968ca66cc89a (2942144428) status=GDISK_ACTIVE
2018-08-05T13:13:39.376493+03:00
create GRIDDISK DATA_01_CD_10_celadm03 on CELLDISK CD_10_celadm03 type 0
GridDisk name=DATA_01_CD_10_celadm03 guid=152618e5-79b9-40d6-86b0-dcc3500daa26 (2430950540) status=GDISK_ACTIVE
2018-08-05T13:13:46.065046+03:00
create GRIDDISK DATA_01_CD_11_celadm03 on CELLDISK CD_11_celadm03 type 0
GridDisk name=DATA_01_CD_11_celadm03 guid=504efbf6-d94e-442e-b8a9-23cd8ac794f8 (2528666188) status=GDISK_ACTIVE

Thats it.

To enable the ASM scoped security click here.