Document 1684112.1 https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=54...

PowerView is Off Last Login: February 27, 2021 12:51 PM UZT Umer (Available) (1) Contact Us Help

Dashboard Knowledge Service Requests Patches & Updates 1684112.1

Give Feedback... You have been directed to this document based on an ID match. Alternatively, click here to search on this phrase. Hide
Copyright (c) 2021, Oracle. All rights reserved. Oracle Confidential.

How to resize ASM disks in Exadata (Doc ID 1684112.1) To Bottom

In this Document Was this document helpful?

Goal Yes
No
Solution
Free up space on celldisks
Document Details
Reduce size of RECO disks in ASM
Reduce size of RECO disks in storage cells
Type:
Increase size of DATA disks in storage cells HOWTO
Status:
PUBLISHED
Increase size of DATA disks in ASM Last Major
Update: Aug 4, 2018
Conclusion Last Aug 20, 2020
Update: English
References
Language:

Related Products
APPLIES TO: Oracle Cloud Infrastructure -
Database Service
Oracle Database Exadata
Oracle Database - Enterprise Edition - Version 11.2.0.1 to 12.1.0.1 [Release 11.2 to 12.1] Express Cloud Service
Oracle Database Cloud Schema Service - Version N/A and later Oracle Database Backup
Oracle Database Exadata Cloud Machine - Version N/A and later Service
Oracle Cloud Infrastructure - Database Service - Version N/A and later Oracle Database Cloud Exadata
Service
Oracle Database Exadata Express Cloud Service - Version N/A and later
Oracle Database Cloud Service
Information in this document applies to any platform. Show More

GOAL Information Centers

Oracle Catalog: Service
This document explains how to resize the ASM disks in Exadata. The free space can be anywhere on the cell disks. Request Data Collections
(SRDCs) for all Products and
Services [51.2]
NOTE: There is a known issue (bug 19695225) which may be exposed if the grid disk size is adjusted many times. Please
apply the patch for this bug prior to performing the actions described in this document. Oracle Catalog: Information
Centers for All Products and
Services [50.2]

SOLUTION Platform as a Service (PaaS)

and Oracle Cloud Infrastructure
(OCI) Information Center
The ASM disks in Exadata are provisioned as griddisks from Exadata storage cells. The griddisks are created from the celldisks. [2048297.2]
Normally, there is no free space in celldisks, as all space is used for griddisks, as seen in this example from storage cell 1:
Index of Oracle Database
Information Centers
# cellcli -e "list celldisk where name like 'CD.*' attributes name, size, freespace" [1568043.2]
CD_00_exacell01 528.734375G 0
CD_01_exacell01 528.734375G 0 Information Center: Overview
CD_02_exacell01 557.859375G 0 Database Server/Client
... Installation and
Upgrade/Migration [1351022.2]
This document shows how to free up some space from the griddisks in RECO disk group, and then reuse that space to increase Show More
the size of disk group DATA.
Document References
Free up space on celldisks
Resizing Grid Disks in Exadata:
Example of Recreating RECO
To free up some space, say 88 GB per disk in disk group RECO, we need to reduce the disk size in ASM, and then reduce the
Grid Disks in a Rolling Manner
griddisk size in Exadata storage cells. Let's do that for disk group RECO. [1465230.1]

We start with the RECO griddisks with the size of 316.6875 GB: When Will the Rebalance
Complete [1477905.1]
# cellcli -e "list griddisk where name like 'RECO.*' attributes name, size" Bug 19695225 - Running Many
RECO_CD_00_exacell01 316.6875G Create or Alter Griddisk
RECO_CD_01_exacell01 316.6875G Commands Over Time Causes
RECO_CD_02_exacell01 316.6875G Cell Disk Metadata Corruption
... (ORA-600
[addNewSegmentsToGDisk_2])
and Loss of Cell Disk Content
To free up 88 GB, the new griddisks size will be 316.6875 GB - 88 GB = 228.6875 GB = 234176 MB.
[1991445.1]

Reduce size of RECO disks in ASM

Recently Viewed
Resize all disks in disk group RECO in ASM:
How to resize ASM disks in
Exadata [1684112.1]

1 of 4 27/02/2021, 5:18 pm
Document 1684112.1 https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=54...

SPT-8000-G3 - Battery failure

$ sqlplus / as sysasm imminent [1159646.1]

SQL> alter diskgroup RECO resize all size 234176M rebalance power 32; Exadata Database Machine and
Exadata Storage Server
Diskgroup altered. Supported Versions [888828.1]
Oracle Linux: ExaData DB Node
SQL> Reboots with stack: "Rcu_sched
Detected Stalls On CPUs/tasks:
Rds_send_remove_from_sock+"
The command will trigger the rebalance operation for disk group RECO. [2667184.1]
How To Collect Sosreport on
Monitor the rebalance with the following command: Oracle Linux [1500235.1]
Show More
SQL> select * from gv$asm_operation;

Once the command returns "no rows selected", the rebalance would have completed and all disks in disk group RECO should
show new size.

SQL> select name, total_mb from v$asm_disk_stat where name like 'RECO%';

NAME TOTAL_MB
---------------------- --------
RECO_CD_11_EXACELL01 234176
RECO_CD_10_EXACELL01 234176
RECO_CD_09_EXACELL01 234176
...
RECOC1_CD_03_EXACELL03 234176

36 rows selected.

SQL>

Reduce size of RECO disks in storage cells

Resize the RECO griddisks on all storage cells. On storage cell 1, the command would be:

# cellcli -e alter griddisk RECO_CD_00_exacell01, RECO_CD_01_exacell01, RECO_CD_02_exacell01,

RECO_CD_03_exacell01, RECO_CD_04_exacell01, RECO_CD_05_exacell01, RECO_CD_06_exacell01,
RECO_CD_07_exacell01, RECO_CD_08_exacell01, RECO_CD_09_exacell01, RECO_CD_10_exacell01,
RECO_CD_11_exacell01 size=234176M;

GridDisk RECO_CD_00_exacell01 successfully altered

GridDisk RECO_CD_01_exacell01 successfully altered
GridDisk RECO_CD_02_exacell01 successfully altered
...
GridDisk RECO_CD_11_exacell01 successfully altered
#

Repeat the above resize on all storage cells.

Now we have some free space on celldisks (show here on storage cell 1):

# cellcli -e "list celldisk where name like 'CD.*' attributes name, size, freespace"

CD_00_exacell01 528.734375G 88G

CD_01_exacell01 528.734375G 88G
CD_02_exacell01 557.859375G 88G
...

Increase size of DATA disks in storage cells

We can now increase the size of DATA griddisks, and then increase all disks size of disk group DATA in ASM.

The current DATA griddisks size is 212 GB:

# cellcli -e "list griddisk where name like 'DATA.*' attributes name, size"

DATA_CD_00_exacell01 212G
DATA_CD_01_exacell01 212G
DATA_CD_02_exacell01 212G

...

The new griddisks size will be 212 GB + 88 GB = 300 GB.

Resize the DATA griddisks on all storage cells. On storage cell 1, the command would be:

2 of 4 27/02/2021, 5:18 pm
Document 1684112.1 https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=54...

# cellcli -e alter griddisk DATA_CD_00_exacell01, DATA_CD_01_exacell01, DATA_CD_02_exacell01,

DATA_CD_03_exacell01, DATA_CD_04_exacell01, DATA_CD_05_exacell01, DATA_CD_06_exacell01,
DATA_CD_07_exacell01, DATA_CD_08_exacell01, DATA_CD_09_exacell01, DATA_CD_10_exacell01,
DATA_CD_11_exacell01 size=300G;

GridDisk DATA_CD_00_exacell01 successfully altered

GridDisk DATA_CD_01_exacell01 successfully altered
GridDisk DATA_CD_02_exacell01 successfully altered
...
GridDisk DATA_CD_11_exacell01 successfully altered

# cellcli -e "list griddisk where name like 'DATA.*' attributes name, size"
DATA_CD_00_exacell01 300G
DATA_CD_01_exacell01 300G
DATA_CD_02_exacell01 300G
...

Repeat the above resize on all storage cells.

Increase size of DATA disks in ASM

Increase the size of all disks in disk group DATA, with the following command:

$ sqlplus / as sysasm

SQL> alter diskgroup DATA resize all rebalance power 32;

Diskgroup altered.

SQL>

Note that there was no need to specify the new disks size, as ASM will get that from the griddisks. The rebalance clause is
optional.

The command will trigger the rebalance operation for disk group DATA.

Monitor the rebalance with the following command:

SQL> select * from gv$asm_operation;

Once the command returns "no rows selected", the rebalance would have completed and all disks in disk group DATA should
show new size:

SQL> select name, total_mb/1024 "GB" from v$asm_disk_stat where name like 'DATA%';

NAME GB
------------------------------ ----------
DATA_CD_02_EXACELL01 300
DATA_CD_09_EXACELL01 300
DATA_CD_07_EXACELL01 300
...
DATA_CD_06_EXACELL03 300

36 rows selected.

SQL>

Conclusion

If there is free space in Exadata cell disks, increasing the disk group size can be accomplished in two steps - griddisk size
increase on all storage cells followed by the disk size increase in ASM. This requires a single ASM rebalance operation. If there is
no free space in celldisks, some space may be freed up from other disk group(s) as shown in the example.

Note that reducing starts with reducing the disks size in ASM, followed by reducing the griddisks size. The increase starts with the
griddisks size increase, followed by increasing the disks size in ASM.

REFERENCES

NOTE:1465230.1 - Resizing Grid Disks in Exadata: Example of Recreating RECO Grid Disks in a Rolling Manner
NOTE:1477905.1 - When Will the Rebalance Complete

BUG:19695225 - SPECIFIC ORDER OF CREATE/ALTER GRIDDISK CAUSES ORA-600 [ADDNEWSEGMENTSTOGDISK_2]

Didn't find what you are looking for? Ask in Community...

Related
Products
Oracle Cloud > Oracle Platform Cloud > Oracle Cloud Infrastructure - Database Service > Oracle Cloud Infrastructure - Database Service

3 of 4 27/02/2021, 5:18 pm
Document 1684112.1 https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=54...

Oracle Cloud > Oracle Platform Cloud > Oracle Database Cloud Service > Oracle Database Exadata Express Cloud Service
Oracle Cloud > Oracle Platform Cloud > Oracle Database Backup Service > Oracle Database Backup Service
Oracle Cloud > Oracle Platform Cloud > Oracle Database Cloud Service > Oracle Database Cloud Exadata Service
Oracle Cloud > Oracle Platform Cloud > Oracle Database Cloud Service > Oracle Database Cloud Service
Oracle Database Products > Oracle Database Suite > Oracle Database > Oracle Database - Enterprise Edition > STORAGE
Oracle Cloud > Oracle Platform Cloud > Oracle Database Cloud Service > Oracle Database Cloud Schema Service
Oracle Cloud > Oracle Infrastructure Cloud > Oracle Cloud at Customer > Gen 1 Exadata Cloud at Customer (Oracle Exadata Database Cloud Machine)

Keywords
ASM; CELLCLI; DISK; DISKGROUP; EXADATA; FREE SPACE; GRID; GRIDDISK; INFRASTRUCTURE; RACK; REBALANCE; RESIZE; STORAGE; SYSASM
Translations
English Source Chinese 简体中文 Japanese 日本語

Back to Top
Copyright (c) 2021, Oracle. All rights reserved. Legal Notices and Terms of Use Privacy Statement

4 of 4 27/02/2021, 5:18 pm