ISSUE

IF YOU ARE FACING ANY PROBLEM WITH adcfgclone.pl dbTechStack then instead of
extracting the ORACLE_HOME in the directory with source db name for
instance ERPTEST just rename the directory ERPTEST to ERPDEV(target SID name)
https://support.oracle.com/epmos/faces/DocumentDisplay?
_afrLoop=483765833780545&parent=EXTERNAL_SEARCH&sourceId=PROBLEM&id=802464.1&_afrWi
ndowMode=0&_adf.ctrl-state=ohe5utqw0_4

ISSUES FACED:
$perl adcfgclone.pl appsTier dualfs
ERROR: txkWfClone.sh exited with status 1

solution
The above issue might occur if still there is some reference to the source system,
or
the cloning script is unable to change it to appropriate environment during the
cloning
process for some reasons. This is one such case, where this issue might occur.
There
are many other reasons which will throw the above same issue but the reason might
be
different. Need to drill down on the log files for exact cause for the issue.

1. Take backup of AD_APPL_TOPS table

2. Remove the entries for prod reference
3. On db tier connect with apps
4. Run "exec fnd_conc_clone.setup_clean;"
5. Run autoconfig on database tier
6. On application tier rerun "perl adcfgclone.pl appsTier"
7. Verify Clone complete successfully or not.

$SQLPLUS APPSUSERNAME/APPSPASSWORD
SQL> COL OWNER FOR A10
SQL> COL TABLE_NAME FOR A15
SQL> SELECT OWNER,TABLE_NAME,TABLESPACE_NAME FROM DBA_TABLES WHERE
TABLE_NAME='AD_APPL_TOPS';

SQL> CREATE TABLE APPLSYS.AD_APPL_TOPS_BKP AS SELECT * FROM APPLSYS.AD_APPL_TOPS;

SQL> SELECT COUNT(*) FROM APPLSYS.AD_APPL_TOPS;
SQL> SELECT COUNT(*) FROM APPLSYS.AD_APPL_TOPS_BKP;

SQL> SET LINES 200 PAGES 200

SQL> COL DESCRIPTION FOR A40
SQL> COL APPLICATIONS_SYSTEM_NAME FOR A10
SQL> SELECT APPL_TOP_ID, NAME, DESCRIPTION, APPLICATIONS_SYSTEM_NAME FROM
AD_APPL_TOPS;

SQL> UPDATE AD_APPL_TOPS SET APPLICATIONS_SYSTEM_NAME='ERPDEV' where

APPLICATIONS_SYSTEM_NAME='ERPTEST';
SQL> COMMIT;

SQL> COL NAME FOR A20

SQL> COL DESCRIPTION FOR A20
SQL> COL APPLICATIONS_SYSTEM_NAME FOR A10
SQL> SELECT APPL_TOP_ID, NAME, DESCRIPTION, APPLICATIONS_SYSTEM_NAME FROM
AD_APPL_TOPS;

SQL> SHOW USER

USER IS "APPS"
SQL> exec fnd_conc_clone.setup_clean;
SQL> COMMIT;
SQL> EXIT;

in database tier
$ $ORACLE_HOME/appsutil/scripts/ERPDEV_STGERPAPP01/adautocfg.sh
in application tier
$export CONFIG_JVM_ARGS="-Xms1024m -Xmx2048m"
$ cd /u01/app/ERPDEV/fs1/EBSapps/comn/clone/bin
$ perl adcfgclone.pl appsTier dualfs

-----------------------------------------------------------------------------------
-------------
Issue:
unable to execute the adclone.pl/ ouicli.pl
1. try to export the path variable/ and try to see java or jre set properly or not
2. clear the oraInventory directory and
3. clear the FMW directory and other directories and try to run the same command
ie., $perl adcfgclone.pl appsTier dualfs
-----------------------------------------------------------------------------------
-------------

ISSUE:
in ETCC-EBS Technology CodeLevel Checker iam getting the following error
p17537119_R12_GENERIC.zip
./checkDBpatch.sh
LsInventorySession failed: RawInventory gets null OracleHomeInfo

Error running opatch. Error code : 73

Cannot confirm bugfixes applied to the Database ORACLE_HOME.
Exiting.

[oratest@prodapps OPatch]$ ./opatch lsinventory

Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2017, Oracle Corporation. All rights reserved.
Oracle Home : /u011/data/dbhome_1
Central Inventory : /etc/oraInventory
from : /u011/data/dbhome_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location :/u011/data/dbhome_1/cfgtoollogs/opatch/opatch2017-06-08_11-07-
55AM_1.log
List of Homes on this system:
Home name= GST_WEBOH__apps_tech_st_10_1_3, Location= “/apps/tech_st/10.1.3”
Home name= GST_TOOLS__apps_tech_st_10_1_2, Location= “/apps/tech_st/10.1.2”

LsInventorySession failed: RawInventory gets null OracleHomeInfo

OPatch failed with error code 73

Solution:

step 1:

[oracle@abcserver] $ cd $ORACLE_HOME/oui/bin
[oracle@abcserver] $ pwd
step 2:
Change the entery of attachHome.sh

[oratest@aceapps bin]$ vi attachHome.sh

#!/bin/sh
OHOME=/u011/data/dbhome_1 –>change Oracle Home — OHOMENAME=dbhome_1
CUR_DIR=`pwd`
cd $OHOME/oui/bin
./runInstaller -detachhome ORACLE_HOME=$OHOME ORACLE_HOME_NAME=$OHOMENAME $* >
/dev/null 2>&1

./runInstaller -attachhome ORACLE_HOME=$OHOME ORACLE_HOME_NAME=$OHOMENAME$*

Step 3:

Run the attachHome.sh

[oratest@aceapps bin]$ ./attachHome.sh

Starting Oracle Universal Installer…
Checking swap space: must be greater than 500 MB.Actual 40760 MB Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /etc/oraInventory
‘AttachHome’ was successful.

Step 4:

Check the lsinventory again.

[oratest@stgerpapp01 bin]$ opatch lsinventory

Oracle Interim Patch Installer version 12.2.0.1.8
Copyright (c) 2022, Oracle Corporation. All rights reserved.

Oracle Home : /u01/db/ERPDEV/12.1.0/dbhome_1

Central Inventory : /u01/db/oraInventory/
from : /u01/db/ERPDEV/12.1.0/dbhome_1//oraInst.loc
OPatch version : 12.2.0.1.8
OUI version : 12.1.0.2.0
Log file location : /u01/db/ERPDEV/12.1.0/dbhome_1/cfgtoollogs/opatch/opatch2022-
03-04_12-14-27PM_1.log

Lsinventory Output file location :

/u01/db/ERPDEV/12.1.0/dbhome_1/cfgtoollogs/opatch/lsinv/lsinventory2022-03-04_12-
14-27PM.txt

--------------------------------------------------------------------------------
Local Machine Information::
Hostname: stgerpapp01.oracle.com
ARU platform id: 226
ARU platform description:: Linux x86-64

Installed Top-level Products (2):

Oracle Database 12c 12.1.0.2.0

Oracle Database 12c Examples 12.1.0.2.0
There are 2 products installed in this Oracle Home.

Interim patches (35) :

Patch 22338374 : applied on Tue Apr 18 15:16:21 IST 2017
Unique Patch ID: 20233729
Created on 25 May 2016, 22:47:21 hrs PST8PDT
Bugs fixed:
22338374

Patch 21967332 : applied on Tue Apr 18 15:14:24 IST 2017

Unique Patch ID: 19900636
Created on 23 Feb 2016, 15:52:49 hrs PST8PDT
Bugs fixed:
21967332

Patch 23595848 : applied on Tue Apr 18 15:12:29 IST 2017

Unique Patch ID: 20780863
Created on 30 Jun 2016, 02:15:03 hrs PST8PDT
Bugs fixed:
20476776, 22452653, 14666816, 21751519, 22229581, 22737974

Patch 24560906 : applied on Tue Apr 18 12:09:53 IST 2017

Unique Patch ID: 20715635
Created on 7 Nov 2016, 07:12:10 hrs PST8PDT
Bugs fixed:
24560906

Patch 23089357 : applied on Tue Apr 18 12:06:52 IST 2017

Unique Patch ID: 20129515
Created on 24 May 2016, 07:09:47 hrs PST8PDT
Bugs fixed:
23089357

Patch 22731026 : applied on Tue Apr 18 12:03:55 IST 2017

Unique Patch ID: 20228530
Created on 25 May 2016, 04:33:55 hrs PST8PDT
Bugs fixed:
22731026

Patch 22496904 : applied on Tue Apr 18 12:00:23 IST 2017

Unique Patch ID: 19784047
Created on 19 Jan 2016, 13:51:06 hrs PST8PDT
Bugs fixed:
22496904

Patch 21904072 : applied on Tue Apr 18 11:28:56 IST 2017

Unique Patch ID: 19608117
Created on 26 Jan 2016, 15:20:55 hrs PST8PDT
Bugs fixed:
21904072

Patch 21864513 : applied on Tue Apr 18 11:25:24 IST 2017

Unique Patch ID: 19560242
Created on 18 Nov 2015, 16:29:08 hrs PST8PDT
Bugs fixed:
21864513

Patch 21321429 : applied on Tue Apr 18 11:19:58 IST 2017

Unique Patch ID: 19794377
Created on 26 Jan 2016, 15:14:07 hrs PST8PDT
Bugs fixed:
21321429
Patch 22098146 : applied on Tue Apr 18 11:17:19 IST 2017
Unique Patch ID: 19488651
Created on 12 Nov 2015, 05:00:27 hrs PST8PDT
Bugs fixed:
21028698, 18689530

Patch 24481723 : applied on Tue Apr 18 11:14:07 IST 2017

Unique Patch ID: 20508201
Created on 21 Aug 2016, 11:20:00 hrs PST8PDT
Bugs fixed:
18485835, 21099502, 21614112

Patch 20766180 : applied on Tue Apr 18 11:11:25 IST 2017

Unique Patch ID: 20801692
Created on 29 Nov 2016, 00:59:53 hrs PST8PDT
Bugs fixed:
20766180

Patch 19908836 : applied on Tue Apr 18 11:08:48 IST 2017

Unique Patch ID: 19721463
Created on 12 Jan 2016, 05:06:27 hrs PST8PDT
Bugs fixed:
19908836

Patch 19591608 : applied on Tue Apr 18 11:06:39 IST 2017

Unique Patch ID: 18095152
Created on 27 Sep 2014, 10:36:22 hrs PST8PDT
Bugs fixed:
19591608

Patch 24911308 : applied on Tue Apr 18 11:00:55 IST 2017

Unique Patch ID: 20685089
Created on 4 Nov 2016, 01:51:36 hrs PST8PDT
Bugs fixed:
18674024, 18964939, 19239846, 19487147, 19536415, 20245930, 20413820
20588502, 20627866, 20825533, 20936905, 21091431, 21106027, 21387964
21813400, 22024071, 22568797, 22640754, 22666802, 23084142, 23220453
23632545, 23645516, 24326444, 24385983

Patch 18793246 : applied on Mon Apr 17 15:32:03 IST 2017

Unique Patch ID: 18373074
Created on 11 Dec 2014, 13:04:20 hrs PST8PDT
Bugs fixed:
18793246

Patch 20798891 : applied on Sat Apr 15 01:02:15 IST 2017

Unique Patch ID: 18832956
Created on 25 Sep 2015, 12:51:09 hrs PST8PDT
Bugs fixed:
20798891

Patch 22223463 : applied on Sat Apr 15 01:01:02 IST 2017

Unique Patch ID: 19603646
Created on 1 Dec 2015, 15:48:07 hrs PST8PDT
Bugs fixed:
22223463

Patch 21153266 : applied on Sat Apr 15 00:58:14 IST 2017

Unique Patch ID: 19123094
Created on 24 Jul 2015, 02:35:56 hrs PST8PDT
Bugs fixed:
21153266

Patch 20887355 : applied on Sat Apr 15 00:57:41 IST 2017

Unique Patch ID: 18990781
Created on 13 Jul 2015, 08:23:23 hrs PST8PDT
Bugs fixed:
20887355

Patch 20830911 : applied on Sat Apr 15 00:53:46 IST 2017

Unique Patch ID: 18781025
Created on 4 Apr 2015, 07:25:16 hrs PST8PDT
Bugs fixed:
19791273, 18607546

Patch 18966843 : applied on Sat Apr 15 00:53:24 IST 2017

Unique Patch ID: 18827839
Created on 16 Apr 2015, 05:15:11 hrs PST8PDT
Bugs fixed:
18966843

Patch 19835133 : applied on Sat Apr 15 00:52:22 IST 2017

Unique Patch ID: 18717257
Created on 27 Mar 2015, 10:05:59 hrs PST8PDT
Bugs fixed:
19835133

Patch 20294666 : applied on Sat Apr 15 00:50:47 IST 2017

Unique Patch ID: 18487079
Created on 6 Feb 2015, 08:04:13 hrs PST8PDT
Bugs fixed:
20294666

Patch 20204035 : applied on Sat Apr 15 00:49:12 IST 2017

Unique Patch ID: 18381868
Created on 15 Dec 2014, 05:44:27 hrs PST8PDT
Bugs fixed:
20123899, 15894842

Patch 20181016 : applied on Sat Apr 15 00:48:01 IST 2017

Unique Patch ID: 18448465
Created on 6 Jan 2015, 01:17:36 hrs PST8PDT
Bugs fixed:
20181016

Patch 20093776 : applied on Sat Apr 15 00:46:54 IST 2017

Unique Patch ID: 18363536
Created on 12 Dec 2014, 06:20:38 hrs PST8PDT
Bugs fixed:
20093776

Patch 19896336 : applied on Sat Apr 15 00:45:34 IST 2017

Unique Patch ID: 18257069
Created on 21 Nov 2014, 08:37:46 hrs PST8PDT
Bugs fixed:
19896336
Patch 19393542 : applied on Sat Apr 15 00:44:18 IST 2017
Unique Patch ID: 18031353
Created on 19 Sep 2014, 07:43:45 hrs PST8PDT
Bugs fixed:
19393542

Patch 19649152 : applied on Sat Apr 15 00:43:09 IST 2017

Unique Patch ID: 18095241
Created on 27 Sep 2014, 02:32:57 hrs PST8PDT
Bugs fixed:
19649152

Patch 19627012 : applied on Sat Apr 15 00:41:37 IST 2017

Unique Patch ID: 18249807
Created on 11 Nov 2014, 06:28:09 hrs PST8PDT
Bugs fixed:
19627012

Patch 19291380 : applied on Sat Apr 15 00:39:52 IST 2017

Unique Patch ID: 18130618
Created on 24 Oct 2014, 05:32:30 hrs PST8PDT
Bugs fixed:
19291380

Patch 19472320 : applied on Sat Apr 15 00:35:56 IST 2017

Unique Patch ID: 18110569
Created on 20 Oct 2014, 03:14:44 hrs PST8PDT
Bugs fixed:
19472320

Patch 19779059 : applied on Sat Apr 15 00:33:56 IST 2017

Unique Patch ID: 18123924
Created on 13 Oct 2014, 08:40:22 hrs PST8PDT
Bugs fixed:
16359751, 19382851

--------------------------------------------------------------------------------

OPatch succeeded.

reference : https://doyensys.com/blogs/lsinventorysession-failed-rawinventory-gets-
null-oraclehomeinfo/
-----------------------------------------------------------------------------------
-------------

ISSUE
Verifying environment and performing prerequisite checks...
Prerequisite check "CheckActiveFilesAndExecutables" failed.
The details are:

Following executables are active :

/u01/db/ERPDEV/12.1.0/dbhome_1/bin/oracle
UtilSession failed: Prerequisite check "CheckActiveFilesAndExecutables" failed.

$/sbin/fuser oracle
oracle: 663e 667e 671e 675e 680e 684e 688e 692e 696e 834e 838e
862e 868e 904e 932e 1404e 3048e 6007e 6011e 6015e 6021e 6025e 6033e
6037e
6041e 6045e 6049e 6053e 6057e 6061e 6065e 6069e 6073e 6077e 6081e 6085e
6089e
6151e 6159e 6163e 6167e 6171e 6175e 6179e 6196e 6201e 6213e 6221e 6225e
9993e
11270e 11274e 30954e 31156e 31163e 31172e 31184e 31186e 31221e 31223e 31228e 31235e
31243e
31246e 31254e 31257e 31260e 31268e 31271e 31275e 31278e 31282e 31285e 31288e 31292e
31296e
31298e 31318e 31339e 31343e 31347e 31351e 31357e 31361e 31380e 31382e 31413e 31420e
31466e
31526e
$kill -9 663e 667e 671e 675e 680e 684e 688e 692e 696e 834e 838e
862e 868e 904e 932e 1404e 3048e 6007e 6011e 6015e 6021e 6025e 6033e
6037e
6041e 6045e 6049e 6053e 6057e 6061e 6065e 6069e 6073e 6077e 6081e 6085e
6089e
6151e 6159e 6163e 6167e 6171e 6175e 6179e 6196e 6201e 6213e 6221e 6225e
9993e
11270e 11274e 30954e 31156e 31163e 31172e 31184e 31186e 31221e 31223e 31228e 31235e
31243e
31246e 31254e 31257e 31260e 31268e 31271e 31275e 31278e 31282e 31285e 31288e 31292e
31296e
31298e 31318e 31339e 31343e 31347e 31351e 31357e 31361e 31380e 31382e 31413e 31420e
31466e
31526e
(WITHOUT E,ie; no need to have e while killing the processes)

----------------------------------------------------------------------------------
Oracle APPS DBA Real Time Issues and Solutions
Hiya Buddies,
I would like to share some real time issue and solution which we have faced during
the EBS integration recently.
These are very common issues also which may helpful here to all...

1. Issue –
Suppose, our Concurrent Manager processing are running slow then what we have done
and what we need to check.
As per our investigation we found as 2000 request was submitted one at time. So, CM
cannot cache as request are coming one at time

What we did and got Fix:

1) Reduced Conflict Resolution Manager Sleep Time to 10
2) Increase Cache Size to 20 for standard manager

2) Issue -
This issue we get almost time and it is very common : java.lang.OutOfMemoryError:
Java heap space & Intermittent HTTP-500 Errors

Solution:
We got the fix issue by Increase Java Heap & number of oacore JVM’s
a) <oacore_jvm_start_options oa_var="s_oacore_jvm_start_options">-server -

?'
verbose:gc -Xmx1024M -Xms512M -XX:MaxPermSize=256M -XX:NewRatio=2 -XX:+PrintGCT

imeStamps -XX:+UseTLAB -XX:+UseParallelGC -XX:ParallelGCThreads=2 -Dcom.sun.ma

nagement.jmxremote -Djava.security.policy=$ORACLE_HOME/j2ee/oacore/config/java2.
policy -Djava.awt.headless=true -Dhttp.webdir.enable=false -Doracle.security.jaz

n.config=/u01/apps/inst/apps/ORA-DATA/ora/10.1.3/j2ee/oacore/config/j

azn.xml</oacore_jvm_start_options>

b) <oacore_nprocs oa_var="s_oacore_nprocs">2</oacore_nprocs>

3) Issue -
Log file details:
java.io.IOException: Broken pipe
13/01/19 11:12:04.849 html: Servlet error
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcher.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:104)
at sun.nio.ch.IOUtil.write(IOUtil.java:75)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:334)
at java.nio.channels.Channels.write(Channels.java:60)
at java.nio.channels.Channels.access$000(Channels.java:47)
at java.nio.channels.Channels$1.write(Channels.java:134)
;/ at
com.evermind.server.http.AJPOutputStream.endRequest(AJPOutputStream.java:117)
at
com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:317)
at
com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:199)
at
oracle.oc4j.network.ServerSocketReadHandler$SafeRunnable.run(ServerSocketReadHandle
r.java:260)

For this above issue we found work-around and Fix as:

– Apache pid should be on Local File System than
s_lock_pid_dir - /u01/apps/inst/apps/ORA-DATA/pids/10.1.3/Apache/logs
s_pids_dir - /u01/apps/inst/apps/ORA-DATA/pids
s_web_pid_file - /u01/apps/inst/apps/ORA-DATA/pids/10.1.3/Apache/httpd.pid

4)Issue –
Suppose, our Workflow Notification Mailer is running either slow or not working
then what we need to do.

Work-around:
a) Workflow Manager Have System Hold Fix Manager Before Resetting Counters

Solution:
Wfmgsms And Wfmgsmd Managers Have System Hold Fix Manager Before Resetting Counters
[ID 1378284.1] -- ref.
SQL> update FND_CONCURRENT_QUEUES
set ENABLED_FLAG='N'
where CONCURRENT_QUEUE_NAME like 'WF%GSM%'
SQL> commit;
;
b) Notification Mailer slow/not running
oracle.apps.fnd.wf.mailer.NotificationFormatter$FormatterSAXException:
Problem obtaining the HTML content ->
oracle.apps.fnd.wf.common.HTTPClientException:
Unable to invoke method HTTPClient.HTTPResponse.listHeaders caused by:
java.net.SocketTimeoutException: Read timed out
Solution:
Profile “WF: Workflow Mailer Framework Web Agent” set.
select t.PROFILE_OPTION_ID ID, z.USER_PROFILE_OPTION_NAME Profile,
nvl(v.PROFILE_OPTION_VALUE,'Replace with non-load balanced URL') Value,
decode(v.level_id, 10001,'Site',
10002,'Application',
10003,'Responsibility',
10004,'User',
10005,'Server',
10006,'Organization') "LEVEL"
from fnd_profile_options t, fnd_profile_option_values v, fnd_profile_options_tl z
where (v.PROFILE_OPTION_ID (+) = t.PROFILE_OPTION_ID)
and (z.PROFILE_OPTION_NAME = t.PROFILE_OPTION_NAME)
and (t.PROFILE_OPTION_NAME in
('APPS_FRAMEWORK_AGENT','WF_MAIL_WEB_AGENT'));
To set the WF_MAIL_WEB_AGENT profile :

- Stop Workflow Mailer and Agent Listener service

- Change the "WF: Workflow Mailer Framework Web Agent" [WF_MAIL_WEB_AGENT] profile
option to point to a physical Web Server host address that is non-load balanced.

- Rebuild mailer queue with:

SQL>@$FND_TOP/patch/115/sql/wfntfqup.sql APPS <APPS schema passwd> APPLSYS•Start
Workflow Mailer and Agent Listener service.

-Test scenario with a new notification.

select * from wf_notifications
check mail_status=’SENT’ for notification

5)Issue -
FRM-41839 Disk I/O error on temporary record buffer file /tmp/AAxxe893.tmp

Solution:
We need to Increase the /tmp size to 8 GB

-----------------------------------------------------------------------------------
---------------------
INTRODUCTION TO ORACLE APPS DBA

Oracle APPS DBA:

What is Application Database?

The Database which is storing the data’s from application (say front end ) that is
EBS (Enterprise Business suite) is said to be Application Database .

What is EBS?

Oracle E-Business Suite is one of Oracle Corp’s major product lines. Also known as
Oracle EBS, it is an integrated set of business applications for automating
customer relationship management (CRM), enterprise resource planning (ERP), supply
chain management (SCM), human resource management (HRMS)etc. processes within
organizations. This for Whole is Application

What is Database?
A database is collection of data’s That is in the form of objects.

Objects List

Tables
Views
Synonyms
Sequence
Triggers
Functions
Packages
Procedures
Roles Etc.
These are Database Objects When the database is up and Running.

The Person Who is maintaining both application and database is APPS DBA.

Roles and Responsibilities Of Oracle APPS DBA

Installation, configuration and upgrading of Oracle server software and related

products.
Starting and Stopping the application
Monitoring the application related products like oacore,oafm apache etc.
Bouncing apache,oacore,oafm if needed
Establish and maintain backup and recovery policies and procedures.
Take care of the Database design and implementation.
Implement and maintain database security (create and maintain users and roles,
assign privileges).
Work as part of a team and provide 24×7 support when required
Perform general technical trouble shooting and give consultation to development
teams.
Interface with Oracle Corporation for technical support.
Patch Management and Version Control.
Perform database tuning and performance monitoring.
Perform application tuning and performance monitoring.
Cloning DEV and TEST from PROD.
Prerequisites for Learning Oracle APPS DBA

Good Knowledge in OS like Linux, IBM(UIX), Windows etc.as oracle software will be
installed on these OS’s.
Good Knowledge in sql and PlSQL.
Very good understanding of Oracle core database architecture and concepts
Oracle SQLNet configuration and working knowledge
Knowledge on Concurrent managers
Daily activities are performed by the “Oracle Apps DBA” is mention below: –

There are mainly 4 types of roles an Oracle Apps DBA have :

Type 1: L1 Apps DBAs

L1 Apps DBAs mainly involve in help desk activities such as:

Answering calls
Logging/updating tickets
Interacting with L2 Apps DBAs on tasks to be completed
Monitoring alerts
Type 2: L2 Apps DBAs

L2 Apps DBAs mainly work on daily/scheduled/ad-hoc activities such as:

Code Migration Support to Functional Consultants
Handling tickets raised by functional/technical/business users
Handling Alerts raised by alert monitoring system from Database and applications
Tablespace Reorg Activities to improve the performance/to reclaim the unused space
Schema Reorg Activities to improve the performance
Patch Analysis where there is a patch needs to be applied
Patch Application as per schedule
Cloning as per schedules
Backups and issues related to them
Query response time and other Performance Issues
Work with Oracle Support by raising SRs on several issues
Monitoring Standby Databases and resolve respective issues
Regular database maintenance activities (tablespace management, datapump, purging
logfiles……)
Training L1 Apps DBAs to make them L2 Candidates.
L1 and L2 Apps DBAs are the main teams who will impact SLAs of a client

Type 3: L3 Apps DBAs

L3 Apps DBAs mainly work on installation/setup related tasks such as:

Work on issues which L2 couldn’t fix
New Environments Build/Setups
Designing Backup/Recovery policies
Installing new Application environments
Post-Installation Tasks of New environments
Integrating E-Business Suite with other environments such as (SOA, OSB, OBIEE, OTM,
IPM …)
Work on integration issues
Work on Cluster setups for both applications and databases
Work on DMZ setups to E-Business Suite
Work on Standby site setups for both applications and databases
Interact with Network/OS teams on network setups and load balancer setups.
Work on Parallel Concurrent Processing (PCP) Setups
Fail-over capabilities testing of E-Business Suite and database
Design Cloning strategies.
Work on design related issues.
Setting up E-Business Suite with Oracle Access Manager/OID to achieve Single Sign-
On (SSO) Capabilities

Training L2 team to make them L3 Candidates

Type 4: Architects

Architects are the ones who design systems from scratch. They mainly involve in:

Attend Client Meetings to understand their expectations.

Involve in Business User Meetings to understand their expectations.
Design E-Business Suite Architecture with failover/failback capabilities.
Design Clustering capabilities of E-Business Suite and databases.
Design High availability of E-Business Suite and databases.
Design hardware/capacity sizing.
Helping L3 Team to achieve their targets and in understanding technologies.
Conduct training sessions to the L3 team to get an understanding of system design.
Fix any architectural related issues.
Work on integration options of E-Business Suite with other environments such as
(SOA, OSB, OBIEE, OTM, IPM …)

-----------------------------------------------------------------------------------
----------------
what to do when user reported load on the server ?
my query was running fine yesterday and today running long time ?
how to check bllocking session ?
what is holder and waiter sessions ?
what is the awr ,ash,addm ?
how to rebuild index ?
how to shirnk table ?
what is the fragmentation ?
what are the wait events ?

-----------------------------------------------------------------------------------
---------------
Did you face any memory issue whhile applying weblogic patch ?

Yes, need to update memory arguments in $FMW_HOME/util/bsu/bsu.sh file

-----------------------------------------------------------------------------------
------------------
How to troubleshoot long running concurrent request ?
1.Determine Which Manager Ran a Specific Concurrent Request?
2.Concurrent manager status for a given sid?
3.Find out request id from Oracle_Process Id
4.find sid,serial# for a given concurrent request id?
5. find the sql query for a given concurrent request sid?
6.find child requests
7. check is there any database lock happened for this Concurrent request
8. Enable trace and by using tkprof find any wait events
9. execute execution plan and see what is cost and is it going to full
table/index scan
10. check when table collected stats ?
11. check unselect indexes or index might corrept
12. check how many execution plans for sqlhas values
13. By using OEM -> sql advisior :find any hints or profiles
14. Send right execution plan to baseline to fix the plan
-----------------------------------------------------------------------------------
-------------------
My patch failed with prereq then how to troubleshoot ?
Quit the all works using adctrl
Take backup of fnd_install_processes and ad_deferred_jobs
Take *.rf9 file in $APPL_TOP/admin/SID/restart/*
Drop fnd_install_processes and ad_deferred_jobs
Apply prereq patch
Revert the fnd_install_processes and ad_deferred_jobs
Revert the *.rf9 files from $APPL_TOP/admin/ERPPROD/restart
Apply failed patch mention yes to continue the previews patch
-----------------------------------------------------------------------------------
-------------------
ISSUE
[Solved] Oracle E-Business Suite (R12) Cloning Issue: ERROR: Script timed out

This post covers Apps Tier or middle tier cloning issue ‘ERROR: Script timed out’
in Oracle E-Business Suite R12 and how to troubleshoot it with complete solution.

But before that let’s first understand what is cloning and high level steps of
Cloning in EBS R12

Cloning is the process of creating a copy of an existing Oracle E-Business Suite

system using Rapid Clone. For more details about cloning check here

High Level Steps of Cloning in EBS (R12)

The cloning process consists of the following three phases, each of which is made
up of several logical sections and their steps.

1. Prepare the Source System for database tier and application tier
1.1 Database Tier
a) Log on to the Source System as the oracle user.
b) Source the Database tier environment file.
c) Execute the following commands:
cd <RDBMS ORACLE_HOME>/appsutil/scripts/<CONTEXT_NAME>
perl adpreclone.pl dbTier

1.2 Application Tier

a) Log on to the primary node of the Source System as the applmgr user.
b) Source the environment file of the Run Edition File system.

Note: You can use the following command to confirm that the environment variable
FILE_EDITION points to the Run Edition File System:
echo $FILE_EDITION
It should return the value:
run

c) Execute the following commands:

cd <INST_TOP>/admin/scripts
perl adpreclone.pl appsTier

2. Copy both database tier and application tier nodes from the Source System to
Target System
2.1 Database Tier
a) Create Target Directory structure like “/u01/oracle/PRD122” from root user and
then change ownership to target DB user, in our case its oracle:dba

mkdir –p /u01/oracle/PRD122
chown –R oracle:dba /u01

b) Copy DB Tier files from source to target (from root user)

cd /u01/oracle/PRD122
cp –RH data /u01/oracle/PRD122
cp –RH 12.1.0 /u01/oracle/PRD122

c) Change ownership of data and 12.1.0 to target DB User. In our case its
oracle:dba

cd /u01/oracle/PRD122
chown –R oracle:dba data
chown –R oracle:dba 12.1.0

2.2 Application Tier

a) Copy Run and Patch Edition File System and Apps Tier files from source to target
like $APPL_TOP, $COMMON_TOP, 10.1.2 ORACLE_HOME (from root user)

cd /u01/oracle/PRD122
cp -RH fs1 /u01/oracle/PRD122/fs1
cp -RH fs2 /u01/oracle/PRD122/fs2

b) Change permission of fs1 to applmgr:dba on target (/u01/oracle/PRD122).

cd /u01/oracle/PRD122
chown -R applmgr:dba fs1
chown -R applmgr:dba fs2

3. Configure the Target System for both database tier and application tier
3.1 Database Tier
a) Log on to the Target System as the oracle user and enter the following commands:
cd <RDBMS ORACLE_HOME>/appsutil/clone/bin
perl adcfgclone.pl dbTier

The log file is created in <RDBMS_ORACLE_HOME>/appsutil/log/<CONTEXT_NAME>

directory.

3.2 Application Tier

a) Log on to the Run Edition File System in the Target System as the applmgr user
and enter the following commands:
cd <COMMON_TOP>/clone/bin
perl adcfgclone.pl appsTier dualfs

Note: Different logs are created for Run Edition and Patch Edition Cloning. The log
files are created in the following directories in the Run Edition File System:
<INST_TOP>/admin/log/clone/run
<INST_TOP>/admin/log/clone/patch

Below diagram explain the flow of Cloning in Application Tier of Oracle E-Business
Suite R12

Process of Standard Cloning TaskIssue:

Trainee was hitting issue while Configuring the Target System on application tier
as

cd <COMMON_TOP>/clone/bin
perl adcfgclone.pl appsTier dualfs

Error in logs: $INST_TOP/apps/$CONTEXT_NAME/admin/log/StageAppsTier_MMDDHHMM.log

Note: Kindly refer this post to know more about log file location in R12.2 Oracle
Apps R12.2 Log Files Location every Apps DBA must know

START: Creating new WLS domain.

Running /u01/oracle/PRD122/fs2/FMW_Home/oracle_common/bin/pasteConfig.sh -
javaHome /u01/oracle/PRD122/fs2/EBSapps/comn/util/jdk64 -al
/u01/oracle/PRD122/fs2/EBSapps/comn/clone/FMW/WLS/EBSdomain.jar -tdl
/u01/oracle/PRD122/fs2/FMW_Home/user_projects/domains/EBS_domain_PRD122 -tmw
/u01/oracle/PRD122/fs2/FMW_Home -mpl
/u01/oracle/PRD122/fs2/EBSapps/comn/clone/FMW/WLS/plan/moveplan.xml -ldl
/u01/oracle/PRD122/fs2/inst/apps/PRD122_erpprd122/admin/log/clone/run/wlsT2PApply -
silent true -debug true -domainAdminPassword
/u01/oracle/PRD122/fs2/EBSapps/comn/clone/FMW/tempinfo.txt

Script Executed in 7200014 milliseconds, returning status -1

ERROR: Script timed out.

Solution:
Timeout Error Encountered for pasteBinary.sh While Running “adop phase=fs_clone”
(Doc ID 1599424.1)

Though it is fs_clone, the workaround is good for the current issue as well.
-----------------------------------------------------------------------------------
---------------
Application R12 Cloning Issues :

1. log/out files are not getting generated:

· stop all concurrent services
· Navigate to profile/system
· search for %RRA Enabled%
· set the value to “yes” and save it
· start the concurrent services
· test the issue

2. Concurrent Managers are not getting up.

· CLeaned up the nodes from FND_NODES by using EXEC FND_CONC_CLONE.SETUP_CLEAN;
- Ran autoconfig on all tier ( DB first then CM and then Web node ) checked node
entries again. then started CM.
- Also entries in fnd_concurrent_queues (NODE_NAME,TARGET_NODE) and then checked.

3. apps listener is not getting up ?

First check log file of apps listener to find root cause at adalnctl.txt
1. $OAD_TOP/admin/log/$CONTEXT_NAME/adalnctl.txt
2. $ORACLE_HOME/network/admin/apps_$SID.log (on Middle Tier)
1. Failure to create proper apps listener file via adgentns.sh during Rapid Clone
process
2. FNDSM (Service Manager issues) FNDSM Entries missing in tnsnames.ora.

4. RC-00110: Fatal: Error occurred while relinking of ApplyDBTechStack

Drop softlink and recreate it pointing to target ORACLE_HOME

5. Oracle APPS R12 Post Cloning issue - Form not launching :

1- Stopped the APPS Tier services.

2- rename the directory "tldcache" under following directories.
a- $ORA_CONFIG_HOME/10.1.3/j2ee/oafm/tldcache
b- $ORA_CONFIG_HOME/10.1.3/j2ee/oacore/tldcache
c- $ORA_CONFIG_HOME/10.1.3/j2ee/forms/tldcache
3- create the emplty directory with the name "tldcache" under the above
directories.
4- restart the APPS Tier services.
5- test the issue with starting some forms.

6 . R12 Login issue on target after cloning

1. cd $FND_TOP/patch/115/bin
2. perl ojspCompile.pl --compile --flush -p 2
3. Run autoconfig on both db and apps tiers
3. Bring up the services and test login

11i - perl ojspcompile.pl --compile -quiet

7. Error 500 – Internal server error

Fix: 1) Clear Cache (Application Server Cache)and start the services
-----------------------------------------------------------------------------------
---------------------------
Troubleshooting ADOP Prepare Phase Issue:
1. Run Prepare Phase:
Any Patching Cycle starts with Prepare Phase and to start it run below command

adop phase=prepare

Prepare phase is failing with error message

[UNEXPECTED]fs_clone has failed.

[UNEXPECTED]Error calling runPendingConfigClone subroutine.
2. Look at ADOP logs:
First thing in troubleshooting is to look at log file (in this case ADOP log file)

Note: Kindly refer this post to know more on log file location in R12.2 Oracle Apps
R12.2 Log Files Location every Apps DBA must know
A) Error in adop logs:
/u01/oracle/PRD122/fs_ne/EBSapps/log/adop/6/prepare_20171109_032332/
PRD122_1705ecloud05/log/adop.log
Note: Here
/u01/oracle/PROD is Oracle EBS install base directory
fs_ne Non-Editioned File System
6 – adop session id
prepare_20171109_032332 – <phase>_<date>_<time>
PRD122_1705ecloud05 – CONTEXT NAME
Oracle Apps R12.2 has Dual File System (fs1 & fs2), which helps organizations to
have less downtime during patching. By introducing duplicate file system, Oracle
has reduced patching downtime and improved availability of the system.

We can focus on three major parts of the E-Business Suite 12.2 file system:

File System 1 (fs1): /u01/oracle/PROD/fs1

File System 2 (fs2): /u01/oracle/PROD/fs2
Non-Editioned File System (fs_ne): /u01/oracle/PROD/fs_ne
Thu Nov 9 03:34:15 2017

*******FATAL ERROR*******
PROGRAM :
(/u01/oracle/PRD122/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSyn
chronize.pl)
TIME : Thu Nov 9 03:34:15 2017
FUNCTION: main::migrateCloneComponentApply [ Level 1 ]
ERRORMSG: /u01/oracle/PRD122/fs1/EBSapps/comn/adopclone_1705ecloud05/bin/adclone.pl
did not go through successfully.
[UNEXPECTED]Error occurred running “perl
/u01/oracle/PRD122/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSync
hronize.pl -contextfile=/u01/oracle/PRD122/fs1/inst/apps/PRD12111_1705ecloud05/
appl/admin/PRD12111_1705ecloud05.xml
-patchcontextfile=/u01/oracle/PRD122/fs2/inst/apps/PRD12111_1705ecloud05/appl/
admin/PRD12111_1705ecloud05.xml -promptmsg=hide -console=off -mode=migrate -
sync_mode=copy -sessionid=6 -timestamp=20171109_032332
-outdir=/u01/oracle/PRD122/fs_ne/EBSapps/log/adop/6/20171109_032332/prepare/
1705ecloud05”
[UNEXPECTED]occurred during CONFIG_CLONE Patch File System from Run File
System, running command: “perl
/u01/oracle/PRD122/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSync
hronize.pl -contextfile=/u01/oracle/PRD122/fs1/inst/apps/PRD12111_1705ecloud05/
appl/admin/PRD12111_1705ecloud05.xml
-patchcontextfile=/u01/oracle/PRD122/fs2/inst/apps/PRD12111_1705ecloud05/appl/
admin/PRD12111_1705ecloud05.xml -promptmsg=hide -console=off -mode=migrate -
sync_mode=copy -sessionid=6 -timestamp=20171109_032332
-outdir=/u01/oracle/PRD122/fs_ne/EBSapps/log/adop/6/20171109_032332/prepare/
1705ecloud05”.
[PROCEDURE] [START 2017/11/09 03:34:15] Updating status of patches
[STATEMENT] SQL statement : ” update ad_adop_session_patches
set status=’F’
where applied_file_system_base = ‘/u01/oracle/PRD122/fs1’ and
patch_file_system_base = ‘/u01/oracle/PRD122/fs2′ and bug_number=’CONFIG_CLONE’
and status <> ‘Y’
and appltop_id=195 and node_name=’1705ecloud05′”
[PROCEDURE] [END 2017/11/09 03:34:16] Updating status of patches
[STATEMENT] SQL statement : ” update ad_adop_session_patches
set status=’F’
where applied_file_system_base = ‘/u01/oracle/PRD122/fs1’ and
patch_file_system_base = ‘/u01/oracle/PRD122/fs2′ and bug_number=’CONFIG_CLONE’
and status <> ‘Y’
and appltop_id=195 and node_name=’1705ecloud05′”
[PROCEDURE] [END 2017/11/09 03:34:16] Updating status of patches
[UNEXPECTED]fs_clone has failed.
[UNEXPECTED]Error calling runPendingConfigClone subroutine.
B) Error in fs_clone logs:
Note: Prepare Phase, creates a clone of Patch File System from Run File System, and
as per the previous log, an error was during this Cloning so we need to look at
clone logs.

$INST_TOP/admin/log/clone/FSCloneApplyAppsTier_<timestamp>.log
START: Instantiating the OHS Config.
Running /u01/oracle/PRD122/fs2/FMW_Home/webtier/perl/bin/perl
-I/u01/oracle/PRD122/fs2/FMW_Home/webtier/perl/lib/5.10.0
-I/u01/oracle/PRD122/fs2/FMW_Home/webtier/perl/lib/site_perl/5.10.0
-I/u01/oracle/PRD122/fs2/EBSapps/appl/au/12.0.0/perl
-I/u01/oracle/PRD122/fs2/FMW_Home/webtier/ohs/mod_perl/lib/site_perl/5.10.0/x86_64-
linux-thread-multi
/u01/oracle/PRD122/fs2/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetOHSConfig.pl
cfgCloneInstance
-ctxfile=/u01/oracle/PRD122/fs2/inst/apps/PRD12111_1705ecloud05/appl/admin/
PRD12111_1705ecloud05.xml
-archvloc=/u01/oracle/PRD122/fs1/EBSapps/comn/adopclone_1705ecloud05/FMW/OHS/
ohsarchive.jar -mvpln=/u01/oracle/PRD122/fs1/EBSapps/comn/adopclone_1705ecloud05/
FMW/OHS/moveplan.xml
-t2plogloc=/u01/oracle/PRD122/fs1/inst/apps/PRD12111_1705ecloud05/admin/log/clone/
ohsT2PApply -logdir=/u01/oracle/PRD122/fs1/inst/apps/PRD12111_1705ecloud05/admin/
log/clone -console=off -promptmsg=hide
Script Executed in 37703 milliseconds, returning status 255
ERROR: Script failed, exit code 255
Error Message :1
[PLUGIN][OHS] – ERROR – Nov 9, 2017 03:34:15 – CLONE-26009 OHS T2P failed.
[PLUGIN][OHS] – CAUSE – Nov 9, 2017 03:34:15 – CLONE-26009 Unable to start OS
component.
[PLUGIN][OHS] – ACTION – Nov 9, 2017 03:34:15 – CLONE-26009 Check clone log and
error file and ohs log file
/u01/oracle/PRD122/fs2/FMW_Home/webtier/instances/EBS_web_PRD12111_OHS1/
diagnostics/logs/OHS/EBS_web_PRD12111/console~OHS~1.log for root cause.
C) Error in OHS logs:
Note: Clone process clones, Fusion Midddleware (WebLogic & OHS) as per the previous
log, the error was during this startup of OHS server so we need to look at OHS
logs.

/u01/oracle/PRD122/fs2/FMW_Home/webtier/instances/EBS_web_PRD12111_OHS1/
diagnostics/logs/OHS/EBS_web_PRD12111/console~OHS~1.log
 /u01/oracle/PRD122/fs2/FMW_Home/webtier/ohs/bin/apachectl startssl: execing httpd
httpd.worker: bad user name applmgr11
3. Root Cause:
Root cause as identified in previous OHS log was, wrong owner permission for OHS
files

Checked httpd.conf file and wherever it is having applmgr11, changed to applmgr

user permission

cd /u01/oracle/PRD122/fs1/inst/apps/PRD12111_1705ecloud05/appl/admin/cutover/OHS/
EBS_web_PRD12111
[root@1705ecloud05 EBS_web_PRD12111]# grep applmgr11 *
httpd.conf: User applmgr11
[root@1705ecloud05 EBS_web_PRD12111]# chown applmgr:dba httpd.conf
[root@1705ecloud05 EBS_web_PRD12111]#
User applmgr
#Group GROUP_TEMPLATE
</IfModule>
4. Change in Context File
Note: After updating user to applmgr in httpd.conf, OHS start-up was still failing

So checked $CONTEXT_FILE and below two entries having applmgr11 user on both run
(fs1) and patch (fs2) file system and causing the issue

<appsuser oa_var=”s_appsuser” osd=”unix”>applmgr11</appsuser>

<sysadminmail oa_var=”s_sysadmin_mail”
osd=”unix”>applmgr11@1705ecloud05.k21academy.com</sysadminmail>
/u01/oracle/PRD122/fs1/inst/apps/PRD12111_1705ecloud05/appl/admin/
PRD12111_1705ecloud05.xml

Note: $CONTEXT_FILE, captured all configuration parameters. In Oracle R12, we are

having two context file:

Application context file called the <CONTEXT_NAME>.xml contains the configuration

information for the application tier & is located in $APPl_TOP/admin for each node
of application tier.

Database context file called the <CONTEXT_NAME>.xml contains the configuration

information for the database tier & is located in $ORACLE_HOME/appsutil/

Fix:
1. Changed user to applmgr on both run and patch file system under $CONTEXT_FILE
and run autoconfig, then restart prepare phase again

<appsuser oa_var=”s_appsuser” osd=”unix”>applmgr</appsuser>

<sysadminmail oa_var=”s_sysadmin_mail”
osd=”unix”>applmgr@1705ecloud05.k21academy.com</sysadminmail>
/u01/oracle/PRD122/fs1/inst/apps/PRD12111_1705ecloud05/appl/admin/
PRD12111_1705ecloud05.xml

Run Prepare Phase Again:

adop phase=prepare restart=yes

The Node Manager is already shutdown

NodeManager log is located at

/u01/oracle/PRD122/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome1

adnodemgrctl.sh: exiting with status 2

adnodemgrctl.sh: check the logfile
/u01/oracle/PRD122/fs2/inst/apps/PRD12111_1705ecloud05/logs/appl/admin/log/
adnodemgrctl.txt for more information …

The prepare phase completed successfully.

adop exiting with status = 0 (Success)

Checked ADOP Status

adop -status

ADOP (C.Delta.8)
Session Id: 6
Command: status
Output:
/u01/oracle/PRD122/fs_ne/EBSapps/log/adop/6/20171109_085910/adzdshowstatus.out
===============================================================
Node Name Node Type Phase Status Started
Finished Elapsed
————— ———- ————— ————— ——————– ——————– ————
1705ecloud05 master PREPARE COMPLETED 2017/11/06 22:41:13
2017/11/09 08:47:02 58:05:49
APPLY NOT STARTED
FINALIZE NOT STARTED
CUTOVER NOT STARTED
CLEANUP NOT STARTED

File System Synchronization Type: Light

adop exiting with status = 0 (Success)

-----------------------------------------------------------------------------------
----------------

Common Issues when cloning the Database Tier

ISSUE
How to prevent DB recovery issues when running adcfgclone
These errors can be prevented using the following steps

ORA-01547: warning: RECOVER succeeded but OPEN RESETLOGS would get error below
ORA-01194: file 1 needs more recovery to be consistent
ORA-01110: data file 1: <file>.dbf
ORA-01503: CREATE CONTROLFILE failed
ORA-01159: file is not from same database as previous files - wrong database
id

Note: The steps in this section apply to cold backups only. To perform Cloning
using HOT Backup, refer the following Document 760772.1 Cloning Oracle Application
11i /R12 with Rapid Clone - Database (9i/10g/11g) Using Hot Backup on Open Database

To perform Cloning using Cold Backup, make sure these steps are followed to avoid
any recovery issues while performing cloning at Target:
Follow the "Prepare the source system database tier for cloning" steps in the
cloning notes Note 230672.1(11i) or Note 406982.1(R12) . These are as follows:
Run autoconfig
Run adpreclone on dbTier
Stop DB and its listener processes
Shutdown the Database with (Normal, Immediate ) Mode
Bring down the application services
Crosscheck with alert log whether DB has been shutdown completely
Run the following OS command to confirm/crosscheck that no DB process running , if
any DB processes running , terminate them manually
ps -ef | grep pmon
Copy all the datafiles from Source to Target
On Target System, at mount stage on Database, run the following SQL :
set pagesize 20000
set linesize 180
set pause off
set serveroutput on
set feedback on
set echo on
set numformat 999999999999999
Spool recovery_info.txt
select substr(name, 1, 50), status from v$datafile;
select substr(name,1,40), recover, fuzzy, checkpoint_change# from
v$datafile_header;
select GROUP#,substr(member,1,60) from v$logfile;
select * from v$recover_file;
select distinct status from v$backup;
select hxfil FILENUMBER,fhsta STATUS,fhscn SCN,fhrba_Seq SEQUENCE from x$kcvfh;
select distinct (fuzzy) from v$datafile_header;
select HXFIL File_num,substr(HXFNM,1,40) File_name,FHTYP Type,HXERR Validity, FHSCN
SCN, FHTNM
TABLESPACE_NAME,FHSTA status ,FHRBA_SEQ Sequence from X$KCVFH;
spool off
exit
Points to consider:
All Datafiles STATUS should be showing ONLINE , if any datafile is showing RECOVER,
then you need to recover at source and redo the copy again
The column checkpoint_change# of each datafiles different from the
checkpoint_change# of all the other datafiles. For a cold backup, all the
checkpoint_change# of the datafiles should be the same
v$recover_file should not show any datafiles need to be recovered
Check each datafile status and make sure that none of datafiles shows "RECOVER"
Make sure that the FHSTA column does not show status "4", if so, status 4 means the
datafile is online fuzzy, i.e, the datafile was backed when the database as open
Run the clone configuration command:
cd <RDBMS ORACLE_HOME>/appsutil/clone/bin
perl adcfgclone.pl dbTier

ISSUE
Troubleshooting DB recovery issues while running adcfgclone
This section shows how to troubleshoot the following error:

ORA-01194: file 1 needs more recovery to be consistent

ORA-01110: data file 1: '<file>.dbf'

Run the following to verify the backup

In target system, mount the database and run the following SQL :
set pagesize 20000
set linesize 180
set pause off
set serveroutput on
set feedback on
set echo on
set numformat 999999999999999
Spool recovery_info.txt
select substr(name, 1, 50), status from v$datafile;
select substr(name,1,40), recover, fuzzy, checkpoint_change# from
v$datafile_header;
select GROUP#,substr(member,1,60) from v$logfile;
select * from v$recover_file;
select distinct status from v$backup;
select hxfil FILENUMBER,fhsta STATUS,fhscn SCN,fhrba_Seq SEQUENCE from x$kcvfh;
select distinct (fuzzy) from v$datafile_header;
select HXFIL File_num,substr(HXFNM,1,40) File_name,FHTYP Type,HXERR Validity, FHSCN
SCN, FHTNM
TABLESPACE_NAME,FHSTA status ,FHRBA_SEQ Sequence from X$KCVFH;
spool off
exit
For a cold backup, all the checkpoint_change# of the datafiles should be the same.

If there are any differences in checkpoint_change# on any of the datafiles, the

datafile needs to be recovered at source, the database shutdown and the files the
copied again to the Target.
If the checkpoint_change# of each datafile is the same, then try the following
option:
SQL> startup mount;
SQL> recover database using backup controlfile until cancel;
-- type CANCEL
SQL> alter database open resetlogs;
If this is fails, then files will need to be recopied from the source.
If the select from X$KCVFH shows status as "4" for any of the datafiles, this
indicates the datafile is "online fuzzy", i.e, the datafile was backed up when the
database was open.
For example:

SQL> select HXFIL File_num,substr(HXFNM,1,40) File_name,FHTYP Type,HXERR Validity,

FHSCN
2 SCN, FHTNM
3 TABLESPACE_NAME,FHSTA status ,FHRBA_SEQ Sequence from X$KCVFH;

FILE_NUM FILE_NAME TYPE

VALIDITY
SCN TABLESPACE_NAME STATUS
SEQUENCE
---------------- ---------------------------------------- ----------------
----------------
---------------- ------------------------------ ----------------
----------------
1 <DATA_TOP>/system01.dbf 3
0
2371803541 SYSTEM 4
124273
2 <DATA_TOP>/system02.dbf 3
0
2371803541 SYSTEM 4
124273
 3 <DATA_TOP>/system03.dbf 3
0
2371803541 SYSTEM 4
124273
4 <DATA_TOP>/system04.dbf 3
0
2371803541 SYSTEM 4
124273
In this case the datafiles need to be recopied from the source again, making sure
the database was shutdown cleanly prior to the copy.
Section 9: Known issues
- Some files and symbolic links still contain references to the source system
$ORACLE_HOME/bin/qxmlctl
$ORACLE_HOME/bin/clscfg
$ORACLE_HOME/bin/clsfmt
$ORACLE_HOME/bin/dbca
$ORACLE_HOME/bin/dbua
$ORACLE_HOME/bin/dropjava
$ORACLE_HOME/bin/emagentdeploy.pl
$ORACLE_HOME/bin/emtgtctl
$ORACLE_HOME/bin/emutil
$ORACLE_HOME/bin/emca
$ORACLE_HOME/bin/emutil
$ORACLE_HOME/bin/netca
$ORACLE_HOME/lib32/ldflags
$ORACLE_HOME/lib/hsdb_inf.so -> <Source ORACLE_HOME>/lib32/hsdb_inf.so
$ORACLE_HOME/lib/hsdb_odbc.so -> <Source ORACLE_HOME>/lib32/hsdb_odbc.so
$ORACLE_HOME/lib/hsdb_oing.so -> <Source ORACLE_HOME>/lib32/hsdb_oing.so
$ORACLE_HOME/lib/hsdb_ora.so -> <Source ORACLE_HOME>/lib32/hsdb_ora.so
$ORACLE_HOME/lib/hsdb_syb.so -> <Source ORACLE_HOME>/lib32/hsdb_syb.so
Cause

This can be caused by a failure with the OUI native clone process. If an
ORACLE_HOME is already registered in the Global inventory, whether the purpose is
to refresh an existing Target instance, or the original instance was removed from
the file system (but not from the inventory), then OUI native cloning will assume
the instance is already registered and no further configuration is required. This
will result in an incomplete target system with files and links still referencing
the source instance. This can also occur for any failure of runInstaller during
cloning.

Any problems with ouicli.pl will be detailed in the log files :

<RDBMS $ORACLE_HOME>/appsutil/log/$CONTEXT_NAME/ohclone.log
$INST_TOP/admin/log/ohclone.log
<Global Inventory>/logs/cloneActions<timestamp>.log
<Global Inventory>/logs/oraInstall<timestamp>.log
<Global Inventory>/logs/silentInstall<timestamp>.log

The following extract from ohclone.log shows a typical example of this problem:-

SEVERE: OUI-10197:Unable to create a new Oracle Home at <ORACLE_HOME>.

Oracle Home already exists at this location. Select another location.
INFO: User Selected: Yes/OK

java.io.IOException: OUI-10197:Unable to create a new Oracle Home at

<ORACLE_HOME>. Oracle Home already exists at this location. Select another
location.
Possible solutions to this are to rerun the native OUI cloning :

Solution 1 :
Use this if the Global Inventory is shared amongst multiple instances :

- Run OUI and "De-install" the unwanted ORACLE_HOME

- Recopy the files from Source system
- Reconfigure the Target system using the "perl adcfgclone.pl" scripts.

Solution 2 :
Use this if the Global Inventory is local to this ORACLE_HOME, i.e oraInst.loc
"inventory_loc" points to :

inventory_loc=<RDBMS $ORACLE_HOME>/admin/oui/$CONTEXT_NAME/oraInventory
or (for the Applications Tier)

inventory_loc=<INST_TOP>/admin/oraInventory
Rename the global inventory :

cd RDBMS $ORACLE_HOME>/admin/oui/$CONTEXT_NAME
mv oraInventory oraInventory.bkp
or (for the Applications Tier)

cd <INST_TOP>/admin
mv oraInventory oraInventory.bkp
Create an empty directory and set permissions :

mkdir oraInventory
chmod 770 oraInventory
Rerun the ouicli.pl scripts to register the ORACLE_HOME (repeat for all RDBMS,
Tools and Web each if required) :

cd ORACLE_HOME/appsutil/clone/
./ouicli.pl

Check the log files as listed above

- Cloning fails at 50% with RC-00118 or RC-50004 after creating control files

The last connection test after the control files are created shows the following
error in ApplyDBTier_xxxxxx.log:

-------------------ADX Database Utility Finished---------------

RC-00118: Error occurred during creation of database

Raised by oracle.apps.ad.clone.ApplyDatabase

StackTrace:
java.lang.Exception: Control file creation failed
at oracle.apps.ad.clone.ApplyDatabase.doConf(ApplyDatabase.java:635)
at oracle.apps.ad.clone.ApplyDatabase.doApply(ApplyDatabase.java:473)
at oracle.apps.ad.clone.ApplyDatabase.<init>(ApplyDatabase.java:366)
at oracle.apps.ad.clone.ApplyDBTier.<init>(ApplyDBTier.java:110)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccesso
rImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructo
rAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:494)
at
oracle.apps.ad.clone.util.CloneProcessor.run(CloneProcessor.java:67)
at java.lang.Thread.run(Thread.java:595
Cause:

The listener.ora contains the source listener name

This was originally resolved in CloneContext.java (12.1 - 120.92.12010000.16) but

is present again in version: 120.92.12010000.24

This is reported in Bug :12598630 - R12 CLONING FAILS AT 50% DUE TO LISTENER.ORA
CONTAINING SOURCE NAME

Workaround:

The Workaround is to make the change on the temporary stage context file prior to
the file copy:

1. edit CTXORIG.xml either after adpreclone.pl or before adcfgclone.pl

2. change the s_db_listener value from Source to Target
3. copy files to target
4. run perl adcfgclone.pl dbTier

If the Clone has already failed, the workaround/solution would be:

1. Correct the s_db_listener value in the Target context file.

2. Ensure the target Database is down.
3. Run: perl adcfgclone.pl dbtier /path/to/contextfile.xml.

- adcfgclone.pl appsTier fails with "ERROR: OUI files not found at their expected
location"
This error was raised because Rapid Clone only prompted for base directory and
places the $APPL_TOP, $ORACLE_HOME and $IAS_ORACLE_HOME into an "apps" sub-
directory. If the "apps" sub-directory does not exist on the Target instance, this
error is raised.

This is detailed in Note 466937.1.

The fix is in CloneContext.java 120.54.12000000.22 and higher, which now now
prompts for the locations of the individual homes. It is delivered via Patch
6145693 and is listed in the pre-requisite section of Note 406982.1

- ouicli.pl fails with: "NON-COMPLIANT: <$ORACLE_HOME>/oraInst.loc does not point

to an inventory inside the current ORACLE_HOME" or or "Timed out( 3750000 ):
Interrupted Exception"
Beginning OUI CLI cloning for s_db_oh<Day> <Mon DD HH:MI:SS YYYY>
<RDBMS ORACLE_HOME>/appsutil/jre/bin/java
-classpath <RDBMS ORACLE_HOME>/appsutil/java:
<RDBMS ORACLE_HOME>/oui/jlib/OraInstaller.jar:
<RDBMS ORACLE_HOME>/appsutil/java/xmlparserv2.jar
oracle.apps.ad.clone.util.OracleHomeCloner
-OUICLI
-e <RDBMS ORACLE_HOME>/appsutil/<Context>.xml
-nolink -oaVar s_db_oh -homestub db
-log <RDBMS ORACLE_HOME>/appsutil/log/<Context>/ohclone.log
NON-COMPLIANT: <RDBMS ORACLE_HOME>/oraInst.loc does not point to an inventory
inside the current ORACLE_HOME
Rapid Clone only supports oraInst.loc at that location if its content points to an
inventory inside the same ORACLE_HOME
Please make the necessary changes to the following file:
<RDBMS ORACLE_HOME>/oraInst.loc
running OUI CLI home cloning:
<RDBMS ORACLE_HOME>/oui/bin/runInstaller
-clone -silent -force -nolink -waitForCompletion
-invPtrLoc <RDBMS ORACLE_HOME>admin/oui/<Context>/oraInst.loc
ORACLE_HOME=<RDBMS ORACLE_HOME>
ORACLE_HOME_NAME=<SID>_DB__apps1_<sid>_db_tech_st_<version>
-J-Doracle.installer.noLink=true
Finished OUI CLI cloning for s_db_oh with return code: 0<Day Mon DD HH:MI:SS YYYY>
or extract from:

$INST_TOP>/apps/$CONTEXT_NAME/admin/log/ApplyAppsTier_<timestamp>.log
script returned:
****************************************************
Timed out( 3750000 ): Interrupted Exception

Before cloning, you must have an oraInst.loc pointing to any directory location
where the user has access (ie: /u01/TEST/oraInventory). If not using <default
location>/oraInst.loc (if that file does not exist), then $OH/oraInst.loc will be
used instead. If that is the case, $OH/oraInst.loc must point to a location inside
that ORACLE_HOME.

This is explained in BUG 6374744 and Note 458653.1

- adrelink.sh fails after cloning due to missing PRODUCT_TOP library files

This appears to be HP-UX Itanium specific. After completing a clone all of the
library files for the different product tops are missing. The library files were
copied as part of the clone and exist in the <PROD>_TOP/lib but after adcfgclone
appsTier they disappear.

An extract from adrelink log may show:

Current product is AD
adrelink: Warning: not setting LADLIB
since <$APPL_TOP>/ad/12.0.0/lib/libad.a does not exist
or cannot be read
...
...
...
Current product is FND
adrelink: Warning: not setting LFNDLIB
since <$APPL_TOP>/fnd/12.0.0/lib/libfnd.a does not exist
or cannot be read.
This is detailed in Note:564721.1 and fixed via Patch 6679053

See Note:564721.1 for further details.

- RC-50004: Fatal: Error occurred in ApplyAppsTechStack:

- RC-50013: Fatal: Failed to instantiate driver <10.1.2
ORACLE_HOME>/appsutil/driver/regclone.drv
This was reported on HP-UX Itanium but may occur on other platforms. The oui used
to clone the 10.1.2 ORACLE_HOME hangs due to the opmn executable being executed as
part of the ORACLE_HOME clone. The opmn executable should exit with an error as the
opmn is not used in a 10.1.2 ORACLE_HOME but instead it keeps running until timout
exception is raised.

ERROR:

/ 3% completed
RC-50004: Fatal: Error occurred in ApplyAppsTechStack:
RC-50013: Fatal: Failed to instantiate driver <10.1.2
ORACLE_HOME>/appsutil/driver/regclone.drv

ERROR while running Apply...

<Date Time>

ERROR: Failed to execute /apps/oracle/apps/apps_st/comn/clone/bin/adclone.pl

From the $INST_TOP/admin/log/ApplyAppsTier_<DATE_TIME>.log

script returned:
****************************************************
Timed out( 3750000 ): Interrupted Exception

Beginning OUI CLI cloning for s_tools_oh <Date Time>

<10.1.3 ORACLE_HOME>/jdk/bin/java
-classpath <COMMON_TOP>/clone/jlib/java:
<10.1.2 ORACLE_HOME>/oui/jlib/OraInstaller.jar:
<COMMON_TOP>/clone/jlib/xmlparserv2.jar:
<COMMON_TOP>/clone/jlib/ojdbc14.jar
oracle.apps.ad.clone.util.OracleHomeCloner
-OUICLI -e <INST_TOP>/appl/admin/<CONTEXT_NAME>.xml
-nolink -oaVar s_tools_oh -homestub tools
-log <INST_TOP>/admin/log/ohclone.log

running OUI CLI home cloning:

<10.1.2 ORACLE_HOME>/oui/bin/runInstaller -debug -clone -silent -force -nolink -
waitForCompletion
-invPtrLoc /var/opt/oracle/oraInst.loc session:
ORACLE_HOME=/<10.1.2 ORACLE_HOME>
oracle.as.j2ee.top:
s_asInstanceName=<SID>_TOOLS__apps_oracle_apps_tech_st_10_1_2
oracle.as.j2ee.top:s_adminName=ias_admin oracle.as.j2ee.top:s_adminPassword=welcome
ORACLE_HOME_NAME=<SID>_TOOLS__apps_oracle_apps_tech_st_10_1_2
-J-Doracle.installer.noLink=true
****************************************************
Refer to Note 725995.1 for further information and the solution

- Application Tier clone fails with RC-50004 when Database Tier is in different
domain

When cloning the Applications Tier, if the Database is in a different domain,

adcfgclone.pl will fail with the error:
RC-50004: Fatal: Error occurred in ApplyAppsTier:

StackTrace -
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccesso
rImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructo
rAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:494)
at
oracle.apps.ad.clone.util.CloneProcessor.run(CloneProcessor.java:67)
at java.lang.Thread.run(Thread.java:595)
Caused by: java.lang.NoSuchMethodError:
oracle.apps.ad.autoconfig.InstantiateFile.writeReport(Ljava/util/Vector;Loracl
e/apps/ad/util/LogFile;I)V
at
oracle.apps.ad.clone.ApplyApplTop.checkAutoConfigErr(ApplyApplTop.java:590)
at
oracle.apps.ad.clone.ApplyApplTop.runAutoConfig(ApplyApplTop.java:558)
at oracle.apps.ad.clone.ApplyApplTop.doConf(ApplyApplTop.java:339)
at oracle.apps.ad.clone.ApplyApplTop.doApply(ApplyApplTop.java:382)
at oracle.apps.ad.clone.ApplyApplTop.<init>(ApplyApplTop.java:267)
at oracle.apps.ad.clone.ApplyAppsTier.<init>(ApplyAppsTier.java:105)
... 6 more

ERROR while running Apply...

Cause:

During the Clone Context stage, there is no prompt for the Database domain, causing
database connections errors during the AppsTier configuration:-

Provide the values required for creation of the new APPL_TOP Context file.

Target System Hostname (virtual or normal) [source-host] :

Target System Database SID : <ORACLE SID>

Target System Database Server Node [source-host] : <target-host>

Target System Base Directory : /oracle/<ORACLE_SID>

Workaround:

- Rerun "perl adcfgclone.pl appsTier" and enter the fully qualified hostname.domain
when prompted for the Target Database hostname:

Example:

Target System Database Server Node [source-host] : <target-host>

Fix:

This is currently being investigated by Development

- 11.1.0.6 Database Tier clone fails with adlnkoh.sh on 64bit machines
When attempting to clone 'perl adcfgclone.pl dbtier' fails on db tier, adlnkoh.sh
fails with the following error:

ERROR
Failed linking target libnmarl on <Time>...
<$ORACLE_HOME>/sysman/lib
cc -o <$ORACLE_HOME>/sysman/lib/emagent
-L<$ORACLE_HOME>/lib32/
-L<$ORACLE_HOME>/sysman/lib32/
-L<$ORACLE_HOME>/lib32/stubs/ `cat
<$ORACLE_HOME>/lib32/sysliblist` -lm `cat
<$ORACLE_HOME>/lib32/sysliblist` -lm -lpthread -lrt -lpthread -Wl,-E
+DD64 <$ORACLE_HOME>/sysman/lib32/s0nmem.o -lclntsh
-L<$ORACLE_HOME>/lib32
-L<$ORACLE_HOME>/sysman/lib32/ -lnmemso -lcore11
-L/app/oracle/EBSCRP2A/db/tech_st/11.1.0/jdk/jre/lib/IA64W/hotspot
-L/app/oracle/EBSCRP2A/db/tech_st/11.1.0/jdk/jre/lib/IA64W -ljava -ljvm -lverify
`cat
<$ORACLE_HOME>/lib32/sysliblist` -lm -lpthread -lrt -lpthread -lnsl -lm
`cat <$ORACLE_HOME>/lib32/sysliblist` `cat
<$ORACLE_HOME>/lib32/sysliblist` -lm -lpthread -lrt
cat: Cannot open <$ORACLE_HOME>/lib32/sysliblist: No such file or directory
cat: Cannot open <$ORACLE_HOME>/lib32/sysliblist: No such file or directory
cat: Cannot open <$ORACLE_HOME>/lib32/sysliblist: No such file or directory
cat: Cannot open <$ORACLE_HOME>/lib32/sysliblist: No such file or directory
cat: Cannot open <$ORACLE_HOME>/lib32/sysliblist: No such file or directory

(Bundled) cc: warning 1913: `<$ORACLE_HOME>/sysman/lib32/s0nmem.o' does

not exist or cannot be read
ld: Can't find library for -lclntsh
Fatal error
Cause
The problem is linked to Note:471476.1 32 Bit Libraries Are Not Installed With
Oracle11g (11.1.0.6)

For Rapid Clone, this was raised in Bug 7602049 and internal Bug:7035076

Solution
Apply Patch:7207440 TXK - 12.0.4 Consolidated Patch 1 to the Source instance and
redo the cloning steps.
This patch is already included in 12.0.6

- CloneContext.log shows "Hot Clone Mode Detected" in when not using "HotClone"
An extract from the log may show:

PROMPT :
Target System Archive Log Directory [<ORACLE_BASE>/db/apps_st/data/archive]
ANSWER :
<ORACLE_BASE>/db/apps_st/data/archive

Hot Clone Mode Detected

Creating <ORACLE_HOME>/dbs/<CONTEXT_NAME>_ifile.ora.
ifile <CONTEXT_NAME>_ifile.ora_ifile.ora succesfully created.
This was reported in Bug:8472117.
This information can be ignored. See Note:815447.1 for further details

REFERENCES
BUG:12598630 - R12.1 ONE-OFF FOR S_DB_LISTENER BUG 12362010
BUG:7602049 - 'PERL ADCFGCLONE.PL DBTIER' FAILS ON DB TIER ON HP UX ITANIUM FOR DB
11.1.0.6

-----------------------------------------------------------------------------------
------------------
ERROR: Failed to configure the target system – Failed to enable EBS_LOGON trigger

The clone procedure for EBS R12.2 is quite different when compared with EBS R12.1.
This post covers very generic issues we may encounter while configuring the target
server as a part of clone Process.

ERROR : 1

Checking the port pool 6

done: Port Pool 6 is free

Report file located at

/u01/appl_PROD/PROD/fs2/inst/apps/PRODERP_erpnode3/admin/out/portpool.lst

The new APPL_TOP context file has been created :

/u01/appl_PROD/PROD/fs2/inst/apps/PRODERP_erpnode3/appl/admin/PRODERP_erpnode3.xml

Check Clone Context logfile

/u01/appl_PROD/PROD/fs1/EBSapps/comn/clone/bin/CloneContextPatch_0811105848.log for
details.

FMW Pre-requisite check log file location :

/u01/appl_PROD/PROD/fs1/EBSapps/comn/clone/FMW/logs/prereqcheck.log

Running: FMW pre-req check…

ERROR: Run file system configuration has failed

Check the logfile

/u01/appl_PROD/PROD/fs1/inst/apps/PRODERP_erpnode3/admin/log/clone/run/
RCloneApplyAppstier_08111059.log

ERROR: Failed to configure the target system,

please check the logfile in :

/u01/appl_PROD/PROD/fs1/inst/apps/PRODERP_erpnode3/admin/log/clone

Enter the APPS password : Enter the APPS password : Error while executing
/u01/appl_PROD/PROD/fs1/EBSapps/comn/clone/bin/alter_ebs_logon_trigger.sql

Failed to enable EBS_LOGON trigger

When we check the logfile its mentioning FMW_Home already exists.

[root@erpnode3 run]# tail -100f

/u01/appl_PROD/PROD/fs1/inst/apps/PRODERP_erpnode3/admin/log/clone/run/
RCloneApplyAppstier_08111059.log

#############################################################

Started RCloneApplyAppstier at Thu Aug 11 10:59:37 AST 2016

Version:

RCloneApplyAppstier.java : 120.0.12020000.4

#############################################################

Found the directory : /u01/appl_PROD/PROD/fs1/FMW_Home

Exiting cloning as FMW Home already exists..

Solution:

We must remove the directory FMW_Home. If the directory is empty also we should
remove it, else rapidclone will exit out with status Error.

ERROR : 2

The error message is almost identical to the previous error in the clone
configuration output.

Report file located at

/u01/appl_PROD/PROD/fs2/inst/apps/PRODERP_erpnode3/admin/out/portpool.lst

The new APPL_TOP context file has been created :

/u01/appl_PROD/PROD/fs2/inst/apps/PRODERP_erpnode3/appl/admin/PRODERP_erpnode3.xml

Check Clone Context logfile

/u01/appl_PROD/PROD/fs1/EBSapps/comn/clone/bin/CloneContextPatch_0811110821.log for
details.

FMW Pre-requisite check log file location :

/u01/appl_PROD/PROD/fs1/EBSapps/comn/clone/FMW/logs/prereqcheck.log

Running: FMW pre-req check…

Configuring: Run file system….

LogFile located at
/u01/appl_PROD/PROD/fs1/inst/apps/PRODERP_erpnode3/admin/log/clone/run/
RCloneApplyAppstier_08111108.log

ERROR: Failed to configure the target system,

please check the logfile in :

/u01/appl_PROD/PROD/fs1/inst/apps/PRODERP_erpnode3/admin/log/clone

Error while executing

/u01/appl_PROD/PROD/fs1/EBSapps/comn/clone/bin/alter_ebs_logon_trigger.sql

Failed to enable EBS_LOGON trigger

[applerp@erpnode3 bin]$

But this time the message in error log is different:

[root@erpnode3 inst]# more

/u01/appl_PROD/PROD/fs1/inst/apps/PRODERP_erpnode3/admin/log/clone/run/
RCloneApplyAppstier_08111108.log

#############################################################

Started RCloneApplyAppstier at Thu Aug 11 11:08:36 AST 2016

Version:

RCloneApplyAppstier.java : 120.0.12020000.4

#############################################################

START: Calling ApplyAppsTier…

START: Creating the FMW Home from ApplyAppsTier

FMW JDK version in use: 1.7.0_85

START: Creating FMW Home.

Running /u01/appl_PROD/PROD/fs1/EBSapps/comn/clone/FMW/pasteBinary.sh -javaHome

/u01/appl_PROD/PROD/fs1/EBSapps/comn/util/jdk64 -al
/u01/appl_PROD/PROD/fs1/EBSapps/comn/clone/FMW/FMW_Home.jar -tl /

u01/appl_PROD/PROD/fs1/FMW_Home -invPtrLoc /etc/oraInst.loc -ldl

/u01/appl_PROD/PROD/fs1/inst/apps/PRODERP_erpnode3/admin/log/clone/run/fmwT2PApply
-silent true -debug true -executeSysPrereqs false

Script Executed in 7558 milliseconds, returning status 255

ERROR: Script failed, exit code 255

[root@erpnode3 inst]#

Solution:

usually we will recieve this error when there are no proper privileges granted on
oraInventory (or) the oraInventory is not empty. To avoid this issue we should
verify “oraInventory” directory has appropriate privileges and its empty.

[root@erpnode3 u01]# mkdir -p /u01/ora_prod/oraInventory

[root@erpnode3 u01]# chmod -R 755 /u01/ora_prod/oraInventory

[root@erpnode3 u01]# chown -R applerp:dbaerp /u01/ora_prod/oraInventory

[root@erpnode3 u01]# cat /etc/oraInst.loc

inventory_loc=/u01/ora_prod/oraInventory

inst_group=dba

[root@erpnode3 u01]#
During the R12.2 cloning process adcfgclone fails with below error message:

ERROR : 3

Below Oracle Homes are already registered in the global inventory:

/u01/oracle/R122/fs1/FMW_Home/oracle_common

/u01/oracle/R122/fs1/FMW_Home/webtier

/u01/oracle/R122/fs1/FMW_Home/Oracle_EBS-app1

Solution:

Make sure that the above Oracle Homes are unregistered from the global inventory.
we should always clean the oraInventory directory by using the following commands.

cd $ORACLE_HOME/oui/bin (/u01/oracle/R122/fs1/EBSapps/10.1.2/oui/bin)

./runInstaller -silent -deinstall

REMOVE_HOMES={“/u01/oracle/R122/fs1/FMW_Home/Oracle_EBS-app1”}

./runInstaller -silent -deinstall

REMOVE_HOMES={“/u01/oracle/R122/fs1/FMW_Home/oracle_common”}

./runInstaller -silent -deinstall

REMOVE_HOMES={“/u01/oracle/R122/fs1/FMW_Home/webtier”}

Then restart the adcfgclone.pl appsTier

https://www.toadworld.com/platforms/oracle/b/weblog/archive/2016/08/11/rror-failed-
to-configure-the-target-system-failed-to-enable-ebs-logon-trigger