Data Pump ORA-39001 ORA-39000 ORA-31640 in Oracle 12c R2 RAC Database

Connected to: Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production
ORA-39001: invalid argument value
ORA-39000: bad dump file specification
ORA-31640: unable to open dump file "/export/home/oracle/stfacmas.dmp" for read
ORA-27037: unable to obtain file status
SVR4 Error: 2: No such file or directory
Additional information: 7

Problem:

-bash-4.4$ impdp said/passwd@orcl full=y directory=STLBAS_DIR dumpfile=stfacmas.dmp logfile=stlbas_tab_261219.log

Import: Release 12.2.0.1.0 - Production on Sat Apr 11 20:53:16 2020

Copyright (c) 1982, 2017, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production
ORA-39001: invalid argument value
ORA-39000: bad dump file specification
ORA-31640: unable to open dump file "/export/home/oracle/stfacmas.dmp" for read
ORA-27037: unable to obtain file status
SVR4 Error: 2: No such file or directory
Additional information: 7


Solution:

Actually we are trying to import data into Oracle 12c R2 2 nodes RAC Database. After that we just shutdown one instance and try to execute the following command and its working fine!!!!!!!!!!

Login into 2nd  Node:

-bash-4.4$ sqlplus

SQL*Plus: Release 12.2.0.1.0 Production on Sun Apr 12 06:41:57 2020

Copyright (c) 1982, 2016, Oracle.  All rights reserved.

Enter user-name: /as sysdba

Connected to:
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production

SQL> shutdown immediate
Database closed.
Database dismounted.
ORACLE instance shut down.
SQL>


Login into 1st Node:

-bash-4.4$ impdp system/passwd@orcl full=y directory=STLBAS_DIR dumpfile=stlbas_100420.dmp  logfile=imp.log

Import: Release 12.2.0.1.0 - Production on Sat Apr 11 07:38:30 2020

Copyright (c) 1982, 2017, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production
Master table "SYSTEM"."SYS_IMPORT_FULL_01" successfully loaded/unloaded
Starting "SYSTEM"."SYS_IMPORT_FULL_01":  system/********@stlbas full=y directory=STLBAS_DIR dumpfile=stlbas_100420.dmp logfile=imp.log
Processing object type SCHEMA_EXPORT/USER

Resize lvm (Logical Volume) in Linux

[root@ncbsdb admin]# df -h
Filesystem           Size  Used Avail Use% Mounted on
devtmpfs             252G     0  252G   0% /dev
tmpfs                252G     0  252G   0% /dev/shm
tmpfs                252G   13M  252G   1% /run
tmpfs                252G     0  252G   0% /sys/fs/cgroup
/dev/mapper/ol-root  200G  5.0G  195G   3% /
/dev/sda2           1014M  222M  793M  22% /boot
/dev/mapper/ol-tmp    50G   42M   50G   1% /tmp
/dev/mapper/ol-var    50G  2.6G   48G   6% /var
/dev/mapper/ol-d01   688G  5.3G  683G   1% /d01
tmpfs                 51G   12K   51G   1% /run/user/42
tmpfs                 51G     0   51G   0% /run/user/54321
tmpfs                 51G     0   51G   0% /run/user/0
/dev/mapper/u01-u01  500G  5.3G  495G   2% /u01
/dev/mapper/u07-u07   99G   33M   99G   1% /u07
/dev/mapper/u02-u02  1.3T   34M  1.3T   1% /u02
/dev/mapper/u04-u04  500G   33M  500G   1% /u04
/dev/mapper/u05-u05  600G   34M  600G   1% /u05
/dev/mapper/u06-u06  400G   33M  400G   1% /u06
/dev/mapper/u09-u09  200G   33M  200G   1% /u09
/dev/mapper/u03-u03  484G   33M  484G   1% /u03

Here we want to resize the mount point /u03 from 484 GB to 499 GB

[root@ncbsdb admin]# pvs
  PV                  VG  Fmt  Attr PSize   PFree
  /dev/mapper/mpatha1 u02 lvm2 a--   <1 .30t="" g="" nbsp="" p="">  /dev/mapper/mpathe1 u01 lvm2 a--  499.98g       0
  /dev/mapper/mpathf1 u03 lvm2 a--  499.98g   15.98g
  /dev/mapper/mpathh1 u07 lvm2 a--   99.98g 1008.00m
  /dev/sda3           ol  lvm2 a--    1.09t    4.00m

Here we can see that the physical volume showing still 15.98 GB available

Now we will resize 

[root@ncbsdb admin]#lvresize -L+15G /dev/u03/u03

Now check the size of mount point /u03 but still showing 484 GB

[root@ncbsdb admin]# df -h
Filesystem           Size  Used Avail Use% Mounted on
devtmpfs             252G     0  252G   0% /dev
tmpfs                252G     0  252G   0% /dev/shm
tmpfs                252G   13M  252G   1% /run
tmpfs                252G     0  252G   0% /sys/fs/cgroup
/dev/mapper/ol-root  200G  5.0G  195G   3% /
/dev/sda2           1014M  222M  793M  22% /boot
/dev/mapper/ol-tmp    50G   42M   50G   1% /tmp
/dev/mapper/ol-var    50G  2.6G   48G   6% /var
/dev/mapper/ol-d01   688G  5.3G  683G   1% /d01
tmpfs                 51G   12K   51G   1% /run/user/42
tmpfs                 51G     0   51G   0% /run/user/54321
tmpfs                 51G     0   51G   0% /run/user/0
/dev/mapper/u01-u01  500G  5.3G  495G   2% /u01
/dev/mapper/u07-u07   99G   33M   99G   1% /u07
/dev/mapper/u02-u02  1.3T   34M  1.3T   1% /u02
/dev/mapper/u04-u04  500G   33M  500G   1% /u04
/dev/mapper/u05-u05  600G   34M  600G   1% /u05
/dev/mapper/u06-u06  400G   33M  400G   1% /u06
/dev/mapper/u09-u09  200G   33M  200G   1% /u09
/dev/mapper/u03-u03  484G   33M  484G   1% /u03

Now execute the command fsadm --- utility to resize or check filesystem on a device

[root@ncbsdb admin]# fsadm resize /dev/mapper/u03-u03
meta-data=/dev/mapper/u03-u03    isize=256    agcount=16, agsize=7929856 blks
         =                       sectsz=4096  attr=2, projid32bit=1
         =                       crc=0        finobt=0 spinodes=0
data     =                       bsize=4096   blocks=126877696, imaxpct=25
         =                       sunit=128    swidth=128 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal               bsize=4096   blocks=61952, version=2
         =                       sectsz=4096  sunit=1 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0
data blocks changed from 126877696 to 130809856
[root@ncbsdb admin]#

Mount the /u03 mount point

[root@ncbsdb admin]# mount /dev/mapper/u03-u03 /u03
[root@ncbsdb admin]# df -h
Filesystem           Size  Used Avail Use% Mounted on
devtmpfs             252G     0  252G   0% /dev
tmpfs                252G     0  252G   0% /dev/shm
tmpfs                252G   13M  252G   1% /run
tmpfs                252G     0  252G   0% /sys/fs/cgroup
/dev/mapper/ol-root  200G  5.0G  195G   3% /
/dev/sda2           1014M  222M  793M  22% /boot
/dev/mapper/ol-tmp    50G   42M   50G   1% /tmp
/dev/mapper/ol-var    50G  2.6G   48G   6% /var
/dev/mapper/ol-d01   688G  5.3G  683G   1% /d01
tmpfs                 51G   12K   51G   1% /run/user/42
tmpfs                 51G     0   51G   0% /run/user/54321
tmpfs                 51G     0   51G   0% /run/user/0
/dev/mapper/u01-u01  500G  5.3G  495G   2% /u01
/dev/mapper/u07-u07   99G   33M   99G   1% /u07
/dev/mapper/u02-u02  1.3T   34M  1.3T   1% /u02
/dev/mapper/u04-u04  500G   33M  500G   1% /u04
/dev/mapper/u05-u05  600G   34M  600G   1% /u05
/dev/mapper/u06-u06  400G   33M  400G   1% /u06
/dev/mapper/u09-u09  200G   33M  200G   1% /u09
/dev/mapper/u03-u03  499G   33M  499G   1% /u03
[root@ncbsdb admin]#

Error message: JPS-01050: Opening of wallet based credential store failed PKI-02002: Unable to open the wallet. Check password.

Error:

[oracle@bach2-app bin]$ ./startWebLogic.sh
.
.
JAVA Memory arguments: -Xms256m -Xmx512m  -XX:MaxPermSize=512m
.
WLS Start Mode=Production
.
CLASSPATH=/u01/oracle/middleware/o
.
.
.
.
.
.

Enter username to boot WebLogic server:weblogic
Enter password to boot WebLogic server:



Jan 27, 2020 6:03:40 PM oracle.security.jps.internal.credstore.ssp.CsfWalletManager openWallet
WARNING: Opening of wallet based credential store failed. Reason java.io.IOException: PKI-02002: Unable to open the wallet. Check password.
Error message: JPS-01050: Opening of wallet based credential store failed. Reason java.io.IOException: PKI-02002: Unable to open the wallet. Check password. >

.
.
.
.
.
Caused By: oracle.security.jps.service.credstore.CredStoreException: JPS-01050: Opening of wallet based credential store failed. Reason java.io.IOException: PKI-02002: Unable to open the wallet. Check password.
        at oracle.security.jps.internal.credstore.ssp.CsfWalletManager.openWallet(CsfWalletManager.java:184)
        at oracle.security.jps.internal.credstore.ssp.SspCredentialStore.doInit(SspCredentialStore.java:238)
        at oracle.security.jps.internal.credstore.ssp.SspCredentialStore.(SspCredentialStore.java:153)
        at oracle.security.jps.internal.credstore.ssp.SspCredentialStore.(SspCredentialStore.java:138)
        at oracle.security.jps.internal.credstore.ssp.SspCredentialStoreProvider.getInstance(SspCredentialStoreProvider.java:115)
        Truncated. see log file for complete stacktrace
>




Reason:

The cause for this particular scenario was that the permissions to the /tmp directory was blocked for the weblogic runtime user. Therefore the user was not able to open the cwallet in the /tmp directory.

Solution:

Provide permissions to /tmp directory.



[root@bach2-app ~]# chmod -R 777 /tmp/

Also check that you are able to open the wallet without being prompted for a wallet password using the command below:


[oracle@bach2-app ~]$ /u01/oracle/middleware/oracle_common/bin/orapki wallet display -wallet /u01/oracle/middleware/user_projects/domains/ClassicDomain/config/fmwconfig/bootstrap
Oracle PKI Tool : Version 11.1.1.6.0
Copyright (c) 2004, 2011, Oracle and/or its affiliates. All rights reserved.

Requested Certificates:
User Certificates:
Oracle Secret Store entries:
fks@#3#@current.key
fks@#3#@master.key.0
IntegrityChecker@#3#@kss
Trusted Certificates:
Subject:        OU=Class 2 Public Primary Certification Authority,O=VeriSign\, Inc.,C=US
Subject:        OU=Class 3 Public Primary Certification Authority,O=VeriSign\, Inc.,C=US
Subject:        CN=GTE CyberTrust Global Root,OU=GTE CyberTrust Solutions\, Inc.,O=GTE Corporation,C=US
Subject:        OU=Class 1 Public Primary Certification Authority,O=VeriSign\, Inc.,C=US
[oracle@bach2-app ~]$
[oracle@bach2-app ~]$
[oracle@bach2-app ~]$
[oracle@bach2-app ~]$

Now Start the service

[oracle@bach2-app bin]$ ./startWebLogic.sh

.

.

JAVA Memory arguments: -Xms256m -Xmx512m  -XX:MaxPermSize=512m

.

WLS Start Mode=Production

.

CLASSPATH=/u01/oracle/middleware/oracle_common/modules/oracle.jdbc_11.1.1/ojdbc6dms.jar:/u01/oracle/middleware/patch_wls1036/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/u01/oracle/middleware/patch_ocp371/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/usr/java/jdk1.7.0_10/lib/tools.jar:/u01/oracle/middleware/wlserver_10.3/server/lib/weblogic_sp.jar:/u01/oracle/middleware/wlserver_10.3/server/lib/weblogic.jar:/u01/oracle/middleware/modules/features/weblogic.server.modules_10.3.6.0.jar:/u01/oracle/middleware/wlserver_10.3/server/lib/webservices.jar:/u01/oracle/middleware/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/u01/oracle/middleware/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/u01/oracle/middlewa

.

.

.

.

.

.

Enter username to boot WebLogic server:weblogic

Enter password to boot WebLogic server:

Jan 27, 2020 6:08:46 PM oracle.ods.virtualization.engine.util.VDELogger info

INFO: Notification sent for Mapping config object reloaded

Jan 27, 2020 6:08:46 PM oracle.ods.virtualization.engine.util.VDELogger info

INFO: ConfigObjectReloaded for ServerConfig. PreviousVersion : -1 : CurrentVersion : 0

.

.

.

.

.

.

:1>

..........have fun!!!!!!!!!!!!!!!