Weekends sometimes offer time for some leisurely R&D (especially with the current lock-down / mask rules). I posted previously about some issues I noticed in the Linux edition of Oracle EPM / Hyperion 11.2.2.0. Well, this weekend I finished standing up the Windows edition. Here are some key configuration errors/issues I spotted.
FDM Enterprise Edition (FDMEE)
You'll find a 3-part post concerning 11.2.2.0 FDMEE errors in Linux. In the Windows edition, I encountered none of those issues. The ODI tables built successfully, and FDMEE in Workspace, ODI Web Studio and ODI Agent were all functional.
Suggestion for Linux users:
Install the 11.2.2.0 Windows edition (you don't need to configure) and zip up \Oracle\Middleware\odi, ftp it over to your Linux server, and unzip it with the Replace option in /Oracle/Middleware/odi
Also copy aif.ear from Windows to Linux.
Then re-try your Configure Database and Deploy for FDMEE.
Planning RMI
Edit: An earlier version of this post had an incorrect link to the Planning RMI fix. This is now corrected.
This starts up just fine in Linux and successfully binds to port 11333. In Windows, we still have the issue I wrote about for 11.2.0.0 and 11.2.1.0. You'll find the solution to fixing the Windows Registry for Planning RMI here on my blog.
Analytic Provider Services
In Windows, it deploys just fine. In Linux, it gets a deployment error.
Suggested solution for Linux users:
Install the Windows edition of EPM 11.2.2.0 (you don't need to deploy). Copy aps.ear from Windows to Linux, and then redeploy in Linux.
Your link to 'fixing the Windows Registry for Planning RMI' does not seem to go there. Instead its linking to 'http://www.epmonprem.pro/2020/08/fdmee-11220-multiple-problems-buggy.html' . Just thought you should know.
ReplyDeleteThanks for the heads up, Todd! I'll get the link fixed after I get out of this meeting.
DeleteHello Dave, We have recently installed epm 11.2.2.0 version on distributed env. everything went fine during installation and running RCU also fine . But while deploying foundation received below error message :
ReplyDelete[2020-09-07T16:50:54.515+02:00] [EPMINS] [TRACE] [EPMINS-00001] [oracle.EPMINS] [tid: 1] [ecid: 70b37511-8b1e-4eca-9798-5e471eb12505-00000006,0] [SRC_CLASS: com.hyperion.install.util.MappingTreeHelper] trace: Getting resource: mappingTree.xml
[2020-09-07T16:50:54.671+02:00] [EPMCFG] [TRACE] [EPMCFG-05922] [oracle.EPMCFG] [tid: 1] [ecid: 70b37511-8b1e-4eca-9798-5e471eb12505-00000006,0] [SRC_CLASS: com.hyperion.install.sw.SoftwareRegistry] Adding Hyperion Home entry...
[2020-09-07T16:50:57.000+02:00] [EPMCFG] [TRACE] [EPMCFG-01001] [oracle.EPMCFG] [tid: 1] [ecid: 70b37511-8b1e-4eca-9798-5e471eb12505-00000006,0] [SRC_CLASS: com.oracle.preconfig.util.EpmLoggerPreConfigReporter] trace: Running preconfig checks...[[
Running EPM_ORACLE_HOME...
EPM_ORACLE_HOME environment variable value: D:\Oracle\Middleware\EPMSystem11R1
JAVA_HOME environment variable value: D:\Oracle\Middleware\EPMSystem11R1\..\jdk1.8.0_181
EPM_ORACLE_HOME succeeded
Running .oracle.products ... .oracle.products succeeded
Running Jars manifest ...
Time spent for manifests parsing: 250 ms
Maximum jars depth achieved: 7, while restriction was: unrestricted
Parsed 936 manifests
Total jars and classpath entries encountered: 936
Total not-existing referenced classpath entries count: 105
Enumerating not-existing classpath entries:
Missing (depth 4) file D:\Oracle\Middleware\oracle_common\modules\org.dom4j.jar referenced from D:\Oracle\Middleware\oracle_common\modules\oracle.iau\fmw_audit.jar referenced from D:\Oracle\Middleware\EPMSystem11R1\common\jlib\11.1.2.0\epm_jrf.jar referenced from D:\Oracle\Middleware\EPMSystem11R1\common\jlib\11.1.2.0\epm_j2se.jar referenced from D:\Oracle\Middleware\EPMSystem11R1\common\config\11.1.2.0\configtool.jar
Any idea ? We have observed all necessary permissions everything fine. Using SQL and while running RCU able to create tables and users also..but strange thing observed WLST_debug log observed 2020-09-14 16:56:11,992 WARNING [1] com.oracle.cie.domain.jdbc.WlsDBHelper - Invalid section
com.oracle.cie.domain.ValidateException: 40318: Invalid or missing JDBC datasource connection parameters.
40318: The JDBC datasource required parameters are invalid or missing.
40318: Correct the datasource connection parameters.
64205: The Password must be specified.
64205: Specify the property.
OPSS Audit Viewer Schema: 64207: Mismatched passwords.
64207: The Password and Confirm Password do not match.
We used RCU prefix: hss but in logs its still taking DEV :(
Regards,
Dinesh
Same with me too. Were you able to fix this Dinesh ?
DeleteWe have raised SR with oracle but still there is no proper solution and informing us to keep run RCU only :(
ReplyDelete2020-09-14 16:56:16,648 SEVERE [19] com.oracle.cie.domain.progress.AbstractProgressGenerator - Error occurred in phase {OPSS Processing} execution.
java.lang.IllegalStateException: SecurityContext:
Domain Name: EPMSystem
JDBC URL: opss-audit-DBDS:jdbc:oracle:thin:@//dbhost.example.com:1521/orcl
JDBC URL: opss-data-source:jdbc:oracle:thin:@//dbhost.example.com:1521/orcl
JNDI Name: opss-audit-DBDS:jdbc/AuditAppendDataSource
JNDI Name: opss-data-source:jdbc/OpssDataSource
Driver Name: opss-audit-DBDS:oracle.jdbc.OracleDriver
Driver Name: opss-data-source:oracle.jdbc.OracleDriver
Persistence Type: DATABASE
Platform: WLS
Scratch Dir: scratch
Reconfig Domain: false
Shared Secret Store: null
Extension: true
DisableManagementOperations: falseJDBC Properties:
user:DEV_IAU_APPEND
username:DEV_IAU_APPENDJDBC Properties:
user:DEV_OPSS
username:DEV_OPSS
at com.oracle.cie.domain.progress.template.importer.ImporterOPSSProcessingPhase.initialize(ImporterOPSSProcessingPhase.java:40)
at com.oracle.cie.domain.progress.domain.generation.OPSSProcessingPhase.processOPSS(OPSSProcessingPhase.java:154)
at com.oracle.cie.domain.progress.domain.generation.OPSSProcessingPhase.execute(OPSSProcessingPhase.java:54)
at com.oracle.cie.domain.progress.AbstractProgressGenerator.run(AbstractProgressGenerator.java:94)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.oracle.cie.domain.security.external.ConfigSecurityException: oracle.security.opss.tools.lifecycle.LifecycleException: JDBC password for opss-audit-DBDS is missing for configuring security store to database.
at oracle.security.opss.tools.lifecycle.cie.OpssSecurityConfiguration.initializeSubsystem(OpssSecurityConfiguration.java:191)
at com.oracle.cie.domain.progress.template.importer.ImporterOPSSProcessingPhase.initialize(ImporterOPSSProcessingPhase.java:36)
... 4 more
Hi Dinesh, regrets for the late reply. Two back-to-back 12-hour days! A couple of thoughts for you.
DeleteI've done each 11.2 now from 11.2.0.0 through 11.2.2.0, and from time to time have hit deployment issues as I destroy one sandbox and try a different method in a new one. Here are my observations concerning your situation.
1. In a distributed environment, choose a unique RCU prefix for each EPM instance / server. So for example, HSS1 for your first Foundation server, PLN1 for your first Planning server, and so on. Remember to edit that RCU properties file on each server accordingly.
2. If you run into trouble when deploying AdminServer plus FoundationServer0, and you're getting complaints about opss or some other datasource, it often means an RCU problem. This may sound extreme, but the following works for me every time (usually when I got distracted by a phone call and did something out of sequence):
- Blow away the user_projects folder - yes, the instance and the domain. You can keep Middleware, EPMSystem11R1 and everything else.
- Blow away the HSS and RCU schemas
- Start RCU over again from scratch
- Carefully edit the RCU properties file. Your log snippet shows a vanilla "dbhost.example.com" with a sid named "orcl", so you missed something.
- Make a new empty HSS schema/database.
- Run configtool and run the first 3 items only: configure common settings, configure database, and deploy to application server. You'll come back and do everything else later.
- Start Foundation and check the log.
- If it comes up, config/deploy everything else on your first server, except for Configure Erb Server (OHS).
- Start everything and check the logs that they start OK
If all looks good, you start AdminServer and move on to the next server, running RCU fresh there with a unique prefix, editing the properties file, and then deploying what needs to run there. Wash, rinse and repeat for the other servers. Then finally you return to where you want OHS to run and you configure that.
Good luck!
ps; the EnableLUA registry key's default setting WILL trip you up if you don't fix it and reboot. I'm sure I've posted about it before, or you can google that word.
Forgive typos. Long day and I tapped this on my tablet. "Configure WEB Server" is what I meant concerning OHS.
DeleteHello Dave,
ReplyDeleteFirst of all thanks a lot for taking your time and replying to my question :) I would like to inform we are using SQL 2016 server while running RCU it's able to connect database and create required tables, users etc without any issues.
We followed same suggestions as you mentioned above from past few days dropping HSS and RCU databases, uninstalling EPM and reinstalling again with new database configurations.
Also we have used different prefix for each server while running RCU. Strange thing while running RCU its able to connect database create required tables and users but while running configuration RCUschema properties file encrypted but in logs it's showing only default prefix and Oracle database connection string values only.
dbURL=jdbc:weblogic:sqlserver://host1.insim.biz:48000;databasename=RCU
I am really out of my options checked all necessary prerequisites like UAC, Anti virus, Paging etc everything looks good .
Do you have any other suggestions? anything else need to check at my end ?
Sorry to trouble you.
Regards,
Dinesh
Hi Dinesh, I'm also using SQL Server 2016. I'll post my complete rcuschema.properties file in the morning... after coffee, of course! For SQL Server, you still want 2 different userids in that file. In MSSQL's case, one of them is literally "sa" and the other is whomever the dbowner is of your RCU database. Remember the SQL Server needs to be in Mixed Authentication mode for this to work.
DeleteHello Dave, thanks for response. Yes am using 2 different accounts , one for sysadmin and one of db_owner permissions account. I have checked it's in mixed authentication mode only. Do you think installation account need to have permissions on SQL server 2016 of RCU and FND databases ? SQL server installed in diferent server , as clearly observed once finished RCU tool , it's able to create tables on RCU database and users on server with same prefix we used during RCU. somehow WLst log unable to read the schema properties file , as it's still using default prefix and giving false errors jdbc connection.
ReplyDeleteMy properties file (redacted stuff is ****)
DeletesysDBAPassword=****
schemaPrefix=FND
rcuSchemaPassword=****
dbURL=jdbc\:weblogic\:sqlserver\://REDFIVE\:1433;databaseName\=EPMRCU
sysDBAUser=sa
Dinesh, you might be describing a filesystem permission problem. I hit this on a few of the sandboxes I spun up. Try this: Go to your Hyperion drive and right-click on Oracle. Do Properties->Security->Advanced. Look at who it says the Owner is. If it is "System" rather than "Administrators" (or your EPM service account), this may be contributing to your problem. Do the same check on the root of the Hyperion drive itself.
What I hit a few times is the Owner was wrong and certain files became read-only to my EPM service account. So the config tool couldn't encrypt the passwords in the properties file, and other mischief happened. I had to change the filesystem Owner and let the change ripple down to all subdirectories and files.
This is the registry key I mentioned earlier. It overrules whatever you have UAC set to in the Control Panel.
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\policies\system]
"EnableLUA"=dword:00000000
If it is a 1, change it to 0 and reboot.
Hello Dave, thanks once again for detailed explanation. Just now finished calls with Oracle support team as we have raised to severity 1 and they have observed closely rcuschema properties file encrypted after config.tool but when we are deploying foundation server it's somehow not reading properties file and giving same jdbc missing mismatch pwd and user erros...
ReplyDeleteIn Webex session have dropped all db's and recreated fresh fnd and rcu databases also.after Run Rcu tool it's able to create tables ,users and later same way updated rcuschema properties file in same order you mentioned with rcusysadmin account. When we ran config.tool it's able to encrypt file but deployment failing with jdbc string issues.
Oracle support team is planning to raise bug with internally with their dev team. Could you please let me know are you using any specific SQL version 2016 patch xxxx ? In SQL server 2016 windows team installed SQL native client 2012..when I did telnet on server able to connect SQL server without any issues .
Really no idea what's exactly going on my systems :( :(
Hi Dinesh, at this point you are probably best served by that Sev 1 Oracle SR, as your environment sounds unique in some fashion.
DeleteIn answer to your question, the current iteration of my lab is running SQL Server Developer Edition 2016 Service Pack 2 - SQL Management Console reports the server's version number is 13.0.5820.21.
The client the DBAs installed on the SQL server isn't relevant to your environment, as EPM comes with its own client (the WebLogic SQL Server driver) and the fact you can run RCU proves the DBAs setup the firewall and TCP/IP connection rules properly.
I'm suspecting a filesystem permission issue on your Foundation server somewhere.
Lastly, make sure Windows Defender isn't causing mischief on your EPM servers. If you don't have your own anti-virus installed, Windows Defender kicks in and a recent Microsoft update makes it impossible to shut off entirely. So go through all of the Windows Defender options in your Windows Control Panel and make sure you have exceptions added to D:\Oracle or wherever your Hyperion stuff lives. One possibility is Windows Defender is blocking a config activity and when this happens you won't get a pop-up prompt... it just silently gets blocked behind the scenes. Windows Defender nowadays is much more strict than when we did 11.1.2.x installs on older versions of MS Windows Server.
Hello Dave, thanks for detailed explanation.we finally figured out today when creating database following some company standards and using one default user as owner which is in disable mode till now.But today morning we have requested dba to provide us sysadmin and created database with simple and owner is sysadmin that's it.after running regular steps with config tool finally it's got deployed :) really great to see successfull screen :) thanks a lot for your great support and explanations. Our suspect if we not create RCU database without sysadmin and that sysadmin account should be enable mode .
ReplyDeleteDo you think our suspect correct ?