![\"\"](\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/12\/oracle-logo.png\"){kind=logo}
<\/a>In this post we will learn how to access data from Oracle UCM Web Service<\/a> (Middle layer for WebLogic) and load into SQL Server or any other target. We will use SSIS XML Source<\/a> to achieve this result.<\/p>\n<\/p>\n
<\/p>\n
Prerequisites<\/span><\/h2>\r\nBefore we perform the steps listed in this article, you will need to make sure the following prerequisites are met:\r\n\r\n \t- SSIS<\/abbr> designer installed.\u00a0Sometimes it is referred to as BIDS<\/abbr> or SSDT<\/abbr> (download it from the Microsoft site<\/a>).<\/li>\r\n \t
- Basic knowledge of SSIS package\u00a0development using\u00a0Microsoft SQL Server Integration Services<\/em>.<\/li>\r\n \t
- Make sure\u00a0ZappySys SSIS PowerPack<\/a><\/span>\u00a0is installed (download it<\/a>, if you haven't already).<\/li>\r\n \t
- (Optional step<\/em>).<\/em>\u00a0Read this article<\/a>, if you are planning to deploy packages to a server and schedule their execution later.<\/li>\r\n<\/ol><\/div>\n
About Oracle UCM Web Service<\/h2>\n
If you are not sure what is SOAP Web Service and how to call in SSIS, First read this article<\/a> to understand general concepts of calling SOAP API in SSIS.<\/p>\nUCM Web Service offers calling various commands<\/a>. You have to send XML Request and server will send you XML response with requested data. We will use Array Transformation Technique (Key \/ Value Pattern)<\/a> to extract complex nested XML data.<\/p>\nStep-By-Step<\/h2>\n
Now let’s look at how to call Oracle UCM SOAP API in SSIS.<\/p>\n
Read from Oracle UCM Web Service using XML Source<\/h3>\n\n- Drag Data Flow Task in SSIS Designer<\/li>\n
- Inside Data flow drag ZS SSIS XML Source<\/a> from toolbox<\/li>\n
- First enter URL as below (Replace INSTANCE ID with your own instance)\n
https:\/\/YOUR-INSTANCE-ID.oraclecloud.com\/idcws\/GenericSoapPort<\/pre>\n<\/li>\n
- Now Check Use Credentials and select new ZS-HTTP connection<\/li>\n
- Enter your User ID and Password to call Web Service using Basic Authentication. Click OK to save.\n
![\"Configure](\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/12\/ssis-oracle-ucm-web-api-connection-settings.png\")
<\/a>Configure HTTP Connection – Call Oracle UCM Web Service (SOAP XML)<\/p><\/div><\/li>\n
- On XML Source UI Select Content Type = XML (text \/ xml, charset=UTF-8)<\/li>\n
- Select Request Method as POST<\/strong><\/li>\n
- Click Enter Raw Edit for HTTP Headers and enter below\n
SOAPAction: \"urn:GenericSoap\/GenericSoapOperation\"<\/pre>\n<\/li>\n
- Click on Edit Body and enter your Request Body in XML format.For example\u00a0to call GET_SEARCH_RESULTS<\/strong> service to retrieve the search results for the passed query text you can submit Request Body as below.
\nNOTICE:<\/strong>\u00a0 String in Search Text was surrounded by backtick (\u00a0 `\u00a0 ). Single tick \/ double quote didn’t work in our case.<\/p>\n<soapenv:Envelope xmlns:soapenv=\"http:\/\/schemas.xmlsoap.org\/soap\/envelope\/\" xmlns:ucm=\"http:\/\/www.oracle.com\/UCM\">\r\n<soapenv:Body>\r\n <ucm:GenericRequest webKey=\"cs\">\r\n <ucm:Service IdcService=\"GET_SEARCH_RESULTS\">\r\n <ucm:Document>\r\n <ucm:Field name=\"QueryText\">dDocTitle <starts> `MY_sites_201`<\/ucm:Field>\r\n <\/ucm:Document>\r\n <\/ucm:Service>\r\n <\/ucm:GenericRequest>\r\n<\/soapenv:Body>\r\n<\/soapenv:Envelope><\/pre>\n![\"\"](\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/12\/ssis-xml-source-read-oracle-ucm-soap-service.png\")
<\/a><\/li>\n- Now Select Filter (Browse upto Fields under SearchResult node. Once you click OK try to edit your Expression so it looks like below. As you may notice we changed\u00a0ResultSet[*]<\/strong> to\u00a0ResultSet[?(@@name==’SearchResults’)]<\/strong>
\nThis will ensure that we extract records from only SearchResult Node and not other nodes such as\u00a0UserAttribInfo or\u00a0EnterpriseSearchResults<\/p>\n$.env:Envelope.env:Body.ns2:GenericResponse.ns2:Service.ns2:Document.ns2:ResultSet[?(@@name=='SearchResults')].ns2:Row[*]<\/pre>\n![\"Select](\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/12\/ssis-xml-source-select-filter.png\")
<\/a>Select Filter<\/p><\/div><\/li>\n
- Now go to 2D Array Tab. Select Key \/ Value Pattern Option<\/a>.<\/li>\n
- Select Column Names \/ Value Filters as below. You can Use Browse Option to navigate to that field or just type below directly. Below expression will Transform Rows into Column. Foreach attribute name we will get one column.Column Name Filter =>\u00a0 $.ns2:Field[*].@name<\/strong>
\nColumn Value Filter =>\u00a0 $.ns2:Field[*].#text<\/strong><\/li>\n- Now Click Preview to confirm it works
\n![\"\"](\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/12\/ssis-calling-oracle-ucm-web-service-weblogic-soap-api.png\")
<\/a><\/li>\n- That’s it, you can now click OK to close UI.<\/li>\n<\/ol>\n
Loading Oracle UCM SOAP API data into SQL Server \/ Other Target<\/h3>\nZappySys SSIS PowerPack makes it easy to load data from various sources such as REST, SOAP, JSON, XML, CSV or from other source into SQL Server, or PostgreSQL, or Amazon Redshift, or other targets. The Upsert Destination<\/strong> component allows you to automatically insert new records and update existing ones based on key columns. Below are the detailed steps to configure it.<\/p>\r\nStep 1: Add Upsert Destination to Data Flow<\/h3>\r\n\r\n- Drag and drop the Upsert Destination<\/strong> component from the SSIS Toolbox.<\/li>\r\n
- Connect your source component (e.g., JSON \/ REST \/ Other Source) to the Upsert Destination.<\/li>\r\n<\/ol>\r\n\r\n\r\n
![\"\"](\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2017\/08\/ssis-data-flow-drag-drop-upsert-destination.png\")
<\/a>\r\nSSIS - Data Flow - Drang and Drop Upsert Destination Component<\/p>\r\n<\/div>\r\n
Step 2: Configure Target Connection<\/h3>\r\n\r\n- Double-click the Upsert Destination<\/strong> component to open the configuration window.<\/li>\r\n
- Under Connection<\/strong>, select an existing target connection or click NEW<\/strong> to create a new connection.\r\n
\r\n- Example: SQL Server, or PostgreSQL, or Amazon Redshift.<\/li>\r\n<\/ul>\r\n<\/li>\r\n<\/ol>\r\n
Step 3: Select or Create Target Table<\/h3>\r\n\r\n- In the Target Table<\/strong> dropdown, select the table where you want to load data.<\/li>\r\n
- Optionally, click NEW<\/strong> to create a new table based on the source columns.<\/li>\r\n<\/ol>\r\n\r\n\r\n
![\"\"](\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2020\/09\/upsert-destination-configuration.png\")
<\/a>\r\nConfigure SSIS Upsert Destination Connection - Loading data (REST \/ SOAP \/ JSON \/ XML \/CSV) into SQL Server or other target using SSIS<\/p>\r\n<\/div>\r\n
Step 4: Map Columns<\/h3>\r\n\r\n- Go to the Mappings<\/strong> tab.<\/li>\r\n
- Click Auto Map<\/strong> to map source columns to target columns by name.<\/li>\r\n
- Ensure you check the Primary key column(s)<\/strong> that will determine whether a record is inserted or updated.<\/li>\r\n
- You can manually adjust the mappings if necessary.<\/li>\r\n<\/ol>\r\n \r\n\r\n
![\"\"](\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2020\/09\/upsert-destination-key.png\")
<\/a>\r\nSSIS Upsert Destination - Columns Mappings<\/p>\r\n<\/div>\r\n
Step 5: Save Settings<\/h3>\r\n\r\n- Click OK<\/strong> to save the Upsert Destination configuration.<\/li>\r\n<\/ul>\r\n
Step 6: Optional: Add Logging or Analysis<\/h3>\r\n\r\n- You may add extra destination components to log the number of inserted vs. updated records for monitoring or auditing purposes.<\/li>\r\n<\/ul>\r\n
Step 7: Execute the Package<\/h3>\r\n\r\n- Run your SSIS package and verify that the data is correctly inserted and updated in the target table.<\/li>\r\n<\/ul>\r\n
About Oracle UCM Web Service<\/h2>\n
If you are not sure what is SOAP Web Service and how to call in SSIS, First read this article<\/a> to understand general concepts of calling SOAP API in SSIS.<\/p>\n UCM Web Service offers calling various commands<\/a>. You have to send XML Request and server will send you XML response with requested data. We will use Array Transformation Technique (Key \/ Value Pattern)<\/a> to extract complex nested XML data.<\/p>\n Now let’s look at how to call Oracle UCM SOAP API in SSIS.<\/p>\n Configure HTTP Connection – Call Oracle UCM Web Service (SOAP XML)<\/p><\/div><\/li>\n Select Filter<\/p><\/div><\/li>\n ZappySys SSIS PowerPack makes it easy to load data from various sources such as REST, SOAP, JSON, XML, CSV or from other source into SQL Server, or PostgreSQL, or Amazon Redshift, or other targets. The Upsert Destination<\/strong> component allows you to automatically insert new records and update existing ones based on key columns. Below are the detailed steps to configure it.<\/p>\r\n SSIS - Data Flow - Drang and Drop Upsert Destination Component<\/p>\r\n<\/div>\r\n Configure SSIS Upsert Destination Connection - Loading data (REST \/ SOAP \/ JSON \/ XML \/CSV) into SQL Server or other target using SSIS<\/p>\r\n<\/div>\r\n SSIS Upsert Destination - Columns Mappings<\/p>\r\n<\/div>\r\nStep-By-Step<\/h2>\n
Read from Oracle UCM Web Service using XML Source<\/h3>\n
\n
https:\/\/YOUR-INSTANCE-ID.oraclecloud.com\/idcws\/GenericSoapPort<\/pre>\n<\/li>\n
<\/a>SOAPAction: \"urn:GenericSoap\/GenericSoapOperation\"<\/pre>\n<\/li>\n
\nNOTICE:<\/strong>\u00a0 String in Search Text was surrounded by backtick (\u00a0 `\u00a0 ). Single tick \/ double quote didn’t work in our case.<\/p>\n<soapenv:Envelope xmlns:soapenv=\"http:\/\/schemas.xmlsoap.org\/soap\/envelope\/\" xmlns:ucm=\"http:\/\/www.oracle.com\/UCM\">\r\n<soapenv:Body>\r\n <ucm:GenericRequest webKey=\"cs\">\r\n <ucm:Service IdcService=\"GET_SEARCH_RESULTS\">\r\n <ucm:Document>\r\n <ucm:Field name=\"QueryText\">dDocTitle <starts> `MY_sites_201`<\/ucm:Field>\r\n <\/ucm:Document>\r\n <\/ucm:Service>\r\n <\/ucm:GenericRequest>\r\n<\/soapenv:Body>\r\n<\/soapenv:Envelope><\/pre>\n
<\/a><\/li>\n
\nThis will ensure that we extract records from only SearchResult Node and not other nodes such as\u00a0UserAttribInfo or\u00a0EnterpriseSearchResults<\/p>\n$.env:Envelope.env:Body.ns2:GenericResponse.ns2:Service.ns2:Document.ns2:ResultSet[?(@@name=='SearchResults')].ns2:Row[*]<\/pre>\n
<\/a>
\nColumn Value Filter =>\u00a0 $.ns2:Field[*].#text<\/strong><\/li>\n
\n<\/a><\/li>\nLoading Oracle UCM SOAP API data into SQL Server \/ Other Target<\/h3>\n
Step 1: Add Upsert Destination to Data Flow<\/h3>\r\n
\r\n
<\/a>\r\nStep 2: Configure Target Connection<\/h3>\r\n
\r\n
\r\n
Step 3: Select or Create Target Table<\/h3>\r\n
\r\n
<\/a>\r\nStep 4: Map Columns<\/h3>\r\n
\r\n
<\/a>\r\nStep 5: Save Settings<\/h3>\r\n
\r\n
Step 6: Optional: Add Logging or Analysis<\/h3>\r\n
\r\n
Step 7: Execute the Package<\/h3>\r\n
\r\n
![\"\"](\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/12\/ssis-upsert-destination-execute.png\")
<\/a>\r\n