Crawl the content from SOAP API using Sitecore Search

-

Sitecore search can crawl any content from different sources like Sitemap, REST API, RSS, PDF, Word document, etc, We have a requirement to crawl the data from the Soap Service API and provide the relevant content to the user.

Let's see how easily Sitecore Search helps us to crawl the content from SOAP API.

For Example, Let's crawl the list of languages from the SOAP API  provided below and store each language's details as a separate index document in Sitecore Search

Below are the sample SOAP API details along with request and response object details
http://webservices.oorsprong.org/websamples.countryinfo/CountryInfoService.wso



Steps to configure the source crawler to crawl the content from the SOAP API

  • Create the Source with Web Crawler(Advanced), usually for all APIs we used to go with API Crawler, but in this case, API Crawler does not support SOAP API


  • Update the necessary settings Max Depth, Parallelism etc.
  • Click on the Trigger tab to configure the Trigger to provide the starting point of the URL to crawl with all essential parameters required to get the content from the SOAP API
  • Select the Trigger Type to Request
  • In the Body add the necessary input details
  • Add headers Key as Content-Type and value as text/xml; charset=utf-8
  • Add the Method to POST
  • Add an endpoint in the URL field



  • Steps to configure Document extractor to extract the content from the SOAP API
  • Click on the Tab Document Extractor to provide the necessary Name and set the Extractor Type as JS
  • Click Add Tagger to extract the languages from the soap response, each language will be added as a separate index document.
  • Let's loop through the Soap response and grab the language

  • Publish once after all the configurations have been done.
  • Once the indexing is completed go to the Content Collection tab and click Content to select the Source name Soap which we have created above to view the indexed documents.



Let's learn and grow together, happy programming 😊

Comments

Post a Comment

Popular posts from this blog

Custom Item Url and resolving the item in Sitecore - Buckets

-
Image
I have a situation to update the Item URL to be SEO friendly as my items in content tree looks like below. In the above image in order to resolve the item, Sitecore will find the item from the below URL http://domainname/en/dine/nv/chicken but I need to form a URL that is more SEO friendly like http://domainname/en/chicken In Sitecore by Out of box, we can achieve this by using Aliases , we can create an Aliases under System à Aliases and in the Linked Item field select the target item. But this is very tedious as we need to go to every item in the content tree and create Aliases, instead of that we will be going to do it programmatically using custom pipelines. ·          Link Provider (Provides the custom URL for the item based on the templates) ·          Item Resolver (Resolves the item based on the custom URL generated by CustomLinkProvider , that we going to create later. Sitecore could not resolve the item in the specified path in the content tree
Read more

Sitecore Custom Rule (Action and Condition)

-
Image
I have a situation to create a custom Sitecore rule and action for it. v   Goto /Sitecore/system/Settings/Rules/Definitions/Elements v   Create a new item base on the template “ ElementFolder ” with a name “ Custom Rule ” v   Click on the item and create condition and Actions that are necessary for your requirements Condition Template Item: It has two important sections v   Data ·          Text (This is the condition Text which will use tokens to evaluate the condition and user input which will be in [ ] brackets.The brackets contain four positional parameters separated by commas (“,”). 1. The name of the property that the parameter sets in the .NET class that implements the condition. 2. The name of an item beneath the /Sitecore/System/Settings/Rules/Common/Macros item providing predefined functionality, or an empty string. For example, to activate a user interface allowing the user to select an item from the content tree, specify the value tree. 3. URL param
Read more

XM Cloud - All about XM Preview and Edge GraphQL

-
Image
 I have recently started working on the xmcloud project to fetch the data from xmcloud using GraphQL, I have faced some challenges using GraphQL in both the XM preview and EDGE environment. I am sharing details that will help others who like to use GraphQL extensively for querying and searching content from xmcloud. Challenges : Need to access the item from the data folder which is not under the home node. I have written the GraphQL Item query to fetch the datasource item under the data folder. The response is fine in the XM preview environment with all the data from different fields like image,droplink,droptree,treelist, and treelistex, etc coming properly,  but when switched to EDGE the query does not work as expected, it provides the response in raw values. The reason behind showing raw value is that the items under the data folder do not have any site definition to them and it does have a presentation. If anyone faced this issue, then you will be happy now with the latest release o
Read more