{"id":1106,"date":"2012-11-19T09:16:17","date_gmt":"2012-11-19T09:16:17","guid":{"rendered":"https:\/\/poiseddevelopers.com\/reality-tech\/?p=1106"},"modified":"2024-05-13T10:50:44","modified_gmt":"2024-05-13T10:50:44","slug":"search-crawling-in-sp2013","status":"publish","type":"post","link":"https:\/\/poiseddevelopers.com\/reality-tech\/search-crawling-in-sp2013\/","title":{"rendered":"Search Crawling in SP2013"},"content":{"rendered":"<h2>Search Crawling in SP2013<\/h2>\n<p>In SP2010, we have two types of crawls; Full or Incremental Crawl. In a nutshell, your search index can be made on-average fresher, but it is not real-time. Right now we do Full Crawls weekly and incremental crawls hourly.<\/p>\n<p>One of the limitations of Full and Incremental Crawls in SP2010 is that they cannot run in parallel, i.e. if a full or incremental crawl is in progress, the admin cannot kick-off another crawl on that content source. This forces a first-in-first-out approach to how items are indexed.<\/p>\n<p>Moreover, some types of changes result in extended run times; such as script based permission changes, or moving a folder, or changing fields in a content type.<\/p>\n<p>Incremental crawls don\u2019t remove \u201cdeletes\u201d, so ghost documents are still returned as hits, after deletion, until the next full crawl.<\/p>\n<p>SharePoint 2013 will introduce the concept of \u201cContinuous Crawl\u201d. It doesn\u2019t need scheduling. The underlying architecture is designed to ensure consistent freshness by running in parallel.<\/p>\n<p>Right now, if a Full or Incremental crawl is slow, everything else awaits its completion.<\/p>\n<p>It\u2019s a sequential crawl. Behind the scenes, continuous crawl selection results in the kick-off of a crawl every 15minutes (this wait can be configured) regardless of whether the prior session has completed or not.<\/p>\n<p>This means a change that is made immediately after a deep and wide-ranging change doesn\u2019t need to \u2018wait\u2019 behind it.<\/p>\n<p>New changes will continue to be processed in parallel as a deep policy change is being worked on by another continuous crawl session.<\/p>\n<p>Note that Continuous crawl will increase load incrementally on the SharePoint server since it inherently can run parallel multiple sessions simultaneously.<\/p>\n<p>If needed, we can tune this through \u2018Crawl Impact Rule\u2019 settings (which exist today in SP2010), which control the maximum number of simultaneous requests that can be made to a host (default is 12 threads, but it is configurable).<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Search Crawling in SP2013 In SP2010, we have two types of crawls; Full or Incremental Crawl. In a nutshell, your search index can be made on-average fresher, but it is not real-time. Right now we do Full Crawls weekly and incremental crawls hourly. One of the limitations of Full and Incremental Crawls in SP2010 is [&hellip;]<\/p>\n","protected":false},"author":13,"featured_media":1109,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[37],"tags":[],"class_list":["post-1106","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-search"],"acf":[],"_links":{"self":[{"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/posts\/1106","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/comments?post=1106"}],"version-history":[{"count":2,"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/posts\/1106\/revisions"}],"predecessor-version":[{"id":3964,"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/posts\/1106\/revisions\/3964"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/media\/1109"}],"wp:attachment":[{"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/media?parent=1106"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/categories?post=1106"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/poiseddevelopers.com\/reality-tech\/wp-json\/wp\/v2\/tags?post=1106"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}