How to manage and troubleshoot Search: A practical - Channel 9

WSDL (Web Services Description Language)
AAMs( Alternate Access Mappings)
Protocol Handlers
sts4[s] (SharePoint)
sps3[s] (People)
http[s] (Web)
file (File Share)
bdc (Business)
Processing Flows
\\srv\gthrsvc
mssearch.exe
mssearch.exe
CRAWL
STORE
Crawl
Store
noderunner.exe
noderunner.exe
xnoderunner.exe
Search Query and Site Settings
Mars Lookup
Operator (MLO)
Query Flows
•
•
•
•
•
w3wp.exe
w3wp.exe
w3wp.exe
Analytics
Reporting
Links Store
Usage DB
noderunner.exe
Search
Admin
noderunner.exe
Crawl state lives in the database
Crawl the default zone
Don’t use server name mappings for SharePoint content
Application Server Administration Service Timer Job
Example:
The application cannot be initialized.
Context: Application 'Search_Service_Application'
Details:
The gatherer is shutting down (0x80040d23)
ERROR
Application Server Administration job failed for service instance
Microsoft.Office.Server.Search.Administration.SearchServiceInstance (ee54f9c5-2b43-4466-9e21-483389331abb).
Reason: The gatherer is shutting down.
Technical Support Details:
System.Runtime.InteropServices.COMException (0x80040D23): The gatherer is shutting down.
at Microsoft.Office.Server.Search.Administration.MSSITLB.IGatherManagerAdmin3.get_ConfigurationVersion()
at Microsoft.Office.Server.Search.Administration.Gatherer.ProvisionGlobalProperties()
at Microsoft.Office.Server.Search.Administration.SearchServiceInstance.Synchronize()
at Microsoft.Office.Server.Administration.ApplicationServerJob.ProvisionLocalSharedServiceInstances(Boolean isAdministrationServiceJob)
Check ULS logs on Crawler for errors
If Application Server Administration Service Timer Job isn’t running, you may see no entries at all.
SSP Job Control Service instance Status = online
Hidden “Service on Server”
PowerShell:
$sspjob = (Get-SPFarm).Servers[“<servername>"].ServiceInstances
where {$_.typename -eq "SSP Job Control Service"}
|
The SharePoint Crawl is stateful with
transitional “ing” states (e.g. starting,
completing, stopping, pausing) and
corresponding rest states (e.g. started,
completed, stopped, paused)
Status
0
1
1
4
4
4
4
5
7
8
8
9
11
12
13
13
14
14
14
SubStatus
0
1
2
1
2
3
4
0
1
2
0
1
2
1
2
4
This combination means…
New crawl, requesting start
Starting, Add Start Address(es)
Starting, waiting on Crawl Component(s)
Crawling
Crawling, Unvisited to Queue
Crawling, Delete Unvisited
Crawling, Wait for All Databases
Failed to Start (e.g. Another Crawl Already Running)
Resuming
Pausing, Waiting on Crawl Component(s) to Pause
Pausing, Complete Pause
Paused
Completed
Stopped
Stopping, Waiting on Crawl Component(s) to Stop
Stopping, Complete Stop
Completing, Waiting on Crawl Component(s) to Complete
Completing
Completing, Get Deletes Pending
Crawl Component
Crawl DB
x
x
x
x
x
x
x
x
x
x
x
x
x
Source:[SSA].[dbo].[proc_MSS_CrawlAdmin]
SELECT
hist.CrawlId, hist.CrawlType, hist.ContentSourceId,
hist.StartTime, hist.Status, hist.SubStatus, hist.Request,
ccState.ComponentID, ccState.Status as ccStatus,
ccState.SuspendedCount
FROM [SSA].[dbo].[MSSCrawlHistory] AS hist WITH (nolock)
INNER JOIN
[SSA].[dbo].[MSSCrawlComponentsState] AS ccState
ON hist.CrawlId = ccState.CrawlId
WHERE hist.Status Not In (5,11,12)
and hist.crawlid > 2
Crawl
Store
AJPND
\\srv\gthrsvc
Crawling/Gathering
Feeding/Processing
SQ&SS
User
query
Search Query
& Site Settings
Web01
[HTTP] EndPoint:
SearchService.svc
QPC
MarsLookupOperator
Query Processing
Component
[net.tcp] EndPoint
ImsQueryInternal
For a query, a single Correlation ID spans across components and servers
Search
Index Core
http://web01/results.aspx?k=tps
SharePoint 2013
SharePoint 2010
“Sorry, something went wrong”
Merge-SPLogFile -Path $target -Correlation $id
SQ&SS
User
query
Search Query
& Site Settings
Web01
SharePoint Foundation
Topology
e5mc
Medium
WcfSendRequest: RemoteAddress: 'http://qpcServer:32843/-GUID-of-the-SSA-/SearchService.svc'
Channel: 'Microsoft.Office.Server.Search.Administration.ISearchServiceApplication'
Action: 'http://tempuri.org/ISearchQueryServiceApplication/Execute'
SharePoint Server Search
Query
dka5
High
SearchServiceApplicationProxy::Execute--Error occured:
System.ServiceModel.ServerTooBusyException:
The HTTP service located at http://qpcServer:32843/-GUID-of-the-SSA-/SearchService.svc is
unavailable. This could be because the service is too busy or because no endpoint was found
listening at the specified address.
Please ensure that the address is correct and try accessing the service again later. --->
System.Net.WebException: The remote server returned an error: (503) Server Unavailable.
at System.Net.HttpWebRequest.GetResponse()
•
•
Search
Query Processing
aizgm
Medium
Microsoft.Office.Server.Search.Query.Pipeline.Executors.QueryPipelineFlowExecutor :
FlowExecutor done: SearchApplication=cb4954e3-e4ad-40bd-b0e2-1b1db290c668.
ParentFlow=Microsoft.ProductivitySearchFlow SubFlowTimings: QueryRuleConditionMatching=468
QueryTransformer=31 QueryRouter=1093 ResultsMixer=0 LayoutsSelector=0 QueryLogging=15
Search
Search Component
ajkph
High
Microsoft.Ceres.SearchCore.Query.MarsLookupComponent.LookupService.QueryClient.QueryExecutor
: ExecuteQuery timings for correlation: dad1789c-7d1d-8016-3b36-b562c4fdae55, task dispatch
0 ms, blocked waiting 254 ms, total hits: 84, with dupes: 92, bytes received: 33238, 1
tasks: (cell: I.0.0 at IndexComponent1, total task time: 79 ms, query push queue: 174 ms,
send to index call duration: 20 ms, total in transit: 63 ms, index node execute queue: 0 ms,
query lookup: 7 ms, docsum lookup: 9 ms)
Note: The SQ&SS will be automatically started on all servers with a QPC, but should not be enabled on any other server
Get-SPEnterpriseSearchQueryAndSiteSettingsServiceInstance
TypeName
-------Search Query
Search Query
Search Query
Search Query
Search Query
and
and
and
and
and
Site
Site
Site
Site
Site
Settings
Settings
Settings
Settings
Settings
Service
Service
Service
Service
Service
Status
-----Disabled
Disabled
Disabled
Disabled
Online
Id
-838d344e-cbe2-4045-9350-1f4d19c2413e
0110417b-163b-41cb-9676-63cb80d65b52
6ec6ea28-c732-48dd-ab83-5458a577a300
d301abbf-4a74-4897-933c-3a4041c40a0f
65708c36-66fb-41b5-b622-6a97c4e0aa26
foreach ($pt in $SSA.EndPoints) { $pt.ListenUris.AbsoluteUri }
http://jwspc14spc5:32843/cb4954e3e4ad40bdb0e21b1db290c668/SearchService.svc
https://jwspc14spc5:32844/cb4954e3e4ad40bdb0e21b1db290c668/SearchService.svc
Search Query
& Site Settings
Query Processing
Component
SQ&SS
QPC
User
query
Web01
QPC
Search Query
& Site Settings
Farm Load Balancing
WCF Service EndPoints
MarsLookupOperator
Query Processing
Component
Search Load Balancing
IMS/Query Flows
Search
Index Core
SQ&SS
Search Query
& Site Settings
Query Processing
Component
SQ&SS
QPC
User
query
Web01
QPC
Search Query
& Site Settings
Farm Load Balancing
WCF Service EndPoints
MarsLookupOperator
Query Processing
Component
Search Load Balancing
IMS/Query Flows
Search
Index Core
SQ&SS
SQ&SS
Search Query
& Site Settings
User
query
Web01
SQ&SS
Search Query
& Site Settings
SharePoint Foundation
Topology
8313
Critical
A failure was reported when trying to invoke a service application: EndpointFailure
Process Name: OWSTIMER
Process ID: 12345
AppDomain Name: DefaultDomain
AppDomain ID: 1
Service Application Uri: urn:schemas-microsoft-com:sharepoint:service:144f1459cc294525bf691…
#authority=urn:uuid…&authority=https://someserver:32844/Topology/topology.svc
Active Endpoints: 2
#the total number of known EndPoints for this Service Application
Failed Endpoints:1
Affected Endpoint: http://qpcServer:32843/-GUID-of-the-SSA-/SearchService.svc
http://usersUrl/results.aspx?k=tps
User
query
Web01
Query Results:
• http://usersUrl/foo/DispForm.aspx?ID=3
• http://usersUrl/TPSReports/report1234.pdf
• http://usersUrl/Memos/reminder_03-2014.txt
http://non-default-url/results.aspx?k=tps
User
query
Web01
Query Results:
• http://non-default-url/foo/DispForm.aspx?ID=3
• http://non-default-url/TPSReports/report1234.pdf
• http://non-default-url/Memos/reminder_03-2014.txt
http://spdemo/results.aspx?k=tps
Default
http://sptest
Default
http://foo
Intranet
http://spdemo
Intranet
Alternate
Access
Mappings
http://morefoo
Query Results:
• http://morefoo/foo/DispForm.aspx?ID=3
• http://morefoo/TPSReports/report1234.pdf
• http://morefoo/Memos/reminder_03-2014.txt
“This Site”
Items in Index
QPC
OriginalPath(string):
http://non-default-url/Docs/foo.pptx
Path(string):
http://non-default-url/Docs/foo.pptx
Query Processing
Component
Look for content with
root http://usersurl
Search
Index
SitePath(string):
http://non-default-url/Docs/foo.pptx
ParentLink(string):
http://non-default-url/Docs/AllItems.aspx
ServerRedirectedUrl(string):
http://non-default-url/_layouts/PowerPoint.aspx
SPSiteURL(string):
http://non-default-url
Items in Index
Search
Index
OriginalPath(string):
http://usersUrl/Docs/foo.pptx
Path(string):
http://usersUrl/Docs/foo.pptx
SitePath(string):
http://usersUrl/Docs/foo.pptx
MPs have inconsistent
ParentLink(string):
root URLs when using
http://nonDefaultURL/Docs/AllItems.aspx
http://non-Default-URL/Docs/AllItems.aspx Server Name Mappings
ServerRedirectedUrl(string):
http://nonDefaultURL/_layouts/PowerPoint.aspx
http://non-Default-URL/_layouts/PowerPoint.aspx
SPSiteURL(string):
http://nonDefaultUrl
Crawl state lives in the database
Crawl the default zone
Don’t use server name mappings for SharePoint content
Search Related Sessions
Session
Session
Room
Time
Develop Advanced Search-Driven SharePoint 2013 Apps
SPC402
Palazzo I, J
Tue 1:45pm
Best practices for Hybrid Search deployments
SPC306
Veronese 2401
Tue 5:00pm
SharePoint 2013 Search Analytics
SPC340
Palazzo M, N
Wed 9:00am
How to manage and troubleshoot Search: A practical guide
SPC375
Veronese 2401
Wed 10:45am
6 Proven Steps to Get the Best Out of Search in SharePoint 2013
SPC265
Delphino 4001
Wed 1:45pm
Best practices for Information Architecture and Enterprise Search
SPC207
Veronese 2401
Wed 1:45pm
Search content enrichment and extensibility in SharePoint 2013
SCP414
Palazzo K, L
Wed 1:45pm
Customizing Search experiences with Azure Hosted Data and Bing Maps
SPC321
Veronese 2401
Wed 3:15pm
Futuristic Search applications using Kinect and Yammer!
SPC405
Palazzo M, N
Wed 3:15pm
Search architecture and sizing in SharePoint 2013
SPC336
Titian 2201
Wed 5:00pm
Effective Search deployment and operations in SharePoint 2013
SPC360
Veronese 2401
Thu 9:00am
SharePoint 2013 Search display templates and query rules
SPC322
Palazzo M, N
Thu 9:00am
Managing Search Relevance in SharePoint 2013 and O365
SPC382
Veronese 2401
Thu 12:00pm
See you at the Search booths & Search tables at Ask the Experts WED @6:15pm!
Sponsored by