searchd command reference¶
searchd is the second of the two principle tools as part of Manticore.
searchd is the part of the system which actually handles searches;
it functions as a server and is responsible for receiving queries,
processing them and returning a dataset back to the different APIs for
searchd is not designed to be run either from a
regular script or command-line calling, but instead either as a daemon
to be called from init.d (on Unix/Linux type systems) or to be called as
a service (on Windows-type systems), so not all of the command line
options will always apply, and so will be build-dependent.
searchd is simply a case of:
$ searchd [OPTIONS]
The options available to
searchd on all builds are:
-hfor short) lists all of the parameters that can be called in your particular build of
-vshow version information of your particular build of
-c <file>for short) tells
searchdto use the given file as its configuration, just as with
--stopis used to asynchronously stop
searchd, using the details of the PID file as specified in the
manticore.conffile, so you may also need to confirm to
searchdwhich configuration file to use with the
--configoption. NB, calling
--stopwill also make sure any changes applied to the indexes with :ref:
`UpdateAttributes()<update_attributes>` will be applied to the index files themselves. Example:
$ searchd --config /home/myuser/manticore.conf --stop
--stopwaitis used to synchronously stop
--stopessentially tells the running instance to exit (by sending it a SIGTERM) and then immediately returns.
--stopwaitwill also attempt to wait until the running
searchdinstance actually finishes the shutdown (eg. saves all the pending attribute changes) and exits. Example:
$ searchd --config /home/myuser/manticore.conf --stopwait
Possible exit codes are as follows:
- 0 on success;
- 1 if connection to running searchd daemon failed;
- 2 if daemon reported an error during shutdown;
- 3 if daemon crashed during shutdown.
--statuscommand is used to query running
searchdinstance status, using the connection details from the (optionally) provided configuration file. It will try to connect to the running instance using the first configured UNIX socket or TCP port. On success, it will query for a number of status and performance counter values and print them. You can use Status() API call to access the very same counters from your application. Examples:
$ searchd --status $ searchd --config /home/myuser/manticore.conf --status
--pidfileis used to explicitly force using a PID file (where the
searchdprocess number is stored) despite any other debugging options that say otherwise (for instance,
--console). This is a debugging option.
$ searchd --console --pidfile
--consoleis used to force
searchdinto console mode; typically it will be running as a conventional server application, and will aim to dump information into the log files (as specified in
manticore.conf). Sometimes though, when debugging issues in the configuration or the daemon itself, or trying to diagnose hard-to-track-down problems, it may be easier to force it to dump information directly to the console/command line from which it is being called. Running in console mode also means that the process will not be forked (so searches are done in sequence) and logs will not be written to. (It should be noted that console mode is not the intended method for running
searchd.) You can invoke it as such:
$ searchd --config /home/myuser/manticore.conf --console
--logdebugvvoptions enable additional debug output in the daemon log. They differ by the logging verboseness level. These are debugging options, they pollute the log a lot, and thus they should not be normally enabled. (The normal use case for these is to enable them temporarily on request, to assist with some particularly complicated debugging session.)
--iostatsis used in conjunction with the logging options (the
query_logwill need to have been activated in
manticore.conf) to provide more detailed information on a per-query basis as to the input/output operations carried out in the course of that query, with a slight performance hit and of course bigger logs.
The IO statistics don’t include information about IO operations for attributes, as these are loaded with mmap().
Further details are available under the query log format section. You might start
$ searchd --config /home/myuser/manticore.conf --iostats
--cpustatsis used to provide actual CPU time report (in addition to wall time) in both query log file (for every given query) and status report (aggregated). It depends on clock_gettime() system call or fall back to less precise call on certain systems. You might start
$ searchd --config /home/myuser/manticore.conf --cpustats
-pfor short) is used to specify the port that
searchdshould listen on, usually for debugging purposes. This will usually default to 9312, but sometimes you need to run it on a different port. Specifying it on the command line will override anything specified in the configuration file. The valid range is 0 to 65535, but ports numbered 1024 and below usually require a privileged account in order to run. An example of usage:
$ searchd --port 9313
--listen ( address ":" port | port | path ) [ ":" protocol ](or
-lfor short) Works as
--port, but allow you to specify not only the port, but full path, as IP address and port, or Unix-domain socket path, that
searchdwill listen on. Otherwords, you can specify either an IP address (or hostname) and port number, or just a port number, or Unix socket path. If you specify port number but not the address, searchd will listen on all network interfaces. Unix path is identified by a leading slash. As the last param you can also specify a protocol handler (listener) to be used for connections on this socket. Supported protocol values are ‘sphinx’ and ‘mysql41’ (MySQL protocol used since 4.1 upto at least 5.1).
--force-prereadforbids the daemon to serve any incoming connection until prereading of index files completes. By default, at startup the daemon accepts connections while index files are lazy loaded into memory.
-i <index>for short) forces this instance of
searchdonly to serve the specified index. Like
--port, above, this is usually for debugging purposes; more long-term changes would generally be applied to the configuration file itself. Example usage:
$ searchd --index myindex
--strip-pathstrips the path names from all the file names referenced from the index (stopwords, wordforms, exceptions, etc). This is useful for picking up indexes built on another machine with possibly different path layouts.
--replay-flags=<OPTIONS>switch can be used to specify a list of extra binary log replay options. The supported options are:
accept-desc-timestamp, ignore descending transaction timestamps and replay such transactions anyway (the default behavior is to exit with an error).
ignore-open-errors, ignore missing binlog files (the default behavior is to exit with an error).
$ searchd --replay-flags=accept-desc-timestamp
--coredumpis used to enable save of core file or minidump of daemon on crash. Disabled by default to speed up of daemon restart on crash. This is useful for debugging purposes.
$ searchd --config /home/myuser/manticore.conf --coredump
--new-clusterbootstraps a replication cluster and makes the daemon a reference node with cluster restart protection
--new-cluster-forcebootstraps a replication cluster and makes the daemon a reference node bypassing cluster restart protection
There are some options for
searchd that are specific to Windows
platforms, concerning handling as a service, and are only available in
Note that in Windows searchd will default to
--console mode, unless
you install it as a service.
searchdas a service into the Microsoft Management Console (Control Panel / Administrative Tools / Services). Any other parameters specified on the command line, where
--installis specified will also become part of the command line on future starts of the service. For example, as a part of calling
searchd, you will likely also need to specify the configuration file with
--config, and you would do that as well as specifying
--install. Once called, the usual start/stop facilities will become available via the management console, so any methods you could use for starting, stopping and restarting services would also apply to
C:\WINDOWS\system32> C:\Manticore\bin\searchd.exe --install --config C:\Manticore\manticore.conf
If you want to have the I/O stats every time you start
searchd, you need to specify its option on the same line as the
C:\WINDOWS\system32> C:\Manticore\bin\searchd.exe --install --config C:\Manticore\manticore.conf --iostats
--deleteremoves the service from the Microsoft Management Console and other places where services are registered, after previously installed with
--install. Note, this does not uninstall the software or delete the indexes. It means the service will not be called from the services systems, and will not be started on the machine’s next start. If currently running as a service, the current instance will not be terminated (until the next reboot, or until
searchdis called with
--stop). If the service was installed with a custom name (with
--servicename), the same name will need to be specified with
--servicenamewhen calling to uninstall. Example:
C:\WINDOWS\system32> C:\Manticore\bin\searchd.exe --delete
--servicename <name>applies the given name to
searchdwhen installing or deleting the service, as would appear in the Management Console; this will default to searchd, but if being deployed on servers where multiple administrators may log into the system, or a system with multiple
searchdinstances, a more descriptive name may be applicable. Note that unless combined with
--delete, this option does not do anything. Example:
C:\WINDOWS\system32> C:\Manticore\bin\searchd.exe --install --config C:\Manticore\manticore.conf --servicename ManticoreSearch
--ntserviceis the option that is passed by the Management Console to
searchdto invoke it as a service on Windows platforms. It would not normally be necessary to call this directly; this would normally be called by Windows when the service would be started, although if you wanted to call this as a regular service from the command-line (as the complement to
--console) you could do so in theory.
searchdto only use system backtrace() call in crash reports. In certain (rare) scenarios, this might be a “safer” way to get that report. This is a debugging option.
--nodetachswitch (Linux only) tells
searchdnot to detach into background. This will also cause log entry to be printed out to console. Query processing operates as usual. This is a debugging option.
Last but not least, as every other daemon,
searchd supports a number
- Initiates a clean shutdown. New queries will not be handled; but queries that are already started will not be forcibly interrupted.
- Initiates index rotation. Depending on the value of seamless_rotate setting, new queries might be shortly stalled; clients will receive temporary errors.
- Forces reopen of searchd log and query log files, letting you implement log file rotation.