Elasticsearch for Eloquent Laravel Models
Elasticquent makes working with Elasticsearch and Eloquent models easier by mapping them to Elasticsearch types. You can use the default settings or define how Elasticsearch should index and search your Eloquent models right in the model.
Elasticquent uses the official Elasticsearch PHP API. To get started, you should have a basic knowledge of how Elasticsearch works (indexes, types, mappings, etc).
You must be running at least Elasticsearch 8.
If you do find an issue, please feel free to report it with GitHub's bug tracker for this project.
Alternatively, fork the project and make a pull request :)
Elasticquent allows you take an Eloquent model and easily index and search its contents in Elasticsearch.
$books = Book::where('id', '<', 200)->get();
$books->addToIndex();When you search, instead of getting a plain array of search results, you instead get an Eloquent collection with some special Elasticsearch functionality.
$books = Book::search('Moby Dick');
echo $books->totalHits();Plus, you can still use all the Eloquent collection functionality:
$books = $books->filter(function ($book) {
return $book->hasISBN();
});Check out the rest of the documentation for how to get started using Elasticsearch and Elasticquent!
When using a database, Eloquent models are populated from data read from a database table. With Elasticquent, models are populated by data indexed in Elasticsearch. The whole idea behind using Elasticsearch for search is that its fast and light, so you model functionality will be dictated by what data has been indexed for your document.
Before you start using Elasticquent, make sure you've installed Elasticsearch.
To get started, add Elasticquent to you composer.json file:
"elasticquent/elasticquent": "dev-master"
Once you've run a composer update, you need to register Laravel service provider, in your config/app.php:
'providers' => [
...
Elasticquent\ElasticquentServiceProvider::class,
],We also provide a facade for elasticsearch-php client (which has connected using our settings), add following to your config/app.php if you need so.
'aliases' => [
...
'Es' => Elasticquent\ElasticquentElasticsearchFacade::class,
],Then add the Elasticquent trait to any Eloquent model that you want to be able to index in Elasticsearch:
use Elasticquent\ElasticquentTrait;
class Book extends Eloquent
{
use ElasticquentTrait;
}Now your Eloquent model has some extra methods that make it easier to index your model's data using Elasticsearch.
By default, Elasticquent will connect to localhost:9200 and use default as index name, you can change this and the other settings in the configuration file. You can add the elasticquent.php config file at /app/config/elasticquent.php for Laravel 4, or use the following Artisan command to publish the configuration file into your config directory for Laravel 5:
$ php artisan vendor:publish --provider="Elasticquent\ElasticquentServiceProvider"<?php
return array(
/*
|--------------------------------------------------------------------------
| Custom Elasticsearch Client Configuration
|--------------------------------------------------------------------------
|
| This array will be passed to the Elasticsearch client.
| See configuration options here:
|
| http://www.elasticsearch.org/guide/en/elasticsearch/client/php-api/current/_configuration.html
*/
'config' => [
'hosts' => ['localhost:9200'],
'retries' => 1,
'basicauthentication' => [env('ELASTICQUENT_USERNAME', 'elastic'), env('ELASTICQUENT_PASSWORD', '')],
],
/*
|--------------------------------------------------------------------------
| Default Index Name
|--------------------------------------------------------------------------
|
| This is the index name that Elastiquent will use for all
| Elastiquent models.
*/
'default_index' => 'my_custom_index_name',
);While you can definitely build your indexes and mapping through the Elasticsearch API, you can also use some helper methods to build indexes and types right from your models.
If you want a simple way to create indexes, Elasticquent models have a function for that:
Book::createIndex($shards = null, $replicas = null);
For custom analyzer, you can set an indexSettings property in your model and define the analyzers from there:
/**
* The elasticsearch settings.
*
* @var array
*/
protected $indexSettings = [
'analysis' => [
'char_filter' => [
'replace' => [
'type' => 'mapping',
'mappings' => [
'&=> and '
],
],
],
'filter' => [
'word_delimiter' => [
'type' => 'word_delimiter',
'split_on_numerics' => false,
'split_on_case_change' => true,
'generate_word_parts' => true,
'generate_number_parts' => true,
'catenate_all' => true,
'preserve_original' => true,
'catenate_numbers' => true,
]
],
'analyzer' => [
'default' => [
'type' => 'custom',
'char_filter' => [
'html_strip',
'replace',
],
'tokenizer' => 'whitespace',
'filter' => [
'lowercase',
'word_delimiter',
],
],
],
],
];For mapping, you can set a mappingProperties property in your model and use some mapping functions from there:
protected $mappingProperties = array(
'title' => array(
'type' => 'string',
'analyzer' => 'standard'
)
);If you'd like to setup a model's type mapping based on your mapping properties, you can use:
Book::putMapping($ignoreConflicts = true);You can also get the type mapping and check if it exists.
Book::mappingExists();
Book::getMapping();Note! As ES 7 and forward do not have a type anymore, the type of data is part of the index. For instance with the default index name of my_custom_index_name becomes my_custom_index_name_books_index if the type of data is books.
By default, Elasticquent will look for the default_index key within your configuration file(config/elasticquent.php). To set the default value for an index being used, you can edit this file and set the default_index key:
return array(
// Other configuration keys ...
/*
|--------------------------------------------------------------------------
| Default Index Name
|--------------------------------------------------------------------------
|
| This is the index name that Elastiquent will use for all
| Elastiquent models.
*/
'default_index' => 'my_custom_index_name',
);If you'd like to have a more dynamic index, you can also override the default configuration with a getIndexName method inside your Eloquent model:
function getIndexName()
{
return 'custom_index_name';
}Note: If no index was specified, Elasticquent will use a hardcoded string with the value of default_datatype_index.
In order to use routing for instance for multitenancy, you need to override getRoutingName in the model to return a name.
To index all the entries in an Eloquent model, use addAllToIndex:
Book::addAllToIndex();You can also index a collection of models:
$books = Book::where('id', '<', 200)->get();
$books->addToIndex();You can index individual entries as well:
$book = Book::find($id);
$book->addToIndex();You can also reindex an entire model:
Book::reindex();There are three ways to search in Elasticquent. All three methods return a search collection.
The first method is a simple term search that searches all fields.
$books = Book::search('Moby Dick');The second is a query based search for more complex searching needs:
public static function searchByQuery($query = null, $aggregations = null, $sourceFields = null, $limit = null, $offset = null, $sort = null)Example:
$books = Book::searchByQuery(array('match' => array('title' => 'Moby Dick')));Here's the list of available parameters:
query- Your ElasticSearch Queryaggregations- The Aggregations you wish to return. See Aggregations for details.sourceFields- Limits returned set to the selected fields onlylimit- Number of records to returnoffset- Sets the record offset (use for paging results)sort- Your sort query
The final method is a raw query that will be sent to Elasticsearch. This method will provide you with the most flexibility when searching for records inside Elasticsearch:
$books = Book::complexSearch(array(
'body' => array(
'query' => array(
'match' => array(
'title' => 'Moby Dick'
)
)
)
));This is the equivalent to:
$books = Book::searchByQuery(array('match' => array('title' => 'Moby Dick')));When you search on an Elasticquent model, you get a search collection with some special functions.
You can get total hits:
$books->totalHits();Access the shards array:
$books->shards();Access the max score:
$books->maxScore();Access the timed out boolean property:
$books->timedOut();And access the took property:
$books->took();And access search aggregations - See Aggregations for details:
$books->getAggregations();Items in a search result collection will have some extra data that comes from Elasticsearch. You can always check and see if a model is a document or not by using the isDocument function:
$book->isDocument();You can check the document score that Elasticsearch assigned to this document with:
$book->documentScore();Similar to Illuminate\Support\Collection, the chunk method breaks the Elasticquent collection into multiple, smaller collections of a given size:
$all_books = Book::searchByQuery(array('match' => array('title' => 'Moby Dick')));
$books = $all_books->chunk(10);If you're dealing with raw search data from outside of Elasticquent, you can use the Elasticquent search results collection to turn that data into a collection.
$client = new \Elasticsearch\Client();
$params = array(
'index' => 'default',
'type' => 'books'
);
$params['body']['query']['match']['title'] = 'Moby Dick';
$collection = Book::hydrateElasticsearchResult($client->search($params));Elasticquent will use whatever is set as the primaryKey for your Eloquent models as the id for your Elasticsearch documents.
By default, Elasticquent will use the entire attribute array for your Elasticsearch documents. However, if you want to customize how your search documents are structured, you can set a getIndexDocumentData function that returns you own custom document array.
function getIndexDocumentData()
{
return array(
'id' => $this->id,
'title' => $this->title,
'custom' => 'variable'
);
}Be careful with this, as Elasticquent reads the document source into the Eloquent model attributes when creating a search result collection, so make sure you are indexing enough data for your the model functionality you want to use.
If you are using a custom collection with your Eloquent models, you just need to add the ElasticquentCollectionTrait to your collection so you can use addToIndex.
class MyCollection extends \Illuminate\Database\Eloquent\Collection
{
use ElasticquentCollectionTrait;
}Elasticquent currently needs:
- Tests that mock ES API calls.
- Support for routes