313 Commits

Author	SHA1	Message	Date
mpostma	2b7d614e84	fix test warnings	2020-05-27 19:32:55 +02:00
Samuel Jimenez	8438ac9756	Rename fields_frequency into fields_distribution	2020-05-26 20:40:49 +02:00
Kerollmops	8cebf78485	Bump heed to 0.8.0 and handle abort errors	2020-05-26 17:04:13 +02:00
Kerollmops	bc7b0a38fd	Use fst 0.4.4 in the project	2020-05-22 15:01:55 +02:00
Kerollmops	6c87723b19	Bump the fst crate to 0.4.4	2020-05-22 15:01:35 +02:00
Kerollmops	ddeb5745be	Refactor a little bit	2020-05-20 17:01:57 +02:00
Kerollmops	a60e3fb1cb	Rename user ids into external docids	2020-05-20 15:08:56 +02:00
Kerollmops	7bbb101555	Prefix the attributes_for_faceting key name	2020-05-20 14:19:00 +02:00
Kerollmops	788e2202c9	Reduce the DocumentId size from 64 to 32bits	2020-05-20 14:19:00 +02:00
Kerollmops	3bca31856d	Discover and remove documents ids	2020-05-20 14:18:59 +02:00
Kerollmops	5bf15a4190	Compute and merge discovered ids	2020-05-20 14:18:59 +02:00
Kerollmops	016bfa391b	Introduce internal and user ids put and get methods	2020-05-20 14:18:59 +02:00
Kerollmops	e6a7521610	Introduce the DiscoverIds and DocumentsIds types	2020-05-20 14:18:59 +02:00
Kerollmops	e2b115f3a9	Improve Number extraction/conversion function	2020-05-19 16:51:33 +02:00
Kerollmops	ae30ee2ade	Clean up some comments and variable names	2020-05-19 16:51:33 +02:00
Kerollmops	3026840530	Introduce an index_document helper function	2020-05-19 16:51:33 +02:00
Kerollmops	d300d788c7	Make the compute_document_id validate the id	2020-05-19 16:51:33 +02:00
Kerollmops	2828b5fa19	Move the helper function to their own module	2020-05-19 16:51:33 +02:00
Kerollmops	25b3c9a057	Remove the serde ExtractDocumentId struct	2020-05-19 16:51:33 +02:00
Kerollmops	2558ce9a00	Export the value_to_string helper function	2020-05-19 16:51:33 +02:00
Kerollmops	65ed2dcc1b	Remove the serde ConvertToNumber	2020-05-19 16:51:32 +02:00
Kerollmops	5e063da14f	Remove the serde Indexer	2020-05-19 16:51:32 +02:00
Kerollmops	615825b9fd	Remove the serde Serializer	2020-05-19 16:51:32 +02:00
mpostma	f38d0d731f	style fix	2020-05-13 11:48:34 +02:00
mpostma	869b6019c6	fix tests	2020-05-13 11:48:34 +02:00
mpostma	347045adf2	smarter field_id name passing	2020-05-13 11:29:46 +02:00
mpostma	e5126af458	enables facet count	2020-05-13 11:29:46 +02:00
mpostma	effbb7f7f1	add sort result struct	2020-05-12 18:22:24 +02:00
Kerollmops	48e94b4372	Enable jemalloc only on linux	2020-05-11 21:24:35 +02:00
mpostma	d7f099d3ba	enables faceted search	2020-05-11 17:38:52 +02:00
mpostma	e07fe017c1	document update	2020-05-11 17:38:52 +02:00
mpostma	270c7b0288	facet settings	2020-05-11 16:12:13 +02:00
mpostma	59c67f6bc8	setting up facets	2020-05-11 16:12:13 +02:00
qdequele	2e55457ecc	implement default on DatabaseOptions	2020-05-07 15:40:44 +02:00
mpostma	2e3a765dac	fix database options	2020-04-29 22:29:09 +02:00
Jan Emmens	dff36eaef4	Fix example not compiling	2020-04-29 11:04:09 +02:00
Jan Emmens	bdd088830a	Add DatabaseOptions arg to query_builder test	2020-04-29 10:12:25 +02:00
Jan Emmens	17401cfbe9	Fix compilation error in unit tests	2020-04-29 09:21:07 +02:00
Jan Emmens	c4287cdfac	Add support for configuring lmdb map size	2020-04-29 09:21:07 +02:00
Clément Renault	287226b609	Bump crates versions to v0.10.1	2020-04-28 15:55:29 +02:00
mpostma	d1f1bfe071	fix floats bug ... Update CHANGELOG.md Co-Authored-By: Clément Renault <renault.cle@gmail.com>	2020-04-28 10:44:07 +02:00
mpostma	812465e014	fixes parenthesis ... adds tests	2020-04-27 22:29:29 +02:00
mposmta	cd3c0d750c	Add support for filtering on arrays of strings ... update changelog Update CHANGELOG.md Co-Authored-By: Clément Renault <renault.cle@gmail.com> fix requested changes	2020-04-21 10:33:57 +02:00
Clément Renault	979bea0327	Bump MeiliSearch version to v0.10	2020-04-10 15:43:03 +02:00
mposmta	a0a481697b	replace lazy_static with once_cell	2020-04-09 17:13:34 +02:00
mposmta	3e031d8297	adds error handling and integration	2020-04-09 17:13:34 +02:00
mposmta	83f50914ec	tests	2020-04-09 17:13:34 +02:00
mposmta	d3916f28aa	implements filter logic	2020-04-09 17:13:34 +02:00
mposmta	dcf1096ac3	implements parser	2020-04-09 17:13:31 +02:00
Clément Renault	29d021ad4d	Fixes the stop words and words fst generation	2020-04-06 18:53:02 +02:00
sgummaluri	e5a336a042	Fix for 'First update does not appear before being processed' #542	2020-04-04 23:18:43 +05:30
Clément Renault	38c43759bb	Update most of the dependencies	2020-04-02 18:36:04 +02:00
Pedro Paulo de Amorim	9950fffb6f	Simplify imports of std::fs and std::io, remove space not needed, Remove UpdateState	2020-04-02 11:02:19 +01:00
Pedro Paulo de Amorim	f5d57c9dce	Replace the toml reader with the JSON settings reader, directly parse the data to SettingsUpdate, Update CHANGELOG	2020-04-02 11:01:56 +01:00
Pedro Paulo de Amorim	1b47a10e89	Add support for seq values	2020-04-01 12:59:40 +01:00
Pedro Paulo de Amorim	690b8e0dd0	Replace .toString to String::new()	2020-03-31 14:01:44 +01:00
Pedro Paulo de Amorim	bc6d86c8ce	serialize_unit returns a empty string	2020-03-31 13:51:12 +01:00
Clément Renault	69aee870da	Make the engine index booleans ... The engine will see the values like text "true" and "false"	2020-03-31 10:39:58 +02:00
Clément Renault	c18e907f96	Construct a Set using the from_dirty method ... This commit fixes #566 by ensuring that the slice of matches is ordered and deduplicated.	2020-03-30 20:56:30 +02:00
mposmta	a6dcd7a421	fixes tests ... fixes tests impacted by sifnature change of query	2020-03-25 15:17:20 +01:00
mposmta	fd65cf9dcb	populates exhaustive number of hits	2020-03-25 12:44:38 +01:00
Clément Renault	3ca8db2cc1	Bump the workspace crates to 0.9.0	2020-03-19 11:56:23 +01:00
Clément Renault	f6972ec682	Bump the workspace crates to 0.9.0-rc.1	2020-03-16 16:58:20 +01:00
Quentin de Quelen	2d82f1b655	ranking fields should be stored and indexed by default; fix #521	2020-03-16 16:19:23 +01:00
qdequele	ef3bcd65ab	fix comments from review	2020-03-10 15:59:11 +01:00
qdequele	179969a9e2	fix tests + fmt	2020-03-10 11:29:56 +01:00
qdequele	c984d8d5a5	rename identifier into primaryKey; fix #514	2020-03-09 18:45:29 +01:00
qdequele	8ffa80883a	remove the unused function	2020-03-09 18:45:29 +01:00
qdequele	86c3482cbd	review the internal schema to allow to create schema without identifier; fix #513	2020-03-09 18:45:20 +01:00
qdequele	6016f2e941	change wording of custom ranking rules dsc -> desc; #490	2020-03-06 10:15:19 +01:00
Clément Renault	5e31d28759	Fix the inference of the documents searchable fields	2020-03-03 20:54:17 +01:00
qdequele	a2f0f95337	use distinct on search	2020-03-02 16:19:41 +01:00
qdequele	250aeaa86c	stop reindexing by chunk during complete reindexing	2020-02-28 11:49:12 +01:00
qdequele	47009615ee	rename words_position to wordsPosition; fix #483	2020-02-27 16:24:49 +01:00
qdequele	dda08d60d2	cargo fmt	2020-02-27 14:33:57 +01:00
qdequele	f182afc50b	update tests	2020-02-27 11:30:23 +01:00
qdequele	bb5d931f16	rename criterions on settings route; fix #480	2020-02-27 11:30:22 +01:00
qdequele	3c74e71d4f	show default ranking rules if user reset them; fix #476	2020-02-27 11:30:17 +01:00
qdequele	79e07fa852	reset value of searchable and displayed attributes; fix #473	2020-02-27 11:04:39 +01:00
qdequele	2eb6f81c58	rename ranking_distinct to distinct_attribute; fix #474	2020-02-27 11:04:39 +01:00
qdequele	a067a1b16b	replace index_new_fields to accept_new_fields; fix #475	2020-02-27 11:04:38 +01:00
Clément Renault	96248d9bfa	Change the exactness criterion in the tests	2020-02-25 14:24:15 +01:00
Clément Renault	9d167c08f4	Rename the Exact criterion into Exactness	2020-02-25 14:16:55 +01:00
qdequele	2d7a1bfce0	fix un-rankable fields errors; fix #463	2020-02-14 10:34:33 +01:00
qdequele	4986adc186	move identifier from settings to index; fix #470	2020-02-12 17:00:14 +01:00
qdequele	dc9ca2ebc9	fixes for review	2020-02-12 16:51:14 +01:00
qdequele	559c2f8907	Add stop words on query	2020-02-11 15:28:00 +01:00
Quentin de Quelen	dc6907e748	rebase from master	2020-02-11 15:28:00 +01:00
qdequele	a5b0e468ee	fix for review	2020-02-11 15:28:00 +01:00
qdequele	50a9825a0f	fix some uses cases on settings	2020-02-11 15:27:59 +01:00
Quentin de Quelen	585bba43a0	set new attributes indexed if needed	2020-02-11 15:27:58 +01:00
qdequele	9c0497c419	change the way settings are show in updates	2020-02-11 15:27:58 +01:00
qdequele	f77f38dfa0	fix update system	2020-02-11 15:27:57 +01:00
qdequele	58fe87067b	finish settings	2020-02-11 15:27:57 +01:00
Quentin de Quelen	dbba310770	squash me	2020-02-11 15:27:57 +01:00
Quentin de Quelen	6deb481589	definitely remove attributes_ranked on settings; auto create it with ranking_rules	2020-02-11 15:27:57 +01:00
Quentin de Quelen	036977bfe4	add the possibility to totally clear the schema	2020-02-11 15:27:57 +01:00
Quentin de Quelen	7a6f583b1f	fix issue on ranking rules	2020-02-11 15:27:56 +01:00
Quentin de Quelen	e078eafb1f	clean unused functions	2020-02-11 15:27:56 +01:00
Quentin de Quelen	6f534540a6	fix error on stop words fst	2020-02-11 15:27:56 +01:00
qdequele	38d57d213f	expose api for new settings	2020-02-11 15:27:56 +01:00
qdequele	ae0a11e422	fix schema & fix tests	2020-02-11 15:27:55 +01:00
qdequele	a35eb16a2a	store the schema after each document updates	2020-02-11 15:27:54 +01:00
qdequele	4f0ead625b	adapt meilisearch-http to the new schemaless option	2020-02-11 15:27:54 +01:00
qdequele	21d122a870	rewrite indexed_pos -> field_id for hightligths	2020-02-11 15:27:54 +01:00
qdequele	130fb74928	introduce a new schemaless way	2020-02-11 15:27:54 +01:00
qdequele	bbe1845f66	squash-me	2020-02-11 15:27:54 +01:00
qdequele	2ee90a891c	introduce a new settings update system	2020-02-11 15:27:54 +01:00
qdequele	110adcae85	Remove the schema; fix #422	2020-02-11 15:27:53 +01:00
qdequele	91c6539baf	Rewrite the stop-words endpoint; fix #417	2020-02-11 15:27:53 +01:00
qdequele	f0590d3301	Change documents routes; fix #416	2020-02-11 15:27:53 +01:00
Clément Renault	7c0d8f073b	Support compaction with multi database	2020-01-24 17:38:14 +01:00
Clément Renault	a2bc689b92	Fix the tests a little bit	2020-01-22 18:12:56 +01:00
Clément Renault	a9adbda2cd	Make the engine support non-exact multi-words synonyms	2020-01-22 18:11:58 +01:00
Clément Renault	0b9fe2c072	Introduce the new Query Tree creation supporting more operations	2020-01-22 17:46:46 +01:00
Clément Renault	789e05304c	Replace prints by debug logs	2020-01-21 11:05:34 +01:00
Clément Renault	7604387701	Clean up the dependencies	2020-01-21 11:04:25 +01:00
Clément Renault	daffcaf4c6	Make the docids OR operation method conditional	2020-01-19 12:29:06 +01:00
Clément Renault	ff1ec599e0	Try a better version of sdset	2020-01-19 12:01:24 +01:00
Clément Renault	e44d498c94	Display more debug info for prefix tolerant fetches	2020-01-19 11:07:32 +01:00
Clément Renault	c334d6b7fe	Avoid sorting sorted sequences, prefer using set operations	2020-01-19 10:58:01 +01:00
Clément Renault	5465e401bb	Catch query tree related errors	2020-01-17 10:41:27 +01:00
Clément Renault	9cc3c56c9c	Fix the prefix system	2020-01-16 18:41:27 +01:00
Clément Renault	d7a7560220	Use an union instead of a sort for prefix fetching	2020-01-16 17:09:27 +01:00
Clément Renault	70a529d197	Reduce the number of args of update functions	2020-01-16 16:29:50 +01:00
Clément Renault	be31a14326	Make the clear all operation clear caches	2020-01-16 16:19:04 +01:00
Clément Renault	96139da0d2	Reintroduce the distinct search system	2020-01-16 15:55:55 +01:00
Clément Renault	74fa9ee4df	Introduce a better higlighting system	2020-01-16 14:56:16 +01:00
Clément Renault	00336c5154	Reintroduce a basic highlight display	2020-01-16 14:24:45 +01:00
Clément Renault	3912d1ec4b	Improve query parsing and interpretation	2020-01-16 14:11:17 +01:00
Clément Renault	70d4f47f37	Differentiate short words as prefix or exact matches	2020-01-16 12:01:51 +01:00
Clément Renault	9809ded23d	Implement synonym fetching	2020-01-16 11:38:23 +01:00
Clément Renault	5f9a3546e0	Use an union instead of a sort for OR ops	2020-01-15 15:14:24 +01:00
Clément Renault	db625a08f7	Update lock file	2020-01-15 12:25:14 +01:00
Clément Renault	44fec1b6c9	Cache prefixes of a length of 2	2020-01-14 18:17:52 +01:00
Clément Renault	54dacb362d	Use different algorithms for different documents ratios	2020-01-14 17:51:08 +01:00
Clément Renault	6edb460bea	Try with an exponential search	2020-01-14 16:52:24 +01:00
Clément Renault	40dab80dfa	Change the way we filter the documents	2020-01-14 14:18:01 +01:00
Clément Renault	681711fced	Fix query ids to be usize	2020-01-14 13:12:42 +01:00
Clément Renault	21c1473e0c	Introduce the distance data	2020-01-14 11:38:04 +01:00
Clément Renault	8acbdcbbad	wip: Make the new query tree work with the criteria	2020-01-13 14:36:06 +01:00
Clément Renault	da8abebfa2	Introduce the query words mapping along with the query tree	2020-01-13 13:29:47 +01:00
Clément Renault	4f7a7ea0bb	Faster intersection group by	2020-01-09 16:30:03 +01:00
Clément Renault	d6c9ba8f08	Store the postings lists	2020-01-09 15:04:53 +01:00
Clément Renault	ec8916bf54	Change the debug outputs	2020-01-09 12:05:39 +01:00
Clément Renault	81c573ec92	Add the raw document IDs to the postings lists	2020-01-08 15:30:43 +01:00
Clément Renault	9420edadf4	Introduce the Postings type to decorrelate the DocumentIds	2020-01-08 14:48:23 +01:00
Clément Renault	d724a7659e	Introduce a query tree context struct	2020-01-08 13:37:22 +01:00
Clément Renault	887c212b49	Add more logs about the docids construction	2020-01-08 13:22:42 +01:00
Clément Renault	07937ed6d7	Use the prefix caches	2020-01-08 13:14:07 +01:00