Commit Graph

126 Commits

Author SHA1 Message Date
Clément Renault
1d67012aa5
chore: Clean up some database functions 2019-01-01 01:40:20 +01:00
Clément Renault
7845292ea8
chore: Clippy pass 2018-12-31 23:20:30 +01:00
Clément Renault
dfa19582a2
test: Add benchmarks to mesure the words proximity criterion 2018-12-31 21:18:42 +01:00
Clément Renault
87ec95f7a0
test: Add benchmarks to mesure the database 2018-12-31 21:18:37 +01:00
Clément Renault
20b5a6a06e
doc: Add examples for runtime defined data and Schema 2018-12-31 20:44:33 +01:00
Clément Renault
21bb38c3b0
test: Add more tests for updates ingestion 2018-12-31 19:27:21 +01:00
Clément Renault
64d53ee1bd
chore: Rework the data module structures
being able to be constructed from SharedData
2018-12-31 19:27:21 +01:00
Clément Renault
c022fa3fca
chore: Move serde related structs to their module 2018-12-31 19:26:28 +01:00
Clément Renault
0080bf486f
feat: Introduce the new Index structure
replacing the old ugly Blob system
2018-12-31 19:26:27 +01:00
Clément Renault
6bd779f9ae
feat: Improve the deserialization time of a Blob 2018-12-31 13:15:37 +01:00
Clément Renault
7132c3be89
feat: Allow filtering on QueryBuilder 2018-12-29 22:30:41 +01:00
Clément Renault
aa3d059363
feat: Allow filtering on DistinctQueryBuilder 2018-12-29 22:30:41 +01:00
Clément Renault
e2a9dbc404
feat: Introduce filtering methods for Distinct/QueryBuilder 2018-12-29 22:30:40 +01:00
Clément Renault
36ef9581aa
feat: Return the database view for each update 2018-12-29 21:07:01 +01:00
Clément Renault
f4b04dfb72
feat: Prefer doing DatabaseView updates atomically 2018-12-29 20:52:00 +01:00
Clément Renault
8412c14b5b
feat: Schema can be toml de/serialized 2018-12-28 19:24:50 +01:00
Clément Renault
b27f632e14
feat: Make the Attribute and WordArea errors recoverable 2018-12-28 16:15:22 +01:00
Clément Renault
fa238f21ef
feat: Move Database to its own module 2018-12-27 11:21:47 +01:00
Clément Renault
444a4c1af7
feat: Make the schema consider document ids 2018-12-27 11:21:47 +01:00
Clément Renault
b32c96cdc9
feat: Introduce a WordArea struct
Useful to highlight matching areas in the original text.
2018-12-24 15:58:46 +01:00
Clément Renault
4ebae7784c
feat: Create a strong DocumentId type
Forcing it to be something internal will permit to avoid possible miss comparisons to be done with other types.
2018-12-24 12:42:24 +01:00
Clément Renault
4a310c31ab
feat: Allow query distinct a range of documents 2018-12-18 14:00:30 +01:00
Clément Renault
d0ee5f12a0
feat: Introduce the BufferedDistinctMap struct 2018-12-18 14:00:30 +01:00
Clément Renault
7aafba67ed
feat: Allow querying a range of documents 2018-12-18 14:00:29 +01:00
Clément Renault
89c4af0cc2
chore: Clean up dependencies and avoid custom ones 2018-12-17 16:02:20 +01:00
Clément Renault
cdce016f7c
feat: Improve the Schema performances 2018-12-15 21:17:55 +01:00
Clément Renault
e15d5e6d93
feat: Improve the query distinct performances 2018-12-13 11:54:47 +01:00
Clément Renault
d3a67476e0
feat: Rename registers methods of DistinctMap 2018-12-13 11:54:09 +01:00
Clément Renault
5a2d8a2395
feat: Reexport the internal rocksdb 2018-12-13 11:52:34 +01:00
Clément Renault
df2b6a3e74
feat: Consider the last query word be a prefix
if the last word is not followed by a space.
2018-12-11 17:43:27 +01:00
Clément Renault
b5df87a403
feat: Introduce the Criteria type 2018-12-10 20:17:57 +01:00
Clément Renault
d615f89c56
feat: Introduce the SortBy help structure
This structure help ranking documents using stored attributes.
2018-12-10 20:17:52 +01:00
Clément Renault
23cce69dc5
feat: Introduce the CriteriaBuilder 2018-12-10 20:15:02 +01:00
Clément Renault
671bd3374f
fix: Break the proper loop when bucket sorting 2018-12-10 15:14:15 +01:00
Clément Renault
d8cfac914a
feat: Implement a better automaton builder
This new implementation only allows the last word of a query string to be a prefix.
2018-12-10 12:16:24 +01:00
Clément Renault
916b46c839
feat: Allow dumping the database, useful for full snapshot 2018-12-10 11:09:09 +01:00
Clément Renault
6cb1bfd815
feat: Use sdset Set primitives everywhere possible 2018-12-09 14:18:23 +01:00
Clément Renault
06ba82cfa8
feat: Database holds a DatabaseView and sync update ingestions 2018-12-09 13:42:56 +01:00
Clément Renault
0e825e05bb
feat: Make the DatabaseView become Sync + Send 2018-12-07 17:59:03 +01:00
Clément Renault
bec463a61a
fix: Update the DatabaseView to retrieve the index at creation
remove this computation from the QueryBuilder
2018-12-07 16:29:39 +01:00
Clément Renault
7c98771068
fix: Change the way the iterator upper bound is computed 2018-12-07 15:35:59 +01:00
Clément Renault
4626c77eac
fix: Change the way the BTreeMap store entries 2018-12-07 15:12:15 +01:00
Clément Renault
9342290afe
feat: Simplify the steps to query the database 2018-12-07 14:41:06 +01:00
Clément Renault
8bee31078d
chore: Update the module hierarchy 2018-12-07 12:22:51 +01:00
Clément Renault
2c3d71dd8f
fix: Improve the bucket sort algorithm 2018-12-07 11:53:17 +01:00
Clément Renault
731ed11153
feat: Index and store/serialize attributes while creating the update 2018-12-07 11:32:27 +01:00
Clément Renault
442834c28f
chore: Remove the MapSerializer temporarily 2018-12-06 17:23:01 +01:00
Clément Renault
b2cec98805
feat: Implemented a basic deserialiazation 2018-12-06 17:22:54 +01:00
Clément Renault
6c7a6c5219
feat: Implement DoubleEnded/ExactSizeIterator on DocumentIter 2018-12-06 17:22:25 +01:00
Clément Renault
6f8dbbde9a
feat: Implement the create/open/ingest_file Database methods 2018-12-06 17:22:20 +01:00