50 Commits

Author SHA1 Message Date
Clément Renault
337aee5b65
chore: Emit warnings when a document id is reused 2019-01-28 16:11:55 +01:00
Clément Renault
94d357985f
feat: Remove the manual compaction triggering 2019-01-25 16:05:56 +01:00
Clément Renault
aa9db14c09
chore: Display index loading times 2019-01-23 11:19:44 +01:00
Clément Renault
1316be5b09
chore: Display timings of indexation operations 2019-01-16 11:45:33 +01:00
Quentin de Quelen
fa062ce2cf feat: Schema can be de/serialized from a json format 2019-01-12 21:05:48 +01:00
Clément Renault
ac347d788c
feat: Make multiple document updates shadow themselves 2019-01-10 15:25:24 +01:00
Clément Renault
b53ef08d05
feat: Make WordArea be based on char index and length 2019-01-09 20:14:08 +01:00
Clément Renault
de59ea495d
feat: Log some update steps 2019-01-06 22:49:12 +01:00
Clément Renault
32f8908d71
feat: Reintroduce stopwords for the serializer 2019-01-06 22:49:11 +01:00
Clément Renault
7f5e6c5b6e
test: Add test to the DocumentKeyAttr slice repr 2019-01-02 21:48:58 +01:00
Clément Renault
c05fab783a
fix: Write and Read DocumentKeyAttr in big endian 2019-01-02 17:53:53 +01:00
Clément Renault
95dc6fe904
feat: Rework the UpdateBuilder struct 2019-01-02 17:53:52 +01:00
Clément Renault
1d67012aa5
chore: Clean up some database functions 2019-01-01 01:40:20 +01:00
Clément Renault
7845292ea8
chore: Clippy pass 2018-12-31 23:20:30 +01:00
Clément Renault
87ec95f7a0
test: Add benchmarks to mesure the database 2018-12-31 21:18:37 +01:00
Clément Renault
21bb38c3b0
test: Add more tests for updates ingestion 2018-12-31 19:27:21 +01:00
Clément Renault
64d53ee1bd
chore: Rework the data module structures
being able to be constructed from SharedData
2018-12-31 19:27:21 +01:00
Clément Renault
c022fa3fca
chore: Move serde related structs to their module 2018-12-31 19:26:28 +01:00
Clément Renault
0080bf486f
feat: Introduce the new Index structure
replacing the old ugly Blob system
2018-12-31 19:26:27 +01:00
Clément Renault
6bd779f9ae
feat: Improve the deserialization time of a Blob 2018-12-31 13:15:37 +01:00
Clément Renault
e2a9dbc404
feat: Introduce filtering methods for Distinct/QueryBuilder 2018-12-29 22:30:40 +01:00
Clément Renault
36ef9581aa
feat: Return the database view for each update 2018-12-29 21:07:01 +01:00
Clément Renault
f4b04dfb72
feat: Prefer doing DatabaseView updates atomically 2018-12-29 20:52:00 +01:00
Clément Renault
8412c14b5b
feat: Schema can be toml de/serialized 2018-12-28 19:24:50 +01:00
Clément Renault
b27f632e14
feat: Make the Attribute and WordArea errors recoverable 2018-12-28 16:15:22 +01:00
Clément Renault
fa238f21ef
feat: Move Database to its own module 2018-12-27 11:21:47 +01:00
Clément Renault
444a4c1af7
feat: Make the schema consider document ids 2018-12-27 11:21:47 +01:00
Clément Renault
b32c96cdc9
feat: Introduce a WordArea struct
Useful to highlight matching areas in the original text.
2018-12-24 15:58:46 +01:00
Clément Renault
4ebae7784c
feat: Create a strong DocumentId type
Forcing it to be something internal will permit to avoid possible miss comparisons to be done with other types.
2018-12-24 12:42:24 +01:00
Clément Renault
cdce016f7c
feat: Improve the Schema performances 2018-12-15 21:17:55 +01:00
Clément Renault
b5df87a403
feat: Introduce the Criteria type 2018-12-10 20:17:57 +01:00
Clément Renault
916b46c839
feat: Allow dumping the database, useful for full snapshot 2018-12-10 11:09:09 +01:00
Clément Renault
6cb1bfd815
feat: Use sdset Set primitives everywhere possible 2018-12-09 14:18:23 +01:00
Clément Renault
06ba82cfa8
feat: Database holds a DatabaseView and sync update ingestions 2018-12-09 13:42:56 +01:00
Clément Renault
0e825e05bb
feat: Make the DatabaseView become Sync + Send 2018-12-07 17:59:03 +01:00
Clément Renault
bec463a61a
fix: Update the DatabaseView to retrieve the index at creation
remove this computation from the QueryBuilder
2018-12-07 16:29:39 +01:00
Clément Renault
7c98771068
fix: Change the way the iterator upper bound is computed 2018-12-07 15:35:59 +01:00
Clément Renault
4626c77eac
fix: Change the way the BTreeMap store entries 2018-12-07 15:12:15 +01:00
Clément Renault
9342290afe
feat: Simplify the steps to query the database 2018-12-07 14:41:06 +01:00
Clément Renault
8bee31078d
chore: Update the module hierarchy 2018-12-07 12:22:51 +01:00
Clément Renault
731ed11153
feat: Index and store/serialize attributes while creating the update 2018-12-07 11:32:27 +01:00
Clément Renault
442834c28f
chore: Remove the MapSerializer temporarily 2018-12-06 17:23:01 +01:00
Clément Renault
b2cec98805
feat: Implemented a basic deserialiazation 2018-12-06 17:22:54 +01:00
Clément Renault
6c7a6c5219
feat: Implement DoubleEnded/ExactSizeIterator on DocumentIter 2018-12-06 17:22:25 +01:00
Clément Renault
6f8dbbde9a
feat: Implement the create/open/ingest_file Database methods 2018-12-06 17:22:20 +01:00
Clément Renault
42b0cf68eb
feat: Move the database Deserializer in its own module 2018-12-06 17:22:19 +01:00
Clément Renault
a5b80c72ae
feat: Move the DatabaseView in its own module 2018-12-06 17:22:19 +01:00
Clément Renault
8563c25d62
feat: Move DocumentKey/Attr to their own module 2018-12-06 17:22:19 +01:00
Clément Renault
3d0b334942
feat: Introduce the DocumentKey and DocumentKeyAttr structs 2018-12-06 17:22:07 +01:00
Clément Renault
700d625c93
feat: Introduce the Database and DatabaseView 2018-12-06 17:20:14 +01:00