3 Commits

Author	SHA1	Message	Date
Clément Renault	a7a4984175	Introduce the Transform type into the indexing system	2020-10-24 17:06:09 +02:00
Clément Renault	b44b04d25b	Serialize the CSV record values as JSON strings	2020-10-24 14:43:46 +02:00
Clément Renault	656a851830	Introduce the Transform struct transforming CSVs ... This allows us to: - transform a CSV, a JSON or a JSON lines data type into the same Grenad x Obkv streamable data type and creates the new FieldsIdsMap. - Extract all the documents user ids in advance to be able to delete the existing documents before re-indexing them. - Keep the last documents with the same user id avoiding duplicates in the same request.	2020-10-24 13:37:38 +02:00