Ingest the provided files from Integrated Data Lake (IDL) to SDI.

POST {{baseUrl}}/dataIngestJobs

Initiate the data ingestion using the provided input files. Following modes of data ingestion are supported,

Bulk ingest: User can specify ingestType=BULK to initiate bulk file ingestion from MindSphere Integrated Data Lake (IDL) to SDI. * In this mode, SDI reads pre-existing files from IDL. * The ingestion is applicable to an existing data registry which is specified with sourceName and dataTag attributes. * The registry must have schema present and the schemaFrozen flag on the registry must be set to true. * The fileType must be CSV or PARQUET. * The ingestPaths is an array of folder paths in the IDL. For bulk ingestion, upto 10 folder paths can be specified.

Request Body

{"sourceName"=>"<string>", "dataTag"=>"<string>", "jobDetails"=>{"fileType"=>"<string>", "ingestPaths"=>["<string>", "<string>"]}, "ingestType"=>"<string>"}

HEADERS

RESPONSES

status: Created

{"id":"eiusmod","startedDate":"amet ea","finishedDate":"minim anim dolor","ingestType":"cupidatat proident et","ingestPaths":["Excepteur commodo","non ex officia ut"],"message":"et est","status":"ERROR"}