Explanation of DataHub publishing flow from client and back-end perspectives.
Diagram for upload process
Context: where this pipeline fits in the system
Publishing flow takes the following steps and processes to communicate with DataHub API:
- Upload API - see
POST /source/uploadin source section of API
- Authentication API - see
GET /auth/checkin auth section of API.
- Authorization API - see
GET /auth/authorizein auth section of API.
See example code snippet in DataHub CLI