Skip to main content

Single Pipeline Approach

Workflow - Single Pipeline Approach

  1. Single Pipeline Approach is the procedural scripting.
  2. Every workflow has only one (1) task of main function which is registered and started in the celery
  3. main function
    1. Registered as a task
    2. main(self, task_name="main", *args, **kwargs) -> (status:str, err_msgs:list[str], data:object)
    3. the function intended to define the sequence of the functions for execution. 
    4. has the access to credentials
    5. receives the payload
    6. must verify that the payload provided is correct: right types and values, all other functions assume that payload is correct
  4. other functions
    1. assume the payload is correct
    2. other arguments are not guaranteed to be valid 
    3. Every other(self, task_name, *args, **kwargs) -> (status:str, err_msgs:list[str], data:object)
  5. Create of the new entities MUST be done through platforms tasks
  6. APIAll callsnetwork andrelated, otherresource concurrent or security dependent operations that may have systematic execution errors MUST use try_retry decorator
  7. Errors must be collected through ALL execution of the steps in main and be handled to Notifications.
  8. status for function must be from ["success", "error"]
  9. err_msgs for function must be from ["success", "error"]