Skip to main content

Workflow

Workflow Manager Documentation

Overview

user_code:User Code: com.finmars.standard-workflow:workflow-manager
payload: optionalPayload: Optional

ВоркфлоуThe менеджерWorkflow предназначенManager дляis запускаdesigned воркеровto вexecute требуемоемworkers порядкеin сa определеннымspecific order with a defined payload. Its primary use case is when no payload is provided.

Основной

Workflow сценарийManager использования воркфлоу менеджера предназачен при отсутствии payload.

Сценарий его работы:

Operation

  1. ПрочитатьRead илиor создатьcreate файлthe /states/global\_state\_manager.global_state_manager.json file
  2. ПрочитатьRead всеall jsonJSON менеджеровmanager вfiles in /states/managers
  3. ПрочитатьRead статусthe выполненияexecution каждогоstatus менеджераof изeach поляmanager from the "status" вfield соотетствующемin jsonthe corresponding JSON
  4. РаспределитьCategorize стейтstate файлыfiles поby статусамstatus вin видеa словаряdictionary format:
{
    "to-do": [],
    "in-progress": [
        "com.finmars.standard-workflow:workflow-manager-20240821095322.json"
    ],
    "done": [
        "com.finmars.standard-workflow:workflow-manager-20240724101635.json",
        "com.finmars.standard-workflow:workflow-manager-20240724104102.json"
    ],
    "paused": []
}
  1. ЗапуститьExecute логикуthe обработкиlogic данныхfor стейт-файловЛогикаprocessing обработкиthese global_state_manager.jsonstate files

Global State Manager Processing Logic

  1. ПопытатьсяAttempt прочитатьto файлread the global_state_manager.json. Еслиfile. нет,If тоit создатьdoesn't его.exist, create it.
  2. ПрочитатьRead списокthe файловlist изof files from /states/managers/.
  3. РаспределитьCategorize поby статусамstatus иand сохранитьsave вin global_state_manager.json:
    • ЕслиIf файлаthe нет,file тоdoesn't добавитьexist, вadd to_doit to "to-do"
    • ЕслиIf вit's in "to-do,do", тоchange сменитьthe статусstatus наto "in-progressprogress"
    • ЕслиIf файлthe есть,file тоexists, обновитьupdate статусits status
  4. ПрочитатьRead содержимоеthe файлаcontents изof the file in "in-progressprogress" Логика обработки загруженного стейта файла менеджераstatus

Interaction


with global_state_manager.json

The global_state_manager.json file serves as a central registry for all workflow states in the system:

  1. Initialization: If global_state_manager.json doesn't exist, it's created by scanning the /states/managers/ directory and categorizing all existing state manager files.

  2. Retrieval: The existing global_state_manager.json is loaded and its data is updated.

  3. Updating: The global state manager is updated by:

    • Identifying and adding new state manager files to the "in-progress" category
    • Checking and updating the status of each tracked state manager file
    • Moving state managers between categories based on their current status

  4. Saving: After updates, the modified global_state_manager.json is saved back to storage.

  5. Workflow Processing: The main workflow_manager function uses data from global_state_manager.json to determine which state managers to process when no specific payload is provided.

State Managers and Workers/Items Interaction

Each state manager file represents an individual workflow instance, containing information about its workers and their respective items (tasks):

  1. Loading: Individual state manager files are loaded based on paths stored in global_state_manager.json or provided in the payload.

  2. Status Propagation: Each worker's status is updated based on the statuses of its items.

  3. Worker Processing: For each worker in a state manager:

    • Skipped if status is 'success', 'skip', or 'ignore'
    • If 'in-progress', each item's status is checked:
      • 'in-progress' items: latest state is fetched and updated
      • 'to-do' items: a new workflow is initiated
    • If 'to-do', processing starts with the first 'to-do' item

  4. Item State Management: Each item within a worker has its own state, including a state_path used to fetch and update item-specific states.

  5. Workflow Initiation: New items are processed by calling the start_workflow function with the appropriate user code and payload.

  6. State Updating: After any changes, the modified state manager is saved back to its file.

Back to top