Skip to content

How the library works and is clustering supported? #62

@ngocdaothanh

Description

@ngocdaothanh

Please update the README:

  • To outline how the library works.
  • To clarify if clustering is supported or not.

After reading the source code:

I guess clustering (running tasks on many machines) is not supported yet, because:

  • On startup, all running tasks are forcefully resumed. The code doesn't care that the tasks may be being taken by other machines.
  • When taking new tasks, the code only care about newly inserted tasks. It doesn't care about the tasks that have been marked as taken by other machines, but other machines may have died.

To support clustering with "at least once" semantic, these little modifications can be made ("little" compared to the existing great work):

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions