Skip to content

Spark Plugin for docker based solution #6

@sopaoglu

Description

@sopaoglu

I have airflow and spark clusters. The cluster is built by docker swarm. I am using "puckel/docker-airflow" image in my airflow cluster and I want to submit spark job from airflow container which does not container spark-submit, to spark master container. How can I configure your plugin?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions