[jira] [Created] (FLINK-6949) Make custom resource files to be shipped to YARN cluster

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-6949) Make custom resource files to be shipped to YARN cluster

JIRA jira@apache.org
Mikhail Pryakhin created FLINK-6949:
---------------------------------------

             Summary: Make custom resource files to be shipped to YARN cluster
                 Key: FLINK-6949
                 URL: https://issues.apache.org/jira/browse/FLINK-6949
             Project: Flink
          Issue Type: Improvement
          Components: Client
    Affects Versions: 1.3.0
            Reporter: Mikhail Pryakhin


*The problem:*
When deploying a flink job on YARN it is not possible to specify custom resource files to be shipped to YARN cluster.
 
*The use case description:*
When running a flink job on multiple environments it becomes necessary to pass environment-related configuration files to the job's runtime. It can be accomplished by packaging configuration files within the job's jar. But having tens of different environments one can easily end up packaging as many jar as there are environments. It would be great to have an ability to separate configuration files from the job artifacts.
 
*The possible solution:*
add the --yarnship-files option to flink cli to specify files that should be shipped to the YARN cluster.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)