[jira] [Commented] (FLINK-898) Clean up distribution default config

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
Report Content as Inappropriate

[jira] [Commented] (FLINK-898) Clean up distribution default config

JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/FLINK-898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027133#comment-14027133 ]

Robert Metzger commented on FLINK-898:

I agree with [~StephanEwen] to add the ports to the config. I just had contact with a user who ran into an issue with ports, so it should be very obvious to change them.

I would order the configuration values by their importance. So the _taskmanager.heap.mb_ to the top (this is crucial for anything), secondly, the tmp.dirs, then the hadoopconf.
We should also see if it is possible to detect more stuff automatically, up to the point where the system runs automatically in a cluster (the TMs detect the JM address, the TMs allocate 70% of the system memory etc.) to boost user experience.
I just saw too many Flink users in the past that did not care about setting up a proper configuration.

> Clean up distribution default config
> ------------------------------------
>                 Key: FLINK-898
>                 URL: https://issues.apache.org/jira/browse/FLINK-898
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: GitHub Import
>              Labels: github-import
>             Fix For: pre-apache
> Just a small remark: I vote to simplify the default config we ship, because it gives the impression that you actually have to configure a lot of stuff. See [https://github.com/stratosphere/stratosphere/blob/master/stratosphere-dist/src/main/stratosphere-bin/conf/stratosphere-conf.yaml|https://github.com/stratosphere/stratosphere/blob/master/stratosphere-dist/src/main/stratosphere-bin/conf/stratosphere-conf.yaml].
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/issues/898
> Created by: [uce|https://github.com/uce]
> Labels: enhancement,
> Created at: Mon Jun 02 15:44:54 CEST 2014
> State: open

This message was sent by Atlassian JIRA