Skip to content

Commit

Permalink
[CELEBORN-1504][FOLLOWUP] Start test nodes in random ports to allow m…
Browse files Browse the repository at this point in the history
…ultiple builds run in the same ci server

### What changes were proposed in this pull request?

Start test nodes in random ports to allow multiple builds run in the same ci server, which improves the test implementations so that it starts test nodes in random ports instead of using the hardcoded ones.

Follow up #2619.

### Why are the changes needed?

The test nodes are started in the hard coded ports, this prevents to run multiple builds in the same CI/CD server at present.

Bump the changes of #2237.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

`RemoteShuffleMasterSuiteJ`

Closes #2902 from SteNicholas/CELEBORN-1504.

Authored-by: SteNicholas <programgeek@163.com>
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
  • Loading branch information
SteNicholas authored and FMX committed Nov 11, 2024
1 parent 169b6f6 commit 8b54ed8
Showing 1 changed file with 6 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -53,17 +53,21 @@
import org.slf4j.LoggerFactory;

import org.apache.celeborn.common.CelebornConf;
import org.apache.celeborn.common.util.Utils$;
import org.apache.celeborn.plugin.flink.utils.FlinkUtils;

public class RemoteShuffleMasterTest {
public class RemoteShuffleMasterSuiteJ {

private static final Logger LOG = LoggerFactory.getLogger(RemoteShuffleMasterTest.class);
private static final Logger LOG = LoggerFactory.getLogger(RemoteShuffleMasterSuiteJ.class);
private RemoteShuffleMaster remoteShuffleMaster;
private Configuration configuration;

@Before
public void setUp() {
configuration = new Configuration();
int startPort = Utils$.MODULE$.selectRandomPort(1024, 65535);
configuration.setInteger("celeborn.master.port", startPort);
configuration.setString("celeborn.master.endpoints", "localhost:" + startPort);
remoteShuffleMaster = createShuffleMaster(configuration);
}

Expand Down

0 comments on commit 8b54ed8

Please sign in to comment.