1 Release published by 1 person

• v0.6.0-rc0 v0.6.0

  published May 22, 2025

8 Pull requests opened by 8 people

• [DRAFT] [FEATURE] Inverted index based reduce partition data writer / reader

  #3279 opened May 25, 2025

• [CELEBORN-1413][FOLLOWUP] Bump spark 4.0 version to 4.0.0

  #3282 opened May 26, 2025

• [CELEBORN-2014] updateInterruptionNotice REST API

  #3285 opened May 26, 2025

• [CELEBORN-3288] Fix Deserialization Vulnerability

  #3288 opened May 26, 2025

• [CELEBORN-2003] Add retry mechanism when completing S3 multipart upload

  #3293 opened May 27, 2025

• [CELEBORN-2016] Add cooldown time in worker shutdown

  #3294 opened May 27, 2025

• [CELEBORN-2017][HELM] Add namespace to the metadata

  #3295 opened May 28, 2025

• [CELEBORN-2005][FOLLOWUP] Introduce ShuffleMetricGroup for numBytesIn, numBytesOut, numRecordsOut, numBytesInPerSecond, numBytesOutPerSecond, numRecordsOutPerSecond metrics

  #3296 opened May 28, 2025

14 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [CELEBORN-894] End to End Integrity Checks

  #3261 commented on May 28, 2025 • 16 new comments

• Who is using Apache Celeborn?

  #2140 commented on May 27, 2025 • 0 new comments

• [CELEBORN-894] Add checksum for shuffle data

  #2979 commented on May 26, 2025 • 0 new comments

• [CELEBORN-1768][WRITER] Refactoring Shuffle Writer to extract common methods

  #2985 commented on May 26, 2025 • 0 new comments

• [CELEBORN-1903] Enable connection heartbeat and close idle connection

  #3148 commented on May 26, 2025 • 0 new comments

• CELEBORN-1334 [CIP-12] Support HARD_SPLIT in PushMergedData should not support new version client with old version worker

  #3171 commented on May 26, 2025 • 0 new comments

• Set max memory of SortBasedPusher based off Spark configs

  #3203 commented on May 26, 2025 • 0 new comments

• [RFT] Enable run java UT (not a formal PR, just for discussion purposes)

  #3219 commented on May 26, 2025 • 0 new comments

• [CELEBORN-1841][FOLLOWUP] Support custom implementation of EventExecutorChooser to avoid deadlock when calling await in EventLoop thread for EpollEventLoopGroup

  #3220 commented on May 26, 2025 • 0 new comments

• [CELEBORN-1984] Merge ResourceRequest to transportMessageProtobuf

  #3231 commented on May 26, 2025 • 0 new comments

• CELEBORN-1991: add retries for registerShuffle on the lifecycleManager

  #3238 commented on May 26, 2025 • 0 new comments

• [CELEBORN-1917] supports celeborn.client.push.maxBytesSizeInFlight

  #3248 commented on May 27, 2025 • 0 new comments

• [CELEBORN-1997] RemoteShuffleInputGateDelegation should regard CelebornIOException as data consumption error for RestartPipelinedRegionFailoverStrategy

  #3256 commented on May 26, 2025 • 0 new comments

• [WIP] Dynamically adjust partition write parallelism

  #3260 commented on May 26, 2025 • 0 new comments