All pull requests

Pull requests

• [SPARK-59791][BUILD] Add (mostly optional) pre-push checks to the merge script & option for full CI via backport PRs

  ai-review-requested
  #59899·holdenk opened Oct 29, 2026Contributor·

  ·

• [BACKPORT-4.x][SPARK-59091][SQL] Emit the NaN guard in transpiled equality only for floating-point columns

  ai-review-requested
  #59898·holdenk opened Oct 28, 2026Contributor·

  ·

• [SPARK-60669][BUILD][INFRA][DOC] Drop Java 17 Support

  #59897·dongjoon-hyun opened Oct 28, 2026Member·

  ·
  8

• [SPARK-60668][SQL] Treat target metadata columns as outer references in the runtime group filter of DSv2 MERGE

  #59896·dongjoon-hyun opened Oct 28, 2026Member·

  ·
  2

• [SPARK-60667][SQL] Do not add metadata columns to the target table of DSv2 DELETE, UPDATE and MERGE

  #59895·dongjoon-hyun opened Oct 28, 2026Member·

  ·
  4

• [SPARK-60665][SS] Respect the partitioning of an existing V1 table in DataStreamWriter.toTable

  #59894·dongjoon-hyun opened Oct 28, 2026Member·

  ·
  4

• [SPARK-60664][SQL] Remap metadata columns in runtime group filters of group-based UPDATE with subqueries

  #59893·dongjoon-hyun opened Oct 28, 2026Member·

  ·
  4

• [SPARK-60663][SQL][PYTHON] Add detailed timing metrics for mapInPandas

  #59892·Spenserrrr opened Oct 28, 2026Contributor·

  ·
  4

• [SPARK-60652][SQL] Refresh every matching file index in a cached plan when refreshing a path

  #59890·linhongliu-db opened Oct 28, 2026Contributor·

  ·
  3

• [SPARK-60651][SQL] Allow decimal remainders with integral quotients wider than the math context

  #59889·linhongliu-db opened Oct 28, 2026Contributor·

  ·
  3

• [SPARK-60611][DOCS][CONNECT] Add a Spark Connect programming guide

  #59888·lisancao opened Oct 28, 2026Contributor·

  ·

• [SPARK-60642][SQL] Support collated strings in the Hive ORC data source writer

  #59887·dongjoon-hyun opened Oct 28, 2026Member·

  ·
  4

• [SPARK-59417][SQL][FOLLOWUP] Report a malformed streamed JSON array element as its own record

  #59886·tdcmeehan opened Oct 28, 2026Contributor·

  ·

• [SPARK-60048][SQL] Remember a whole-stage codegen split decision by a key that ignores literal values

  #59885·vboo123 opened Oct 28, 2026Contributor·

  ·

• [SPARK-60636][SQL] Use SQL signed-zero equality in constant-map hash lookups

  #59883·linhongliu-db opened Oct 28, 2026Contributor·

  ·
  1

• [SPARK-60635][SQL] Isolate mutable number-format parsers in expression copies

  #59882·linhongliu-db opened Oct 28, 2026Contributor·

  ·
  3

• [SPARK-60634][SQL] Give copied UUID expressions independent random generators

  #59881·linhongliu-db opened Oct 28, 2026Contributor·

  ·
  3

• [SPARK-60632][SQL] Fix the LIKE/RLIKE expensive heuristic to look at the pattern

  #59879·viirya opened Oct 28, 2026Member·

  ·
  28

• [SPARK-55239][CONNECT][KUBERNETES] Allow to launch SparkConnectServer in KUBERNETES cluster mode

  #59878·hiboyang opened Oct 28, 2026·

  ·
  7

• [SPARK-60624][SQL] Analyze SQL script cursors in parse_sql

  #59876·srielau opened Oct 28, 2026Contributor·

  ·
  19

• [SPARK-60623][SQL] Describe nested statements of SQL scripts in parse_sql

  #59875·srielau opened Oct 28, 2026Contributor·

  ·
  19

• [SPARK-60622][SQL] Support caller-supplied context and batch carry-forward in parse_sql ANALYZE

  #59874·srielau opened Oct 28, 2026Contributor·

  ·
  16

• [SPARK-60621][SQL] Add ANALYZE mode to parse_sql

  #59873·srielau opened Oct 28, 2026Contributor·

  ·
  17

• [SPARK-60627][SQL] Do not slice an Arrow batch whose slice positions overflow int in SliceRecordsArrowOutputProcessorImpl

  #59871·dongjoon-hyun opened Oct 28, 2026Member·

  ·
  15

• [SPARK-60625][SQL] Separate session-catalog SHOW goldens from V2 catalog coverage

  #59869·vladanvasi-db opened Oct 28, 2026Contributor·

  ·
  1