You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
size(expr) - Returns the size of an array or a map. This function returns -1 for null input only if spark.sql.ansi.enabled is false and spark.sql.legacy.sizeOfNull is true. Otherwise, it returns null for null input. With the default settings, the function returns null for null input.
@comphead there is cardinality function in the DataFusion repository that I think we can reuse. I'm considering adding a new function size to datafusion-spark that aligns with Spark's semantics whilest reusing cardinality
Activity
dharanad commentedon Jun 26, 2025
@comphead Can i pick this up ?
comphead commentedon Jun 26, 2025
Feel free, yes
dharanad commentedon Aug 11, 2025
@comphead there is
cardinalityfunction in the DataFusion repository that I think we can reuse. I'm considering adding a new functionsizeto datafusion-spark that aligns with Spark's semantics whilest reusingcardinalityandygrove commentedon Nov 6, 2025
Here is a test that can be added to the
CometFuzzTestSuite:andygrove commentedon Nov 6, 2025
Hi @dharanad. Are you still planning on working on this, or is it ok if we let someone else pick this up? Thanks!
dharanad commentedon Nov 11, 2025
@andygrove I overlooked this issue, i will spend sometime over this weekend
andygrove commentedon May 14, 2026
This was implemented in #2862