You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
SNOW-3203859: 'filter' followed by withColumn(F.concat(...)) adds NaN rows and mismatches values in local testing #4105
2. What are the Snowpark Python and pandas versions in the environment?
pandas==3.0.0
snowflake-snowpark-python==1.45.0
3. What did you do?
This seems like the same root cause as #3384 (SNOW-2116667), which was fixed in v1.33.0 for F.concat_ws. F.concat still produces the same split NaN rows on v1.45.0.
Complete runnable reproduction:
fromsnowflake.snowparkimportSession, functionsasFfromsnowflake.snowpark.functionsimportlitfromsnowflake.snowpark.typesimportStringType, StructField, StructTypes=Session.builder.config("local_testing", True).create()
# 4 rows: TYPE in {A, B}. LABEL derived from TYPE using F.when.df=s.create_dataframe(
[("A", "a1"), ("A", "a2"), ("B", "b1"), ("B", "b2")],
StructType([StructField("TYPE", StringType()), StructField("NAME", StringType())]),
)
df=df.withColumn("LABEL", F.when(F.col("TYPE") ==lit("A"), lit("a")).otherwise(lit("b")))
# Filter to 2 rows where LABEL == "b", then overwrite NAME with F.concatresult= (
df
.filter(F.col("LABEL") ==lit("b"))
.withColumn("NAME", F.concat(F.col("TYPE"), F.lit("_x")))
)
result.show()
s.close()
changed the title [-]'filter' followed by `withColumn(F.concat(...))` adds NaN rows and mismatches values in local testing[/-][+]SNOW-3203859: 'filter' followed by `withColumn(F.concat(...))` adds NaN rows and mismatches values in local testing[/+]on Mar 6, 2026
Activity
sfc-gh-sghosh commentedon Mar 6, 2026
Hello @asyncdoggo
Thanks for raising the issue.
We are able to reproduce the issue with latest snowpark python 1.44.0/1.45.0 as well.
We will work on it to eliminate it.
[-]'filter' followed by `withColumn(F.concat(...))` adds NaN rows and mismatches values in local testing[/-][+]SNOW-3203859: 'filter' followed by `withColumn(F.concat(...))` adds NaN rows and mismatches values in local testing[/+]