Skip to content

Add support for Spark SQL explode expression #1927

Open
@andygrove

Description

@andygrove

What is the problem the feature request solves?

Add support for explode:

https://spark.apache.org/docs/latest/api/sql/index.html#explode

explode(expr) - Separates the elements of array expr into multiple rows, or the elements of map expr into multiple rows and columns. Unless specified otherwise, uses the default column name col for elements of the array or key and value for the elements of the map.

Describe the potential solution

The Spark plan contains GenerateExec with a generator field, which will be an Explode class for this case. We can fall back to Spark for any other generator class for now.

Additional context

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions