org.apache.spark.sql.execution.joins

Class HashOuterJoin

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.execution.joins.HashOuterJoin

All Implemented Interfaces:

java.io.Serializable, Logging, org.apache.spark.sql.catalyst.trees.BinaryNode<SparkPlan>, scala.Equals, scala.Product

public class HashOuterJoin
extends SparkPlan
implements BinaryNode, scala.Product, scala.Serializable

:: DeveloperApi :: Performs a hash based outer join for two child relations by shuffling the data using the join keys. This operator requires loading the associated partition in both side into memory.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HashOuterJoin(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys, org.apache.spark.sql.catalyst.plans.JoinType joinType, scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> condition, SparkPlan left, SparkPlan right)

Method Summary

Methods

Modifier and Type	Method and Description
scala.Option<org.apache.spark.sql.catalyst.expressions.Expression>	condition()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Runs this query returning the result as an RDD.
org.apache.spark.sql.catalyst.plans.JoinType	joinType()
SparkPlan	left()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	leftKeys()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	output()
org.apache.spark.sql.catalyst.plans.physical.Partitioning	outputPartitioning() Specifies how data is partitioned across different nodes in the cluster.
scala.collection.immutable.List<org.apache.spark.sql.catalyst.plans.physical.ClusteredDistribution>	requiredChildDistribution()
SparkPlan	right()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	rightKeys()

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

codegenEnabled, executeCollect, makeCopy

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, inputSet, missingInput, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, printSchema, references, schema, schemaString, simpleString, statePrefix, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, map, mapChildren, nodeName, numberedTreeString, otherCopyArgs, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.BinaryNode

children

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

HashOuterJoin

public HashOuterJoin(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys,
             scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys,
             org.apache.spark.sql.catalyst.plans.JoinType joinType,
             scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> condition,
             SparkPlan left,
             SparkPlan right)

Method Detail

leftKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys()

rightKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys()

joinType

public org.apache.spark.sql.catalyst.plans.JoinType joinType()

condition

public scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> condition()

left

public SparkPlan left()

Specified by:

left in interface org.apache.spark.sql.catalyst.trees.BinaryNode<SparkPlan>

right

public SparkPlan right()

Specified by:

right in interface org.apache.spark.sql.catalyst.trees.BinaryNode<SparkPlan>

outputPartitioning

public org.apache.spark.sql.catalyst.plans.physical.Partitioning outputPartitioning()

Description copied from class: SparkPlan

Specifies how data is partitioned across different nodes in the cluster.

Overrides:

outputPartitioning in class SparkPlan

requiredChildDistribution

public scala.collection.immutable.List<org.apache.spark.sql.catalyst.plans.physical.ClusteredDistribution> requiredChildDistribution()

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()

Specified by:

output in class org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Description copied from class: SparkPlan

Runs this query returning the result as an RDD.

Specified by:

execute in class SparkPlan