org.apache.spark.sql.execution.joins

Class BroadcastHashJoin

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.execution.joins.BroadcastHashJoin

All Implemented Interfaces:

java.io.Serializable, Logging, org.apache.spark.sql.catalyst.trees.BinaryNode<SparkPlan>, HashJoin, scala.Equals, scala.Product

public class BroadcastHashJoin
extends SparkPlan
implements BinaryNode, HashJoin, scala.Product, scala.Serializable

:: DeveloperApi :: Performs an inner hash join of two child relations. When the output RDD of this operator is being constructed, a Spark job is asynchronously started to calculate the values for the broadcasted relation. This data is then placed in a Spark broadcast variable. The streamed relation is not shuffled.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
BroadcastHashJoin(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys, org.apache.spark.sql.execution.joins.BuildSide buildSide, SparkPlan left, SparkPlan right)

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.spark.sql.execution.joins.BuildSide	buildSide()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Runs this query returning the result as an RDD.
SparkPlan	left()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	leftKeys()
org.apache.spark.sql.catalyst.plans.physical.Partitioning	outputPartitioning() Specifies how data is partitioned across different nodes in the cluster.
scala.collection.immutable.List<org.apache.spark.sql.catalyst.plans.physical.UnspecifiedDistribution$>	requiredChildDistribution()
SparkPlan	right()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	rightKeys()

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

codegenEnabled, executeCollect, makeCopy

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, inputSet, missingInput, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, output, outputSet, printSchema, references, schema, schemaString, simpleString, statePrefix, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, map, mapChildren, nodeName, numberedTreeString, otherCopyArgs, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.BinaryNode

children

Methods inherited from interface org.apache.spark.sql.execution.joins.HashJoin

buildKeys, buildPlan, buildSideKeyGenerator, hashJoin, output, streamedKeys, streamedPlan, streamSideKeyGenerator

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

BroadcastHashJoin

public BroadcastHashJoin(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys,
                 scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys,
                 org.apache.spark.sql.execution.joins.BuildSide buildSide,
                 SparkPlan left,
                 SparkPlan right)

Method Detail

leftKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys()

Specified by:

leftKeys in interface HashJoin

rightKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys()

Specified by:

rightKeys in interface HashJoin

buildSide

public org.apache.spark.sql.execution.joins.BuildSide buildSide()

Specified by:

buildSide in interface HashJoin

left

public SparkPlan left()

Specified by:

left in interface org.apache.spark.sql.catalyst.trees.BinaryNode<SparkPlan>

Specified by:

left in interface HashJoin

right

public SparkPlan right()

Specified by:

right in interface org.apache.spark.sql.catalyst.trees.BinaryNode<SparkPlan>

Specified by:

right in interface HashJoin

outputPartitioning

public org.apache.spark.sql.catalyst.plans.physical.Partitioning outputPartitioning()

Description copied from class: SparkPlan

Specifies how data is partitioned across different nodes in the cluster.

Overrides:

outputPartitioning in class SparkPlan

requiredChildDistribution

public scala.collection.immutable.List<org.apache.spark.sql.catalyst.plans.physical.UnspecifiedDistribution$> requiredChildDistribution()

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Description copied from class: SparkPlan

Runs this query returning the result as an RDD.

Specified by:

execute in class SparkPlan