org.apache.spark.sql.hive.execution

Class HiveTableScan

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<org.apache.spark.sql.execution.SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.hive.execution.HiveTableScan

All Implemented Interfaces:

java.io.Serializable, Logging, org.apache.spark.sql.catalyst.trees.LeafNode<org.apache.spark.sql.execution.SparkPlan>, scala.Equals, scala.Product

public class HiveTableScan
extends org.apache.spark.sql.execution.SparkPlan
implements org.apache.spark.sql.execution.LeafNode, scala.Product, scala.Serializable

The Hive table scan operator. Column and partition pruning are both handled.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HiveTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> requestedAttributes, MetastoreRelation relation, scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> partitionPruningPred, HiveContext context)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.AttributeReference>	attributes()
HiveContext	context()
RDD<org.apache.spark.sql.Row>	execute()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.AttributeReference>	output()
scala.Option<org.apache.spark.sql.catalyst.expressions.Expression>	partitionPruningPred()
scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition>	prunePartitions(scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition> partitions) Prunes partitions not involve the query plan.
MetastoreRelation	relation()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	requestedAttributes()

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

codegenEnabled, executeCollect, executeTake, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, makeCopy, newMutableProjection, newOrdering, newPredicate, newProjection, org$apache$spark$Logging$$log__$eq, org$apache$spark$Logging$$log_, outputPartitioning, requiredChildDistribution, sparkContext, sqlContext

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, inputSet, missingInput, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, printSchema, references, schema, schemaString, simpleString, statePrefix, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, foreachUp, generateTreeString, getNodeNumbered, map, mapChildren, nodeName, numberedTreeString, origin, otherCopyArgs, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.LeafNode

children

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, log_

Constructor Detail

HiveTableScan

public HiveTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> requestedAttributes,
             MetastoreRelation relation,
             scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> partitionPruningPred,
             HiveContext context)

Method Detail

requestedAttributes

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> requestedAttributes()

relation

public MetastoreRelation relation()

partitionPruningPred

public scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> partitionPruningPred()

context

public HiveContext context()

attributes

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.AttributeReference> attributes()

prunePartitions

public scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition> prunePartitions(scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition> partitions)

Prunes partitions not involve the query plan.

Parameters:

partitions - All partitions of the relation.

Returns:

Partitions that are involved in the query plan.

execute

public RDD<org.apache.spark.sql.Row> execute()

Specified by:

execute in class org.apache.spark.sql.execution.SparkPlan

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.AttributeReference> output()