org.apache.spark.sql.parquet

Class CatalystPrimitiveRowConverter

Object

parquet.io.api.Converter

parquet.io.api.GroupConverter

org.apache.spark.sql.parquet.CatalystConverter

org.apache.spark.sql.parquet.CatalystPrimitiveRowConverter

public class CatalystPrimitiveRowConverter
extends CatalystConverter

A parquet.io.api.GroupConverter that is able to convert a Parquet record to a Row object. Note that his converter is optimized for rows of primitive types (non-nested records).

Constructor Summary

Constructors

Constructor and Description
CatalystPrimitiveRowConverter(org.apache.spark.sql.catalyst.expressions.Attribute[] attributes)
CatalystPrimitiveRowConverter(org.apache.spark.sql.catalyst.types.StructField[] schema, org.apache.spark.sql.catalyst.expressions.MutableRow current)

Method Summary

Methods

Modifier and Type	Method and Description
void	end()
parquet.io.api.Converter	getConverter(int fieldIndex)
org.apache.spark.sql.catalyst.expressions.Row	getCurrentRecord() Should only be called in the root (group) converter!
int	index() The index of this converter in the parent
scala.Null	parent() The parent converter
int	size() The number of fields this group has
void	start()

Methods inherited from class org.apache.spark.sql.parquet.CatalystConverter

ARRAY_CONTAINS_NULL_BAG_SCHEMA_NAME, ARRAY_ELEMENTS_SCHEMA_NAME, MAP_KEY_SCHEMA_NAME, MAP_SCHEMA_NAME, MAP_VALUE_SCHEMA_NAME

Methods inherited from class parquet.io.api.GroupConverter

asGroupConverter, isPrimitive

Methods inherited from class parquet.io.api.Converter

asPrimitiveConverter

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CatalystPrimitiveRowConverter

public CatalystPrimitiveRowConverter(org.apache.spark.sql.catalyst.types.StructField[] schema,
                             org.apache.spark.sql.catalyst.expressions.MutableRow current)

CatalystPrimitiveRowConverter

public CatalystPrimitiveRowConverter(org.apache.spark.sql.catalyst.expressions.Attribute[] attributes)

Method Detail

size

public int size()

Description copied from class: CatalystConverter

The number of fields this group has

index

public int index()

Description copied from class: CatalystConverter

The index of this converter in the parent

parent

public scala.Null parent()

Description copied from class: CatalystConverter

The parent converter

getCurrentRecord

public org.apache.spark.sql.catalyst.expressions.Row getCurrentRecord()

Description copied from class: CatalystConverter

Should only be called in the root (group) converter!

Overrides:

getCurrentRecord in class CatalystConverter

Returns:

getConverter

public parquet.io.api.Converter getConverter(int fieldIndex)

Specified by:

getConverter in class parquet.io.api.GroupConverter

start

public void start()

Specified by:

start in class parquet.io.api.GroupConverter

end

public void end()

Specified by:

end in class parquet.io.api.GroupConverter