Package org.apache.spark.sql.sources

Interface StreamSourceProvider

All Known Subinterfaces:
SupportsStreamSourceMetadataColumns
public interface StreamSourceProvider
::Experimental:: Implemented by objects that can produce a streaming Source for a specific format or system.

Since:
2.0.0

  • Method Details

    • createSource

      org.apache.spark.sql.execution.streaming.Source createSource(SQLContext sqlContext, String metadataPath, scala.Option<StructType> schema, String providerName, scala.collection.immutable.Map<String,String> parameters)
      Parameters:
      sqlContext - (undocumented)
      metadataPath - (undocumented)
      schema - (undocumented)
      providerName - (undocumented)
      parameters - (undocumented)
      Returns:
      (undocumented)
      Since:
      2.0.0

    • sourceSchema

      scala.Tuple2<String,StructType> sourceSchema(SQLContext sqlContext, scala.Option<StructType> schema, String providerName, scala.collection.immutable.Map<String,String> parameters)
      Returns the name and schema of the source that can be used to continually read data.
      Parameters:
      sqlContext - (undocumented)
      schema - (undocumented)
      providerName - (undocumented)
      parameters - (undocumented)
      Returns:
      (undocumented)
      Since:
      2.0.0