Package com.here.platform.data.client.spark.datasources.raw

Class RawDataSourceV2

java.lang.Object
com.here.platform.data.client.spark.datasources.raw.RawDataSourceV2
All Implemented Interfaces:
org.apache.spark.sql.connector.catalog.TableProvider, org.apache.spark.sql.execution.datasources.v2.FileDataSourceV2, org.apache.spark.sql.sources.DataSourceRegister
public class RawDataSourceV2 extends Object implements org.apache.spark.sql.execution.datasources.v2.FileDataSourceV2

  • Constructor Summary

    Constructors
    Constructor
    Description
    RawDataSourceV2()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    Class<? extends org.apache.spark.sql.execution.datasources.FileFormat>
    fallbackFileFormat()
     
    org.apache.spark.sql.connector.catalog.Table
    getTable(org.apache.spark.sql.util.CaseInsensitiveStringMap options, org.apache.spark.sql.types.StructType schema)
     
    String
    shortName()
     
    org.apache.spark.sql.SparkSession
    sparkSession()
     

    Methods inherited from class java.lang.Object

    equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.spark.sql.execution.datasources.v2.FileDataSourceV2

    getOptionsWithoutPaths, getPaths, getTable, getTableName, inferPartitioning, inferSchema, org$apache$spark$sql$execution$datasources$v2$FileDataSourceV2$$t, org$apache$spark$sql$execution$datasources$v2$FileDataSourceV2$$t_$eq, supportsExternalMetadata

  • Constructor Details

    • RawDataSourceV2

      public RawDataSourceV2()

  • Method Details

    • fallbackFileFormat

      public Class<? extends org.apache.spark.sql.execution.datasources.FileFormat> fallbackFileFormat()
      Specified by:
      fallbackFileFormat in interface org.apache.spark.sql.execution.datasources.v2.FileDataSourceV2

    • getTable

      public org.apache.spark.sql.connector.catalog.Table getTable(org.apache.spark.sql.util.CaseInsensitiveStringMap options, org.apache.spark.sql.types.StructType schema)
      Specified by:
      getTable in interface org.apache.spark.sql.execution.datasources.v2.FileDataSourceV2

    • shortName

      public String shortName()
      Specified by:
      shortName in interface org.apache.spark.sql.sources.DataSourceRegister

    • sparkSession

      public org.apache.spark.sql.SparkSession sparkSession()
      Specified by:
      sparkSession in interface org.apache.spark.sql.execution.datasources.v2.FileDataSourceV2