Package com.here.platform.data.client.spark.datasources.raw

Class RawDataConverter

java.lang.Object
com.here.platform.data.client.spark.datasources.raw.RawDataConverter
All Implemented Interfaces:
com.here.platform.data.client.spark.scaladsl.DataConverter, Serializable
public class RawDataConverter extends Object implements com.here.platform.data.client.spark.scaladsl.DataConverter
RawDataConverter is an implementation of DataConverter to store each message as a single protobuf data file.
See Also:

  • Constructor Summary

    Constructors
    Constructor
    Description
    RawDataConverter()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    <M extends com.here.platform.data.client.spark.scaladsl.RowMetadata>
    com.here.platform.data.client.spark.scaladsl.GroupedData<M>
    serializeGroup(M rowMetadata, scala.collection.Iterator<org.apache.spark.sql.Row> rows)
     

    Methods inherited from class java.lang.Object

    equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • RawDataConverter

      public RawDataConverter()

  • Method Details

    • serializeGroup

      public <M extends com.here.platform.data.client.spark.scaladsl.RowMetadata> com.here.platform.data.client.spark.scaladsl.GroupedData<M> serializeGroup(M rowMetadata, scala.collection.Iterator<org.apache.spark.sql.Row> rows)
      Specified by:
      serializeGroup in interface com.here.platform.data.client.spark.scaladsl.DataConverter