Package com.here.platform.data.client.spark.datasources.avro

Class AvroDataConverter

java.lang.Object
com.here.platform.data.client.spark.datasources.avro.AvroDataConverter
All Implemented Interfaces:
com.here.platform.data.client.spark.scaladsl.DataConverter, Serializable
public class AvroDataConverter extends Object implements com.here.platform.data.client.spark.scaladsl.DataConverter
AvroDataConverter is an implementation of DataConverter to store each message grouping as a single avro data file.
See Also:

  • Constructor Summary

    Constructors
    Constructor
    Description
    AvroDataConverter()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    <M extends com.here.platform.data.client.spark.scaladsl.RowMetadata>
    com.here.platform.data.client.spark.scaladsl.GroupedData<M>
    serializeGroup(M rowMetadata, scala.collection.Iterator<org.apache.spark.sql.Row> rowsIterator)
     

    Methods inherited from class java.lang.Object

    equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • AvroDataConverter

      public AvroDataConverter()

  • Method Details

    • serializeGroup

      public <M extends com.here.platform.data.client.spark.scaladsl.RowMetadata> com.here.platform.data.client.spark.scaladsl.GroupedData<M> serializeGroup(M rowMetadata, scala.collection.Iterator<org.apache.spark.sql.Row> rowsIterator)
      Specified by:
      serializeGroup in interface com.here.platform.data.client.spark.scaladsl.DataConverter