Package com.here.platform.data.client.spark.datasources.protobuf

Class ProtobufDataConverter

java.lang.Object

com.here.platform.data.client.spark.datasources.protobuf.ProtobufDataConverter

All Implemented Interfaces:

com.here.platform.data.client.spark.scaladsl.DataConverter, Serializable

public class ProtobufDataConverter
extends Object
implements com.here.platform.data.client.spark.scaladsl.DataConverter

ProtobufDataConverter is an implementation of DataConverter to store each message as a single protobuf data file.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
ProtobufDataConverter(PartitionDescriptorHolder partitionDecoder)

Method Summary

Modifier and Type	Method	Description
<M extends com.here.platform.data.client.spark.scaladsl.RowMetadata> com.here.platform.data.client.spark.scaladsl.GroupedData<M>	serializeGroup(M rowMetadata, scala.collection.Iterator<org.apache.spark.sql.Row> rows)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ProtobufDataConverter

public ProtobufDataConverter(PartitionDescriptorHolder partitionDecoder)

Method Details

serializeGroup

public <M extends com.here.platform.data.client.spark.scaladsl.RowMetadata>
com.here.platform.data.client.spark.scaladsl.GroupedData<M> serializeGroup(M rowMetadata,
 scala.collection.Iterator<org.apache.spark.sql.Row> rows)

Specified by:

serializeGroup in interface com.here.platform.data.client.spark.scaladsl.DataConverter