package partition
Type Members
-
class
AnyStatePartitionSerializer[K, V] extends StatePartitionSerializer[K, V]
Generic StatePartitionSerializer which can be used to serialize any RDD[K,V] using the Spark default serializer.
Generic StatePartitionSerializer which can be used to serialize any RDD[K,V] using the Spark default serializer. It should be noted that the resulting serialization is fairly fragile, especially with Kryo the results depend on the order of Kryo class registration and weird deserialization errors can be thrown if that order changes.
- K
key type
- V
value type
-
class
JavaStatePartitionSerializer[K, V] extends StatePartitionSerializer[K, V]
Uses Java serialization.
Uses Java serialization.
- K
key type
- V
value type
-
trait
StatePartitionSerializer[K, V] extends Serializable
Serializes/deserializes the values in an iterator to/from Array[Byte].
Serializes/deserializes the values in an iterator to/from Array[Byte]. Each executor should implement a custom version of this.
- K
key type
- V
value type