Packages

package partition

Type Members

  1. class AnyStatePartitionSerializer[K, V] extends StatePartitionSerializer[K, V]

    Generic StatePartitionSerializer which can be used to serialize any RDD[K,V] using the Spark default serializer.

    Generic StatePartitionSerializer which can be used to serialize any RDD[K,V] using the Spark default serializer. It should be noted that the resulting serialization is fairly fragile, especially with Kryo the results depend on the order of Kryo class registration and weird deserialization errors can be thrown if that order changes.

    K

    key type

    V

    value type

  2. class JavaStatePartitionSerializer[K, V] extends StatePartitionSerializer[K, V]

    Uses Java serialization.

    Uses Java serialization.

    K

    key type

    V

    value type

  3. trait StatePartitionSerializer[K, V] extends Serializable

    Serializes/deserializes the values in an iterator to/from Array[Byte].

    Serializes/deserializes the values in an iterator to/from Array[Byte]. Each executor should implement a custom version of this.

    K

    key type

    V

    value type

Ungrouped