Kryo is a library to serialize in-memory objects fatser. It is important for Saprk to serialize objects in RAM for avoiding bottlenecks, since Saprk is in-memory. Serializing memory objects reduces the space occupied. But the serialization itself may take some time. Spark supports usage of 2 libraries for serilization: Java’s ObjectOutputStream framework(this is default) and Kyro lbrary. Kryo is significantly faster and more compact than Java serialization (often as much as 10x).
Please login to comment
8 Comments
what is Kryo ?
Upvote ShareHi,
Kryo is a library to serialize in-memory objects fatser. It is important for Saprk to serialize objects in RAM for avoiding bottlenecks, since Saprk is in-memory. Serializing memory objects reduces the space occupied. But the serialization itself may take some time. Spark supports usage of 2 libraries for serilization: Java’s
ObjectOutputStreamframework(this is default) and Kyro lbrary. Kryo is significantly faster and more compact than Java serialization (often as much as 10x).Feel free to go through https://spark.apache.org/docs/latest/tuning.html
Thanks.
1 Upvote Sharethe audio from the first part is still not clear.
Upvote ShareHi,
1 Upvote ShareStarting of the video is not clear.
Correct. The audio editing is messed up. I am looking into it. Thank you for letting us know.
Upvote ShareIs still messed.
1 Upvote ShareI am looking into it.
Upvote ShareDone! I have re-recorded the audio. Thank you for letting us know and being patient with us. The audio might sound a tad different than usual.
Upvote Share