{"id":120,"date":"2016-06-16T10:15:18","date_gmt":"2016-06-16T10:15:18","guid":{"rendered":"http:\/\/blog.cloudxlab.com\/?p=120"},"modified":"2017-09-15T06:21:18","modified_gmt":"2017-09-15T06:21:18","slug":"apache-spark-stream-processing-hands-on","status":"publish","type":"post","link":"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/","title":{"rendered":"Stream Processing Using Apache Spark and Kafka"},"content":{"rendered":"<p>Thank you all for your overwhelming response to our <strong>&#8220;Stream Processing\u00a0using\u00a0Apache Spark and Apache Kafka\u00a0session&#8221;<\/strong> in <strong>&#8220;Apache Spark Hands-On&#8221;<\/strong> series, which happened on June 15, 2016 8:00 pm IST<\/p>\n<p><strong>Key takeaways-\u00a0<\/strong><\/p>\n<p>+ Introduction to Apache Spark<br \/>\n+ Introduction to stream processing<br \/>\n+ Understanding RDD (Resilient Distributed Datasets)<br \/>\n+ Understanding Dstream<br \/>\n+ Kafka Introduction<br \/>\n+ Understanding Stream Processing flow<br \/>\n+ Real time hands-on using CloudxLab<br \/>\n+ Questions and Answers<\/p>\n<p><!--more--><\/p>\n<p><strong>Hands-on Webinar<\/strong><\/p>\n<p><iframe width=\"683\" height=\"541\" src=\"https:\/\/www.youtube.com\/embed\/QTpDi1_yuVQ\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><strong>Presentation<\/strong><\/p>\n<p><iframe width=\"595\" height=\"500\" style=\"border: 1px solid #CCC; border-width: 1px; margin-bottom: 5px; max-width: 100%;\" src=\"\/\/www.slideshare.net\/slideshow\/embed_code\/key\/pytPLF32cNUjvv\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" allowfullscreen=\"allowfullscreen\"> <\/iframe><\/p>\n<div id=\"cxl-affiliate\"><\/div>\n<p><script>\/\/ <![CDATA[ (function(a, b, c) { affiliate_code = \"CW7CF05WBUZ55SHRSH8R\"; lab = \"hadoop\"; s = b.createElement('script'); s.type = 'text\/javascript'; s.src = \"\/\/s3.amazonaws.com\/cloudxlab\/embed\/affl-without-analytics.js\"; s.async = 1; (b.head || b.body).appendChild(s); } (window, document)); \/\/ ]]><\/script><\/p>\n<p>We will be organizing more hand-on sessions on Apache Spark in coming days. Please follow <a href=\"https:\/\/twitter.com\/CloudxLab\" target=\"_blank\" rel=\"noopener\">CloudxLab on Twitter<\/a> for updates on upcoming events.<\/p>\n<p>Please feel free to drop your comments. It will help us improve the quality of webinar and content.<\/p>\n<p>See you at the next event.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Thank you all for your overwhelming response to our &#8220;Stream Processing\u00a0using\u00a0Apache Spark and Apache Kafka\u00a0session&#8221; in &#8220;Apache Spark Hands-On&#8221; series, which happened on June 15, 2016 8:00 pm IST Key takeaways-\u00a0 + Introduction to Apache Spark + Introduction to stream processing + Understanding RDD (Resilient Distributed Datasets) + Understanding Dstream + Kafka Introduction + Understanding &hellip; <a href=\"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Stream Processing Using Apache Spark and Kafka&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[12],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v16.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Stream Processing Using Apache Spark and Kafka | CloudxLab Blog<\/title>\n<meta name=\"description\" content=\"Learn and practice Apache Spark streaming using Apache Kafka. Hands-on demo on stream processing using CloudxLab.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Stream Processing Using Apache Spark and Kafka | CloudxLab Blog\" \/>\n<meta property=\"og:description\" content=\"Learn and practice Apache Spark streaming using Apache Kafka. Hands-on demo on stream processing using CloudxLab.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/\" \/>\n<meta property=\"og:site_name\" content=\"CloudxLab Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cloudxlab\" \/>\n<meta property=\"article:published_time\" content=\"2016-06-16T10:15:18+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2017-09-15T06:21:18+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@CloudxLab\" \/>\n<meta name=\"twitter:site\" content=\"@CloudxLab\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\">\n\t<meta name=\"twitter:data1\" content=\"1 minute\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/#website\",\"url\":\"https:\/\/cloudxlab.com\/blog\/\",\"name\":\"CloudxLab Blog\",\"description\":\"Learn AI, Machine Learning, Deep Learning, Devops &amp; Big Data\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/cloudxlab.com\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/#webpage\",\"url\":\"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/\",\"name\":\"Stream Processing Using Apache Spark and Kafka | CloudxLab Blog\",\"isPartOf\":{\"@id\":\"https:\/\/cloudxlab.com\/blog\/#website\"},\"datePublished\":\"2016-06-16T10:15:18+00:00\",\"dateModified\":\"2017-09-15T06:21:18+00:00\",\"author\":{\"@id\":\"https:\/\/cloudxlab.com\/blog\/#\/schema\/person\/0efa3c54df68406de820ea466f002d3c\"},\"description\":\"Learn and practice Apache Spark streaming using Apache Kafka. Hands-on demo on stream processing using CloudxLab.\",\"breadcrumb\":{\"@id\":\"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/\",\"url\":\"https:\/\/cloudxlab.com\/blog\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@id\":\"https:\/\/cloudxlab.com\/blog\/apache-spark-stream-processing-hands-on\/#webpage\"}}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/#\/schema\/person\/0efa3c54df68406de820ea466f002d3c\",\"name\":\"Abhinav Singh\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/fc74fe31169bf872f6ab11bbab621d53?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/fc74fe31169bf872f6ab11bbab621d53?s=96&d=mm&r=g\",\"caption\":\"Abhinav Singh\"},\"sameAs\":[\"https:\/\/cloudxlab.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/posts\/120"}],"collection":[{"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/comments?post=120"}],"version-history":[{"count":18,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/posts\/120\/revisions"}],"predecessor-version":[{"id":759,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/posts\/120\/revisions\/759"}],"wp:attachment":[{"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/media?parent=120"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/categories?post=120"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/tags?post=120"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}