Jump to content

File:Neha Narkhede at dotScale 2017.jpg

Page contents not supported in other languages.
This is a file from the Wikimedia Commons
From Wikipedia, the free encyclopedia

Original file (1,121 × 1,151 pixels, file size: 198 KB, MIME type: image/jpeg)

Summary

Description
English: dotScale 2017 - Neha Narkhede - The Rise of Real-Time

Filmed at https://2017.dotscale.io on April 24th in Paris. More talks on https://dotconferences.com/talks

What happens if you take everything that is happening in your company—every click, every database change, every application log—and make it all available as a real-time stream of well-structured data?

Neha discusses the experience at LinkedIn and elsewhere moving from batch-oriented ETL to real-time streams using Apache Kafka, including how the design and implementation of Kafka was driven by the goal of acting as a real-time platform for event data as well as some of the challenges of scaling Kafka to hundreds of billions of events per day at Linkedin, supporting thousands of engineers, applications and data systems in a self-service fashion.

She describes how real-time streams can become the source of ETL into Hadoop or a relational data warehouse, how real-time data can supplement the role of batch-oriented analytics in Hadoop or a traditional data warehouse, and how applications and stream processing systems such as Storm, Spark, or Samza can make use of these feeds for sophisticated real-time data processing as events occur.
Date
Source dotScale 2017 - Neha Narkhede - The Rise of Real-Time at 13:24, cropped, brightened
Author dotconferences

Licensing

This video, screenshot or audio excerpt was originally uploaded on YouTube under a CC license.
Their website states: "YouTube allows users to mark their videos with a Creative Commons CC BY license."
To the uploader: You must provide a link (URL) to the original file and the authorship information if available.
w:en:Creative Commons
attribution
This file is licensed under the Creative Commons Attribution 3.0 Unported license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
This file, which was originally posted to dotScale 2017 - Neha Narkhede - The Rise of Real-Time at 13:24, cropped, brightened, was reviewed on 18 July 2021 by reviewer Victuallers, who confirmed that it was available there under the stated license on that date.

Captions

Add a one-line explanation of what this file represents

Items portrayed in this file

depicts

18 September 2018

image/jpeg

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current13:45, 16 July 2021Thumbnail for version as of 13:45, 16 July 20211,121 × 1,151 (198 KB)GRuban{{Information |description={{en|1=dotScale 2017 - Neha Narkhede - The Rise of Real-Time Filmed at https://2017.dotscale.io on April 24th in Paris. More talks on https://dotconferences.com/talks What happens if you take everything that is happening in your company—every click, every database change, every application log—and make it all available as a real-time stream of well-structured data? Neha discusses the experience at LinkedIn and elsewhere moving from batch-oriented ETL to real-time...

The following page uses this file:

Global file usage

The following other wikis use this file:

Metadata