Stream Processing with Apache Flink

联合创作 · 2023-09-28

Get started with Apache Flink, the open source framework that enables you to process streaming data—such as user interactions, sensor data, and machine logs—as it arrives. With this practical guide, you’ll learn how to use Apache Flink’s stream processing APIs to implement, continuously run, and maintain real-world applications.Authors Fabian Hueske, one of Flink’s creators, an...

Get started with Apache Flink, the open source framework that enables you to process streaming data—such as user interactions, sensor data, and machine logs—as it arrives. With this practical guide, you’ll learn how to use Apache Flink’s stream processing APIs to implement, continuously run, and maintain real-world applications.Authors Fabian Hueske, one of Flink’s creators, and Vasia Kalavri, a core contributor to Flink’s graph processing API (Gelly), explains the fundamental concepts of parallel stream processing and shows you how streaming analytics differs from traditional batch data analysis. Software engineers, data engineers, and system administrators will learn the basics of Flink’s DataStream API, including the structure and components of a common Flink streaming application.Solve real-world problems with Apache Flink’s DataStream APISet up an environment for developing stream processing applications for FlinkDesign streaming applications and migrate periodic batch workloads to continuous streaming workloadsLearn about windowed operations that process groups of recordsIngest data streams into a DataStream application and emit a result stream into different storage systemsImplement stateful and custom operators common in stream processing applicationsOperate, maintain, and update continuously running Flink streaming applicationsExplore several deployment options, including the setup of highly available installations

About the Author

Fabian Hueske is involved with Apache Flink since its very beginnings in 2009 as a research project called Stratosphere at TU Berlin. He is one of the three initial authors of the system and worked on it as part of his PhD research. Fabian is one of the initial committers and a PMC member of Apache Flink. He is a co-founder of data Artisans, a Berlin-based star...

About the Author

Fabian Hueske is involved with Apache Flink since its very beginnings in 2009 as a research project called Stratosphere at TU Berlin. He is one of the three initial authors of the system and worked on it as part of his PhD research. Fabian is one of the initial committers and a PMC member of Apache Flink. He is a co-founder of data Artisans, a Berlin-based start-up devoted to foster Flink, where he works as a software engineer and contributes to Apache Flink. Fabian wrote several well-received blog posts about Flink and its internals (published at the Apache Flink blog http://flink.apache.org/blog, data Artisans’ blog http://data-artisans.com/blog, MapR blog, and Elastic blog).Vasiliki Kalavri is a PhD student at KTH, Stockholm, and UCL, Belgium, and an EMJD-DC fellow. She does research in distributed data processing and large-scale graph analysis.She is a committer and PMC member of Apache Flink, focusing her efforts on its graph processing library and API, Gelly.

Read more

浏览 4
点赞
评论
收藏
分享

手机扫一扫分享

编辑
举报
评论
图片
表情
推荐
点赞
评论
收藏
分享

手机扫一扫分享

编辑
举报