Master the design, implementation, and optimization of production-ready streaming data pipelines using Apache Kafka and Flink. This intermediate-level course teaches you to evaluate log configurations against governance requirements (PCI-DSS, GDPR, SOC2) and cost constraints, design stream processing topologies that join and aggregate data in real time with exactly-once semantics, and optimize pipelines through partition tuning, compression, and cost modeling. You'll work through hands-on labs that mirror real-world scenarios at DoorDash, Netflix, and Robinhood: comparing retention policies against compliance rules, building a Kafka Streams application that joins orders and payments to calculate 5-minute revenue totals, and diagnosing performance bottlenecks to meet SLAs within budget.

Stream & Optimize Real-Time Data Flows
Morgen endet die Frist! Erwerben Sie mit Coursera Plus für 199 $ (regulär 399 $) das nächste Level an Fähigkeiten. Jetzt sparen.

Stream & Optimize Real-Time Data Flows
Dieser Kurs ist Teil von Spezialisierung für Real-Time, Real Fast: Kafka & Spark for Data Engineers


Dozenten: Starweaver
Bei enthalten
Empfohlene Erfahrung
Was Sie lernen werden
Evaluate log configurations to recommend tiered storage, retention policies, and access controls.
Design stream processing topologies that implement join patterns, aggregation windows, and state management for real-time data transformation.
Optimize real-time data flows by analyzing throughput bottlenecks, partition strategies, and resource allocation to meet SLAs within budget limits.
Kompetenzen, die Sie erwerben
- Kategorie: Performance Tuning
- Kategorie: Apache Kafka
- Kategorie: Operational Data Store
- Kategorie: Multi-Tenant Cloud Environments
- Kategorie: Payment Card Industry (PCI) Data Security Standards
- Kategorie: Computer Architecture
- Kategorie: Data Architecture
- Kategorie: Apache
- Kategorie: Application Performance Management
- Kategorie: Data Pipelines
- Kategorie: Real Time Data
- Kategorie: Governance
- Kategorie: Data Governance
- Kategorie: System Monitoring
- Kategorie: Cloud Storage
- Kategorie: Compliance Management
- Kategorie: Scalability
- Kategorie: Capacity Management
Wichtige Details

Zu Ihrem LinkedIn-Profil hinzufügen
Januar 2026
1 Aufgabe
Erfahren Sie, wie Mitarbeiter führender Unternehmen gefragte Kompetenzen erwerben.

Erweitern Sie Ihre Fachkenntnisse
- Lernen Sie neue Konzepte von Branchenexperten
- Gewinnen Sie ein Grundverständnis bestimmter Themen oder Tools
- Erwerben Sie berufsrelevante Kompetenzen durch praktische Projekte
- Erwerben Sie ein Berufszertifikat zur Vorlage

In diesem Kurs gibt es 3 Module
Learn to analyze logging architectures against regulatory requirements and budget constraints. You'll evaluate retention policies for audit logs versus operational events, map data classifications to storage tiers, and quantify the cost impact of different configuration choices. By working through cost modeling exercises and compliance gap analysis, you'll recommend concrete changes to log configurations that balance compliance mandates with infrastructure costs.
Das ist alles enthalten
4 Videos2 Lektüren1 peer review
Learn to architect stream processing pipelines that transform and enrich data in real time. You'll design topologies that join multiple event streams (orders with payments), implement windowing for time-based aggregations (5-minute revenue totals), and manage stateful operations with exactly-once semantics. By working through concrete patterns like stream-stream joins and fan-out architectures, you'll build production-ready data flows that power operational dashboards and decision systems.
Das ist alles enthalten
3 Videos1 Lektüre1 peer review
Learn to diagnose and resolve performance bottlenecks in streaming pipelines while controlling costs. You'll analyze partition strategies against throughput requirements, evaluate replication factors versus latency SLAs, and implement compression and batching optimizations. Through cost modeling exercises and performance benchmarking, you'll balance throughput targets with infrastructure budgets and use monitoring data to make evidence-based recommendations for scaling streaming applications.
Das ist alles enthalten
4 Videos1 Lektüre1 Aufgabe2 peer reviews
Erwerben Sie ein Karrierezertifikat.
Fügen Sie dieses Zeugnis Ihrem LinkedIn-Profil, Lebenslauf oder CV hinzu. Teilen Sie sie in Social Media und in Ihrer Leistungsbeurteilung.
von
Mehr von Data Analysis entdecken
Status: Kostenloser Testzeitraum
Status: Kostenloser Testzeitraum
Status: Kostenloser Testzeitraum
Status: Kostenloser Testzeitraum
Warum entscheiden sich Menschen für Coursera für ihre Karriere?

Felipe M.

Jennifer J.

Larry W.

Chaitanya A.
Häufig gestellte Fragen
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.
Weitere Fragen
Finanzielle Unterstützung verfügbar,




