Managing Data as a Product: Scalable Data Architectures

Managing Data as a Product: Scalable Data Architectures

Instructor: Packt - Course Instructors

Access provided by Refugee Talent Hub

12 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Recommended experience

2 weeks to complete

at 10 hours a week

Flexible schedule

Learn at your own pace

12 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Recommended experience

2 weeks to complete

at 10 hours a week

Flexible schedule

Learn at your own pace

What you'll learn

Overcome challenges in scaling monolithic data platforms
Adopt a data-as-a-product approach for sustainable growth
Navigate the full lifecycle of data products from inception to decommissioning

Skills you'll gain

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

12 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

There are 12 modules in this course

This course provides essential skills for modernizing data architectures by adopting a data-as-a-product approach. It emphasizes building modular, scalable systems to enhance data management and unlock greater value from data assets.

Throughout the course, you will learn to design, implement, and manage data products in a distributed environment, ensuring sustainable growth and scalability. By focusing on practical, real-world applications, the course empowers learners to overcome the challenges of traditional monolithic data platforms. What sets this course apart is its combination of theory and hands-on activities. You will not only grasp key concepts but also develop actionable strategies to modernize your data architecture effectively. Real-world case studies and best practices will guide you through the process. This course is ideal for data engineers, architects, and leaders looking to enhance their data strategies and modernize their organization’s data management. A solid understanding of core data engineering principles is recommended. This course is based on material written by an expert author, bringing the depth of a book into a more engaging, interactive format. The core content is delivered through clear, structured text you can read at your own pace, supported by short videos and quizzes to highlight key ideas and test your understanding. By combining the strengths of book learning with interactive assessments, you get the best of both worlds: the depth and clarity of an author’s expertise, plus the flexibility to revisit, practice, and reinforce concepts whenever you need.

In this section, we examine monolithic data platforms' limitations and explore modular approaches to reduce accidental complexity and improve system sustainability through data product strategies.

What's included

2 videos8 readings1 assignment

2 videosTotal 1 minute

Course Overview1 minute
From Data as a Byproduct to Data as a Product - Overview Video0 minutes

8 readingsTotal 80 minutes

Introduction10 minutes
Data Warehouse10 minutes
DWH Versus Data Lake10 minutes
Understanding Why Monolithic Data Platforms Fail10 minutes
Failure Loops10 minutes
Exploring Why We Need to Manage Data as a Product10 minutes
Data Is Everybody's Business10 minutes
Data Product Thinking10 minutes

1 assignmentTotal 10 minutes

Data Management and System Complexity Fundamentals10 minutes

In this section, we define data products and pure data products, analyze their structure and characteristics, and explore methods for classifying them to enhance data utilization.

What's included

1 video8 readings1 assignment

1 video

Data Products - Overview Video0 minutes

8 readingsTotal 80 minutes

Introduction10 minutes
Why Do We Need Pure Data Products?10 minutes
Pure Data Product Definition10 minutes
The Rise of Data-Driven Applications10 minutes
Relevance10 minutes
Composability10 minutes
Input Ports10 minutes
Classifying Pure Data Products10 minutes

1 assignmentTotal 10 minutes

Data Product Fundamentals10 minutes

In this section, we examine data-product-centered architecture design, operational and management planes, and alternative data management approaches for scalable, adaptable solutions.

What's included

1 video4 readings1 assignment

In this section, we explore domain-driven design and event storming to identify data products, and manage their portfolio for business alignment and operational coherence.

What's included

1 video8 readings1 assignment

1 video

Identifying Data Products and Prioritizing Developments - Overview Video0 minutes

8 readingsTotal 80 minutes

Introduction10 minutes
Connecting Problem and Solution Spaces10 minutes
Identifying Subdomains10 minutes
Identifying Bounded Contexts10 minutes
Mapping Business Capabilities10 minutes
Turning Business Strategy Into Actionable Business Cases10 minutes
Analyzing Processes with Event Storming10 minutes
Managing the Data Product Portfolio10 minutes

1 assignmentTotal 10 minutes

Strategic Alignment of Data and Business Capabilities10 minutes

In this section, we examine data product design, interactions, and implementation, focusing on metadata management, machine-readable descriptors, and data flow processes for scalable solutions.

What's included

1 video8 readings1 assignment

1 video

Designing and Implementing Data Products - Overview Video0 minutes

8 readingsTotal 80 minutes

Introduction10 minutes
Understanding the Data Product Global Ecosystem10 minutes
Understanding Data Product Internals10 minutes
Managing Data Product Metadata10 minutes
Introducing the Data Product Descriptor Specification10 minutes
Describing Interface Components in DPDS10 minutes
Describing Internal Components in DPDS10 minutes
Processing Data10 minutes

1 assignmentTotal 10 minutes

Data Product Design and Implementation Fundamentals10 minutes

In this section, we explore deploying data products using CI/CD, governing them with policies, and managing their evolution to ensure reliability and alignment with organizational standards.

What's included

1 video9 readings1 assignment

1 video

Operating Data Products in Production - Overview Video0 minutes

9 readingsTotal 90 minutes

Introduction10 minutes
Infrastructure as Code10 minutes
Automating Integration Tests10 minutes
Understanding CD10 minutes
Defining the Deployment Pipeline10 minutes
Governing Data Products10 minutes
Implementing Computational Policy10 minutes
Observing Data Products10 minutes
Controlling Data Products10 minutes

1 assignmentTotal 10 minutes

Operating Data Products in Production10 minutes

This section covers automating data product lifecycle management with XOps, focusing on platform capabilities and implementation strategies.

What's included

1 video6 readings1 assignment

1 video

Automating Data Product Lifecycle Management - Overview Video0 minutes

6 readingsTotal 60 minutes

Introduction10 minutes
Understanding Platform Value Engines10 minutes
Leveraging Platform Value Engines10 minutes
Boosting Developer Experience10 minutes
Defining Data Product Modules and Blueprints10 minutes
Supporting Computational Policy and Ontology Development10 minutes

1 assignmentTotal 10 minutes

Data Product Lifecycle and XOps Fundamentals10 minutes

In this section, we explore the adoption phases of data as a product, focusing on challenges, strategies, and adaptive data governance to ensure sustainable and scalable implementation.

What's included

1 video8 readings1 assignment

1 video

Moving through the Adoption Journey - Overview Video0 minutes

8 readingsTotal 80 minutes

Introduction10 minutes
Preparing for the Assessment10 minutes
Understanding the Why10 minutes
Setting the Foundation10 minutes
Defining Key Governance Policies10 minutes
Enabling the Enablers10 minutes
Dealing with Legacy Systems10 minutes
Planning the Execution with EDGE10 minutes

1 assignmentTotal 10 minutes

Navigating the Adoption Journey10 minutes

In this section, we explore team topologies and data ownership strategies to optimize organizational structures for scalable data product delivery and efficient team collaboration.

What's included

1 video9 readings1 assignment

1 video

Team Topologies and Data Ownership at Scale - Overview Video0 minutes

9 readingsTotal 90 minutes

Introduction10 minutes
Understanding Team Types10 minutes
Collaboration10 minutes
Mapping the Organizational Architecture10 minutes
Data Product Teams10 minutes
Platform Teams10 minutes
Defining Management Teams10 minutes
Understanding When to Decentralize10 minutes
Moving toward decentralization10 minutes

1 assignmentTotal 10 minutes

Team Topologies and Data Ownership at Scale10 minutes

In this section, we explore distributed data modeling techniques, focusing on physical and conceptual approaches to design explicit models for data products in decentralized systems.

What's included

1 video11 readings1 assignment

1 video

Distributed Data Modeling - Overview Video0 minutes

11 readingsTotal 110 minutes

Introduction10 minutes
Data Modeling Process10 minutes
Operational and Analytical Data Modeling Methodologies10 minutes
Centralized Dimensional Modeling10 minutes
Distributed Dimensional Modeling10 minutes
Data Vault Modeling10 minutes
Managing Hubs and Links as a Service10 minutes
Join Traps10 minutes
Puppini Bridge10 minutes
Exploring Distributed Conceptual Modeling10 minutes
From String to Things10 minutes

1 assignmentTotal 10 minutes

Data Modeling Fundamentals in Distributed Systems10 minutes

In this section, we explore building an AI-ready information architecture by designing a knowledge plane for semantic interoperability and constructing an enterprise knowledge graph for AI integration.