A bank holds customer data in several BigQuery datasets and Cloud Storage lakes owned by different teams. It wants one governance layer that catalogs these assets, tracks data quality and applies consistent security policies across them. Which service fits?
Show answer and explanation
Answer: B
Dataplex provides a unified governance and management layer over data lakes and warehouses. It discovers and catalogs assets, monitors data quality and applies centralized security and metadata policies across storage in Cloud Storage and BigQuery. Composer schedules pipelines, Pub/Sub moves messages, and Cloud Build compiles and tests code, so none of them governs data assets.
Why the other options are wrong
- A. Cloud Composer orchestrates and schedules data pipelines using Apache Airflow. It runs jobs but does not catalog datasets or enforce data quality and governance policies across lakes.
- C. Pub/Sub is a messaging service for asynchronous event delivery between applications. It moves data in transit and does not discover or govern the datasets held in storage and warehouses.
- D. Cloud Build runs builds and tests from source code in automated pipelines. It concerns software delivery, not the governance of data assets across a bank's lakes and warehouses.