Course Catalog  > Cloud  > Google Cloud
GCP-SRVLS-DATA

Serverless Data Processing with Dataflow Training

This training is intended for big data practitioners who want to further their understanding of Dataflow in order to advance their data processing applications. Beginning with foundations, this training explains how Apache Beam and Dataflow work together to meet your data processing needs without the risk of vendor lock-in.The section on developing pipelines covers how you convert your business logic into data processing applications that can run on Dataflow. This training culminates with a focus on operations, which reviews the most important lessons for operating a data application on Dataflow, including monitoring, troubleshooting, testing, and reliability.
Request Information
Request On-Site or Customized Course Info
Course Details

Duration

3 days

Prerequisites

  • Completed the "Building Batch Data Pipelines" course
  • Completed the "Building Resilient Streaming Analytics Systems" course

Target Audience

  • Data engineers
  • Data analysts and data scientists aspiring to develop data engineering skills

Skills Gained

  • Demonstrate how Apache Beam and Dataflow work together to fulfill your organization's data processing needs. Summarize the benefits of the Beam Portability Framework and enable it for your Dataflow pipelines.
  • Enable Shuffle and Streaming Engine, for batch and streaming pipelines respectively, for maximum performance. Enable Flexible Resource Scheduling for more cost-efficient performance.
  • Select the right combination of IAM permissions for your Dataflow job.
  • Implement best practices for a secure data processing environment.
  • Select and tune the I/O of your choice for your Dataflow pipeline.
  • Use schemas to simplify your Beam code and improve the performance of your pipeline.
  • Develop a Beam pipeline using SQL and DataFrames.
  • Perform monitoring, troubleshooting, testing and CI/CD on Dataflow pipelines.
Course Outline
  • Introduction
  • Beam Portability
  • eparating Compute and Storage with Dataflow
  • IAM, Quotas, and Permissions
  • Security
  • Beam Concepts Review
  • Windows, Watermarks, Triggers
  • Sources and Sinks
  • Schemas
  • State and Timers
  • Best Practices
  • Dataflow SQL and DataFrames
  • Beam Notebooks
  • Monitoring
  • Logging and Error Reporting
  • Troubleshooting and Debug
  • Performance
  • Testing and CI/CD
  • Reliability
  • Flex Templates
  • Conclusion
Upcoming Course Dates
USD $2,700
Online Virtual Class
Scheduled
Date: Jun 19 - 21, 2024
Time: 9 AM - 5 PM ET
Partner Registration

The course you are registering for is being delivered by our sister company - ExitCertified. All logistics related to course delivery will be managed by the ExitCertified team. If you have a dedicated Web Age representative, please feel to reach out to them with any questions/concerns you may have.

You'll now be redirected to https://www.exitcertified.com to complete the enrollment process.