Pipeline technician education requirements

1. Building Batch Pipelines in Cloud Data Fusion

This is a self-paced lab that takes place in the Google Cloud console. This lab will teach you how to use the Pipeline Studio in Cloud Data Fusion to build an ETL pipeline. Pipeline Studio exposes the building blocks and built-in plugins for you to build your batch pipeline, one node at a time. You will also use the Wrangler plugin to build and apply transformations to your data that goes through the pipeline...

2. Building Realtime Pipelines in Cloud Data Fusion

This is a self-paced lab that takes place in the Google Cloud console. In addition to batch pipelines, Data Fusion also allows you to create real-time pipelines, that can process events as they are generated. Currently, realtime pipelines execute using Apache Spark Streaming on Cloud Dataproc clusters. In this lab, you will learn how to build a streaming pipeline using Data Fusion...

3. SAP MM Consignment and Pipeline Procurement

4.7

(287)

Consignment and Pipeline Procurement Cycle...

4. CI/CD Pipelines using Azure DevOps

4.3

(3,845)

Create end-to-end Dev Ops pipelines using the Azure Dev Ops Platform...

5. Building Batch Data Pipelines on Google Cloud

Data pipelines typically fall under one of the Extra-Load, Extract-Load-Transform or Extract-Transform-Load paradigms. This course describes which paradigm should be used and when for batch data. Furthermore, this course covers several technologies on Google Cloud for data transformation including BigQuery, executing Spark on Dataproc, pipeline graphs in Cloud Data Fusion and serverless data processing with Dataflow. Learners will get hands-on experience building data pipeline components on...

6. Serverless Data Processing with Dataflow: Develop Pipelines

In this second installment of the Dataflow course series, we are going to be diving deeper on developing pipelines using the Beam SDK. We start with a review of Apache Beam concepts. Next, we discuss processing streaming data using windows, watermarks and triggers. We then cover options for sources and sinks in your pipelines, schemas to express your structured data, and how to do stateful transformations using State and Timer APIs. We move onto reviewing best practices that help maximize your...

7. Learn CI/CD YAML pipelines with Azure DevOps

4.4

(353)

Learn the fundamentals of CI/CD pipeline, get started with CI/CD pipeline with this complete beginner's course...

8. Learn Azure DevOps CI/CD pipelines

4.5

(2,770)

Create CI/CD pipelines for Java, .NET, Node Js, Docker, Terraform, Nuget, Kubernetes, SQL Server, Bicep and ARM templates...

9. Data Mining Pipeline

This course introduces the key steps involved in the data mining pipeline, including data understanding, data preprocessing, data warehousing, data modeling, interpretation and evaluation, and real-world applications. This course can be taken for academic credit as part of CU Boulder’s MS in Data Science or MS in Computer Science degrees offered on the Coursera platform. These fully accredited graduate degrees offer targeted courses, short 8-week sessions, and pay-as-you-go tuition. Admission...

10. Build your first Machine Learning Pipeline using Dataiku

As part of this guided project, you shall build your first Machine Learning Pipeline using DataIku tool without writing a single line of code. You shall build a prediction model which inputs COVID daily count data across the world and predict COVID fatalities.DataIku tool is a low code no code platform which is gaining traction with citizen data scientist to quickly build and deploy their models...

11. DevOps with Jenkins Pipeline, Ansible, Kubernetes & Docker

4.5

(303)

Learn how to implement Dev Ops using Jenkins Pipeline, docker and Ansible and Kubernetes...

12. Mastering Bitbucket Pipelines for CI and CD

4

(450)

From the most basic build to the most complex project: everything you need to know about mastering Bitbucket Pipelines!...

13. DevOps CI/CD with Jenkins Pipeline and SonarQube Integration

4.6

(1,342)

Unlock the Power of Jenkins, Pipeline, Groovy, Sonar Qube for Dev Ops Automation using Jenkins CI CD Pipeline using DSLs...

14. DevOps: CI/CD with Jenkins pipelines, Maven, Gradle

4.5

(13,023)

Build continuous integration, continuous delivery and Dev Ops pipelines with Java, Gradle, Maven, Artifactory & Sqitch...

15. Azure DevOps: Build and Deploy App using CI and CD Pipeline

4.4

(553)

Learn about CI/CD Pipelines: Continuous Integration, Continuous Delivery / Deployment in Azure Dev Ops...

16. Writing production-ready ETL pipelines in Python / Pandas

4.1

(678)

Learn how to write professional ETL pipelines using best practices in Python and Data Engineering...

17. Snowflake - Build & Architect Data pipelines using AWS

4.4

(275)

Data engineering and architecting pipelines using snowflake & AWS cloud...

18. Rotating Equipment Masterclass: Pumps & Compressors

4.6

(305)

A compelete understanding of pumps & compressors used in process industries for a successful operation of your facility...

19. Learn DevOps: CI/CD with Jenkins using Pipelines and Docker

4.5

(15,701)

Use Jenkins the Dev Ops way. Automate your Jenkins jobs by using Jenkins Pipelines, Docker, and the Jenkins Job DSL...