Design, develop & deploy highly scalable data pipelines. Deep dive into various tuning and optimisation techniques. Enabling job monitoring dashboard. Data Engineering using Big Data Technologies – Apache Spark and Flink and Cloud Technologies – AWS, Azure and GCP
₹25000
Apache Spark with Scala and AWS
Design, develop & deploy highly scalable data pipelines. Deep dive into various tuning and optimisation techniques. Enabling job monitoring dashboard.
Design, develop and deploy Big Data Pipelines (Apache Spark with Scala/Python Projects) on AWS cloud (AWS EMR, CloudFormation, Step Function, SNS, SQS, API Gateway). This pipeline can be triggered as a REST API. Also setup a CI/CD pipeline for the same using Jenkins