and Qualifications: Proven experience with AWS big data services. Strong coding experience in PySpark and SQL. Expertise in Spark... with extensive experience in PySpark, SQL, Spark, and Airflow. The ideal candidate will have a strong background in coding and a deep...
, HDFS, SQL, SQL , CICD on AWS, Airflow on Prem Secondary Skills: Good Python Coding Skill, SQL, Data Modeling, Advance... level of Spark Python, spark, hive, HDFS, Airflow, SQL, Batch data ingestion using Rest & gRPC API/SQL/Files, CICD...
should encompass are Software development skills preferably Python for platform building on AWS; Data engineering Spark (pyspark..., Redshift, and MWAA. Extract, transform, and load data from various sources using SQL and AWS big data technologies. Explore...
exceptional challenges require your unique skills. Its You & Western Digital. Together, were the next BIG thing in data.... ABOUT ADVANCED ANALYTICS OFFICE (AAO) and BIG DATA PLATFORM (BDP) AAO is missioned with accelerating Analytics solutions at scale...
engineering using big data – preferably in PySpark and hyperscaler platforms (cloud services like AWS, GCP and Azure) with focus.... Demonstrable ability to write & optimize SQL and spark jobs. Some experience in Apache Kafka and Airflow is a prerequisite as well...
with cloud infrastructure platforms such as AWS or GCP. Experience in architecting, designing and building scalable big data... analytics pipelines ingesting TB of data per day. Experience in optimizing spark, sql, datapipeline and troubleshooting...
automation. MUST have experience with Python/PySpark/Scala in Big Data environments. Strong skills in SQL queries in Big Data..., Cloudera, Spark, Kafka, Relational SQL, NoSQL databases, and data pipeline/workflow management tools. 6+ years of experience...
in Python and PySpark. Experience in writing SQL queries & scripting. Experience in creating ETL flows and data orchestration... AWS. Experience in managing Apache Airflow. Qualifications: Bachelor's degree in Computer Science or a related field...
on AWS; Data engineering Spark (pyspark, sparksql, scala) for ETL development, Advanced SQL and Data modelling for Analytics... from various sources using SQL and AWS big data technologies. Explore and learn the latest AWS technologies to enhance...
on AWS; Data engineering Spark (pyspark, sparksql, scala) for ETL development, Advanced SQL and Data modelling for Analytics... from various sources using SQL and AWS big data technologies. Explore and learn the latest AWS technologies to enhance...
on AWS; Data engineering Spark (pyspark, sparksql, scala) for ETL development, Advanced SQL and Data modelling for Analytics... from various sources using SQL and AWS big data technologies. Explore and learn the latest AWS technologies to enhance...
on AWS; Data engineering Spark (pyspark, sparksql, scala) for ETL development, Advanced SQL and Data modelling for Analytics... from various sources using SQL and AWS big data technologies. Explore and learn the latest AWS technologies to enhance...
should encompass are Software development skills preferably Python for platform building on AWS; Data engineering Spark (pyspark..., Redshift, and MWAA. Extract, transform, and load data from various sources using SQL and AWS big data technologies. Explore...
should encompass are Software development skills preferably Python for platform building on AWS; Data engineering Spark (pyspark..., Redshift, and MWAA. Extract, transform, and load data from various sources using SQL and AWS big data technologies. Explore...
of Spark/Scala, SQL, Python/PySpark, Databricks, ETL/ELT development using tools like Apache Airflow, omibo, data quality..., Python, SQL, AWS, cloud computing, and big data technologies. The role involves collaboration with multiple departments...
should encompass are Software development skills preferably Python for platform building on AWS; Data engineering Spark (pyspark..., Redshift, and MWAA. Extract, transform, and load data from various sources using SQL and AWS big data technologies. Explore...
to write complex sql) Python and Pyspark Working knowledge with primary AWS Services like Glue, Airflow, DMS, Cloudwatch...Role Cloud Data Engineer Experience 5+years Location Temporary Remote, Bangalore Skills SQL ( must able...
Top Skills: 1. SQL ( must able to write complex sql) 2. Python and Pyspark 3. Working knowledge with primary AWS.... • Implementation experience of Big Data technologies like Hadoop, Spark, Presto, Hive, and Hue will be a major advantage. • Knowledge...
experience of Big Data technologies like Hadoop, Spark, Presto, Hive, and Hue will be a major advantage. Knowledge of AWS...Title: Senior Cloud Data Engineer Location: Bangalore Top Skills: 1. Python and Pyspark 2. SQL ( must able...
, Python , PySpark, SQL, Airflow, Visualization tools & Databricks. Responsibilities: Design and implement the data... data source Ability to migrate the existing Talend ETL workflow into new ETL framework using AWS Glue/ EMR, PySpark...