, and YARN. Solid understanding of big data ecosystem and distributed computing. Experience with SQL and data modeling... with expertise in Python, PySpark, Hive, Hadoop HDFS, Oozie, and YARN to join our data engineering team. The ideal candidate...
using: Job orchestration tools like Tidal/Airflow/ or similar Knowledge on No SQL Databricks Certified Data Engineer... of data tools in the Big Data Environment. Lead the evaluation, implementation and deployment of emerging tools and processes...
, PySpark, Spark, S3, Shell scripting- Strong skills in Airflow, Kinesis, Step function and related ETL-DW data services... Data Platform implementation using AWS tech stack. Mandatory Skills:- Excellent understanding and design experience of Big...
, PySpark, Spark, S3, Shell scripting- Strong skills in Airflow, Kinesis, Step function and related ETL-DW data services... Data Platform implementation using AWS tech stack. Mandatory Skills:- Excellent understanding and design experience of Big...
, PySpark, SQL, and object-oriented or functional languages such as Java or C++. Establish data quality assurance processes..., and AWS Crawlers. o Advanced skills in Python, PySpark, and SQL with exposure to Java, C++, or similar programming languages...
pipelines to handle large datasets efficiently. Employ frameworks such as Apache Spark, Databricks, Snowflake or Airflow...; Master's degree preferred 5-10 years of experience in data engineering, with a strong focus on big data technologies Expert...
pipelines to handle large datasets efficiently. Employ frameworks such as Apache Spark, Databricks, Snowflake or Airflow...; Master's degree preferred 5-10 years of experience in data engineering, with a strong focus on big data technologies Expert...
: Data Engineering Skills Required: Python, SQL, Cloud, Data Warehousing, Data Modeling, spark/pyspark Role... Working knowledge of an ETL and/or orchestration tools like IICS, Talend, Matillion, Airflow, Azure Data Factory, AWS Glue...
providers including Apache PySpark AWS Glue GCP DataProc/DataFlow and Azure ADF/ADLF. Understanding of data warehousing... manipulation and scripting. • Working knowledge of SQL and experience writing optimized queries. • Familiarity with AWS data...
languages used for data manipulation. Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc... tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently...
processing (Spark, PySpark, Ray, Flink) Deep experience with workflow orchestration (Airflow, Dagster, Prefect) Strong hands... distributed processing frameworks integrated with Airflow for orchestration Champion Apache Iceberg-based data lakehouse...
and Databricks Delta Lake Architecture ● Should have hands-on experience in SQL, Python and Spark (PySpark) ● Candidate... Databricks and AWS/ Azure Stack ● Ability to provide solutions that are forward-thinking in data engineering and analytics...
technical proficiency in Python, PySpark, Databricks, SQL, and modern data orchestration platforms such as Airflow and Control-M...) Data Engineering & Pipelines Spark / PySpark SQL Data Science Python Microservices / APIs Qualifications...
's in computer engineering or equivalent Languages-Python, java, SQL, JavaScript, spark, pyspark Skills and Experience API...\microservices architecture Azure\AWS services Database SPARK Python Java Kubernetes PySpark About Standard Chartered...
in computer engineering or equivalent Languages-Python, java, sql, javascript, spark, pyspark Skills and Experience API...\microservices architecture Azure\AWS services Database SPARK Python Java Kubernetes PySpark About Standard Chartered...
in computer engineering or equivalent Languages-Python, java, sql, javascript, spark, pyspark Skills and Experience API...\microservices architecture Azure\AWS services Database SPARK Python Java Kubernetes PySpark About Standard Chartered...
in computer engineering or equivalent Languages-Python, java, sql, javascript, spark, pyspark Skills and Experience API...\microservices architecture Azure\AWS services Database SPARK Python Java Kubernetes PySpark About Standard Chartered...
/ AWS) Data Engineering & Pipelines Spark / PySpark SQL Data Science Python Microservices / APIs About Standard... pipelines using PySpark, Databricks, Airflow, and Control-M. Implement real-time data streaming solutions using Spark...
SQL Python Spark / PySpark Data Science Cloud Platforms (Azure / AWS) Qualifications Education: Bachelor...). The ideal candidate is highly skilled in Python, Spark, SQL, cloud data services, orchestration frameworks, and modern...
Python, java, sql, javascript, spark, pyspark About Standard Chartered We're an international bank, nimble enough to act... ability to program in Python (pandas, numpy, pytest, pyspark modules and data manipulation techniques) Working knowledge...