Looking For We’re hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem... is a strong plus. ⸻ Your Responsibilities Design and develop scalable data pipelines using Apache Spark and Scala Optimize and troubleshoot Spark...
, and YARN. Solid understanding of big data ecosystem and distributed computing. Experience with SQL and data modeling... with expertise in Python, PySpark, Hive, Hadoop HDFS, Oozie, and YARN to join our data engineering team. The ideal candidate...
, PySpark, SQL, and object-oriented or functional languages such as Java or C++. Establish data quality assurance processes..., and AWS Crawlers. o Advanced skills in Python, PySpark, and SQL with exposure to Java, C++, or similar programming languages...
providers including Apache PySpark AWS Glue GCP DataProc/DataFlow and Azure ADF/ADLF. Understanding of data warehousing... manipulation and scripting. • Working knowledge of SQL and experience writing optimized queries. • Familiarity with AWS data...
across systems. Implement both batch and real-time data processing solutions using Spark, Kafka, or Hadoop. Translate business..., or Looker. Conduct exploratory data analysis and develop reports using Python and SQL. Collaborate with data science teams...
in Python (Pandas, NumPy, PySpark) and SQL. ETL & Workflow Orchestration: Hands-on experience with Airflow, dbt, Azure Data... (S3, ADLS, GCS). Big Data Technologies: Working knowledge of Spark, Hadoop, and Kafka. Visualization Tools: Expertise...
languages used for data manipulation. Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc... tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently...
, PySpark, SQL, and object-oriented or functional languages such as Java or C++. · Establish data quality assurance processes..., and AWS Crawlers. o Advanced skills in Python, PySpark, and SQL with exposure to Java, C++, or similar programming languages...
processing (Spark, PySpark, Ray, Flink) Deep experience with workflow orchestration (Airflow, Dagster, Prefect) Strong hands... distributed processing frameworks integrated with Airflow for orchestration Champion Apache Iceberg-based data lakehouse...
: Data Engineering Skills Required: Python, Pyspark, SQL, Cloud, ETL, ELT, Data Pipeline Role: Required Tech Stack... and/or orchestration tools like IICS, Talend, Matillion, Airflow, Azure Data Factory, AWS Glue, GCP Composer, etc Working knowledge...
, Pyspark, ETL Role: Required Tech Stack: Has strong execution knowledge of Data Modeling, Databases in general (SQL... of an ETL and/or orchestration tools like IICS, Metallion, Airflow, Azure Data Factory, AWS Glue, GCP Composer, etc. Working...
Python, java, sql, javascript, spark, pyspark About Standard Chartered We're an international bank, nimble enough to act... ability to program in Python (pandas, numpy, pytest, pyspark modules and data manipulation techniques) Working knowledge...
PYTHON, JAVA, SQL, JAVASCRIPT, SPARK, PYSPARK About Standard Chartered We're an international bank, nimble enough to act... ability to program in Python (pandas, numpy, pytest, pyspark modules and data manipulation techniques) Working knowledge...
ability to program in Python (pandas, numpy, pytest, pyspark modules and data manipulation techniques) Working knowledge... with strong attention to detail Good knowledge on data pipelines and spark architecture. Good knowledge/exposure to public cloud services...
Azure\AWS services Database SPARK Python Java Kubernetes PySpark Qualifications Bachelor's in computer... engineering or equivalent PYTHON, JAVA, SQL, JAVASCRIPT, SPARK, PYSPARK About Standard Chartered We're an international bank...
scripting, PySpark, Scoop, Scala SQL Expertise in writing complex queries, performance tuning, query optimization Data... on-premises & on-cloud with good technical knowledge on big data and Tools. Good exposure in problem solving & stakeholder...
Spark, PySpark, and related big data technologies to develop distributed data processing pipelines. Continuous Improvement.... If you're excited about combining deep Python skills with cutting-edge technologies like Apache Spark, PySpark, GraphDB, SQL...
warehousing solutions (Databricks), and big data technologies (e.g., Hadoop, Spark). Proficient in Structured Streaming... pride in supporting our code in production. Our production systems rely on python, Databricks, PySpark, Airflow, Docker...
H DatabricksJob SummaryWe are seeking an experienced Databricks Developer with 57 years of expertise in big data... engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark, Databricks, PySpark, and cloud...
& on-cloud with good technical knowledge on big data and Tools. Good exposure in problem solving & stakeholder management skills..., and custom Python-based ETL frameworks Must know Programming skills like ETL using Hadoop, Python, SQL, Shell scripting, PySpark...