: Build and optimize ETL/ELT pipelines using Python, Airflow, and DBT to ingest, transform, and load data into Snowflake..., and governance standards are met throughout the migration process. SKILLS Must have Python, Airflow / DBT, Docker...
/ DBT Experience in one or more cloud platforms – Preferably Azure /AWS/GCP In-depth knowledge of data warehousing...
Senior Data Engineer (Data Bricks) \n Primary Skills ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data... Orchestration: Airflow • Data Transformation & Integration: DBT, Fivetran, Informatica • Streaming & Messaging: Kafka • BI...
., Anthropic Claude). Operationalize ETL/ELT jobs and data pipelines with Airflow/dbt, PySpark, and streaming systems (Kafka.... Monitoring/observability using Prometheus, Grafana, Loki, Jaeger, OpenTelemetry. Scripting proficiency in Python and/or Bash...
., Anthropic Claude). Operationalize ETL/ELT jobs and data pipelines with Airflow/dbt, PySpark, and streaming systems (Kafka.... Monitoring/observability using Prometheus, Grafana, Loki, Jaeger, OpenTelemetry. Scripting proficiency in Python and/or Bash...
in BigQuery. ● Develop and maintain analytics-focused transformation logic. ● Use Python for exploratory analysis... of Python for data analysis and experimentation. ● Experience with data visualization tools such as Looker, Tableau, Power BI...
to/from Snowflake, Azure storage account. Proficiency in at least one of the following languages: Python, C#, C++, F#, Java...). Expertise with Airflow, Qlik, Fivetran, Azure Data Factory. Management of Snowflake through DBT scripting. Solid understanding...
and GraphQL services using Python (FastAPI, Flask, Django) and Node.js. Apply 12-factor and microservices principles (idempotency... where applicable. Collaborate with data engineering on Airflow/dbt-driven pipelines and PySpark jobs that expose API endpoints...
., Anthropic Claude). Operationalize ETL/ELT jobs and data pipelines with Airflow/dbt, PySpark, and streaming systems (Kafka.... Monitoring/observability using Prometheus, Grafana, Loki, Jaeger, OpenTelemetry. Scripting proficiency in Python and/or Bash...
. ● Develop and maintain analytics-focused transformation logic. ● Use Python for exploratory analysis, experimentation analysis.... ● Hands-on experience with BigQuery or similar cloud data warehouses. ● Working knowledge of Python for data analysis...
to/from Snowflake, Azure storage account. Proficiency in at least one of the following languages: Python, C#, C++, F#, Java...). Expertise with Airflow, Qlik, Fivetran, Azure Data Factory. Management of Snowflake through DBT scripting. Solid understanding...
and GraphQL services using Python (FastAPI, Flask, Django) and Node.js. Apply 12‑factor and microservices principles (idempotency... where applicable. Collaborate with data engineering on Airflow/dbt‑driven pipelines and PySpark jobs that expose API endpoints...
., Anthropic Claude). Operationalize ETL/ELT jobs and data pipelines with Airflow/dbt, PySpark, and streaming systems (Kafka.... Monitoring/observability using Prometheus, Grafana, Loki, Jaeger, OpenTelemetry. Scripting proficiency in Python and/or Bash...
, and other stakeholders. · Design, develop, and maintain high performance ETL/ELT pipelines using Pyspark, Python, SQL · Build & optimize... efficiency. Data engineering with 4-8 years of experience with strong proficiency in PySpark, Python, SQL. · Hands...
across our ingestion platform (Airflow) and transformation layer (dbt), ensuring data flows reliably from source systems into BigQuery... dbt models, implement data quality checks, and collaborate closely with analysts and stakeholders across the business...
, and other stakeholders. · Design, develop, and maintain high performance ETL/ELT pipelines using Pyspark, Python, SQL · Build & optimize... efficiency. Data engineering with 4-8 years of experience with strong proficiency in PySpark, Python, SQL. · Hands...
, and other stakeholders. · Design, develop, and maintain high performance ETL/ELT pipelines using Pyspark, Python, SQL · Build & optimize... efficiency. Data engineering with 4-8 years of experience with strong proficiency in PySpark, Python, SQL. · Hands...
, and other stakeholders. · Design, develop, and maintain high performance ETL/ELT pipelines using Pyspark, Python, SQL · Build & optimize... efficiency. Data engineering with 4-8 years of experience with strong proficiency in PySpark, Python, SQL. · Hands...
Strong proficiency in SQL, Python, and ETL/ELT development. Experience with SSIS, MSSQL, and building Python-based pipelines (dbt... components: Integration Hub, MID Server. Data pipeline tools: SSIS, Python pipelines, dbt (preferred). Optional exposure...
Dataflow, Composer, Dataform/dbt, Pub/Sub, and Vertex AI Architect and build real-time streaming data pipelines using Cloud..., Cloud Composer, Cloud Storage, Pub/Sub, Dataproc, and Vertex AI Programming Excellence: Expert-level Python/Java...