and platforms. - Optimize SQL queries and Python scripts to enhance data processing efficiency and automation. - Participate... such as Snowpipe, SnowSQL, and Snowpark to design robust ETL/ELT processes. Hold a Bachelor of Engineering/Bachelor of Technology...
and performant data patterns for consumption by various data warehouses, marts, and BI environments. Proficiency in Python, ETL... of software development experience preferably in a Data related field. Proficiency in ETL development and design using Python...
and optimize cloud-based data platforms and ETL pipelines using AWS services. Build, enhance and maintain data lake and data... e. Identify areas to increase efficiency and automation of processes f. Set up and maintain automated data processes g...
connectors] Building ETL, MID Server, and external data synchronization solutions for ServiceNow. Scripted automation via Flow..., and accessibility best practices. Performance analysis, debugging, and troubleshooting complex portal UIs Integration & Automation...
and proactively discover and attack issues. Share ownership in quality, test automation, continuous integration and delivery... Lakehouse, ETL, Data Pipelines, or Business Intelligence is highly desirable. Experience in software design...
, transform, and load (ETL) data using Power Query or other tools. Ensure data quality and integrity before analysis. Design... models for faster report loading. Implement enhancements and automation (e.g., using Power Automate). Provide...
and relational database design. Strong programming experience in Python for data pipelines and automation. Deep hands..., and hierarchical dimensions. Experience designing and operating ETL/ELT pipelines for production analytics and AI/ML workloads...
experience - 7+ years of creating process improvements with automation and analysis experience - Bachelor's degree... of SQL/ETL - Experience working with large-scale data mining and reporting tools (examples: SQL, MS Access, Essbase, Cognos...
, automation, and optimization across ETL pipelines, data models, and ML workflows. Ensure alignment of solution architecture... pipelines in partnership with AI/ML engineers. Processes Design and develop scalable ETL and ELT pipelines using PySpark...
to increase efficiency and quality and on supporting and developing the team. You will explore further automation opportunities... working with our more expert team members and leaders. Technical Skills: Most critical skills: Python, ETL development...
Build and optimize data pipelines and ETL workflows with Python/ Java/ Go/ Scala & run on Flink, Spark, Google Cloud... candidates need to share the Use-Case they are supporting Integrate GenAI capabilities with data pipelines to enhance automation...
. Database Objects and Architecture: A solid understanding of database architecture is crucial. Data Handling and ETL...: Experience in Extract, Transform, Load (ETL) processes Database Tools & Familiarity with Unix/Linux environments and shell...
and optimize cloud databases, including Azure PostgreSQL and Azure SQL Server.ETL/ELT Development:Design, build, and maintain... data warehouses within the Fabric environment.Fabric Pipelines & Dataflows: Proficiency in building ETL/ELT pipelines using...
: Monitor daily data pipelines (ELT/ETL) and dbt jobs to ensure successful completion. Proactively identify delays or failures... issues, and data discrepancies. Automation: Write scripts (using Python) to automate repetitive maintenance tasks, alerting...
Metadata, improving quality of Metadata. ETL or ELT experience Experienced in engaging and managing stake holders.... Experience in automation would be advantageous. Any wholesale bank product knowledge would be advantageous Proficiency...
problems Fine-tune transformer models for specific tasks and domains Perform ETL (Extract, Transform, Load) activities... (e.g., SQL, NoSQL) and experience with data warehousing and data lake architectures. Experience with ETL processes...
Standardization & Automation (SnA) team has an exciting opportunity for you! We are looking for a top notch Data Engineer to be part... automated ETL pipelines using scripting languages such as Python, Spark, SQL and AWS services such as S3, Glue, Lambda...
Software Development Life Cycle tools to enhance automation and maximize process efficiency. Employs technical troubleshooting... certification(s) and hands-on experience with AWS services, Spark, AWS Glue ETL, and Python. Exposure to messaging platforms...
capabilities covering digital services, enterprise architecture, data analytics, intelligent automation, and machine learning..., Python, R, or Power BI/Tableau. Comfortable with data pipelines, ETL processes, and cloud environments (GCP, AWS, or Azure...
to engineering automation, management or development of production level systems Contribute to project engineering design...), ETL, and SQL optimization for large-scale data transformations....