Senior Data Engineer – ETL, Data Warehousing, Big Data

Unleash transformative data solutions — drive innovation through scalable, cutting-edge pipelines!

Porto-based opportunity with hybrid work model (up to 3 remote days per week).

As a Senior Data Engineer, you will be working for our client, a leading player in the data engineering and big data landscape.

You will be instrumental in designing, developing, and maintaining robust ETL/ELT pipelines, data warehousing solutions, and large-scale data processing systems.

Join a forward-thinking team focused on turning complex data into actionable insights and pioneering data-driven strategies for global impact.

Your main responsibilities:

Design, develop, test, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources into data warehouses and lakes.

Configure and manage ETL tools (e.g., Semarchy, Stambia, Talend, DataStage) to automate data integration processes.

Write and optimize complex SQL queries; develop and maintain data models (ODS, staging, core analytics schemas).

Implement data quality checks, lineage tracking, and monitoring to ensure data accuracy, security, and compliance.

Develop and manage job orchestration workflows using VTOM or similar tools; troubleshoot failures, monitor job execution, and implement retry strategies.

Automate operational tasks utilizing UNIX shell scripting and develop reusable scripts for system automation.

Collaborate closely with data architects, analysts, and business stakeholders to translate requirements into scalable data solutions.

Optimize pipeline performance and scalability, identifying bottlenecks and proposing improvements.

Ensure adherence to data governance, security policies, and regulations, including data masking and access controls.

Prepare comprehensive technical documentation, runbooks, and facilitate knowledge transfer.

You're ideal for this role if you have:

5+ years of experience in data engineering or a related field.

Proven expertise with ETL/ELT tools (Semarchy, Stambia, Talend, DataStage or similar).

Strong SQL skills and experience with relational databases (Oracle, SQL Server, PostgreSQL, Snowflake).

Hands-on experience with data modeling and warehousing concepts.

Familiarity with job orchestration tools (VTOM, Virtual-M or equivalent).

Knowledge of UNIX/Linux scripting (shell scripting, awk, sed, Python is a plus) to automate tasks.

Solid understanding of data warehousing, data quality, data lineage, and metadata management.

Strong problem-solving, debugging, and troubleshooting skills.

Excellent communication skills in English; French-speaking ability is a plus.

Ability to work effectively in a fast-paced environment and collaborate with diverse stakeholders.

It is a strong plus if you have:

Experience with cloud data platforms such as GCP.

Knowledge of data governance, data cataloging, and security standards.

Familiarity with big data technologies (Spark, Hadoop).

Understanding of CI/CD and DevOps practices for data pipelines.

Language Required for the role:

Fluent in English.

French language skills are a plus.

Eligibility to work in the EU:

Only candidates with an existing legal right to work in Europe will be considered for this role.

#MAKEYourCareerBETTER

Interested?

Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.

https://itdsportugal.com/en/it-jobs/8965/?utm_source=itjobs