Senior Data Engineer

About

YellowIpe

Our mission is to inspire the connection between technology and people, we foster the best of our professionals through our expertise in finding and attracting the best talent for the best projects.

The Focus on People, Collaboration and Commitment are the pillars that guide us in this trajectory.

Join the yellow team as our new Senior Data Engineer!

Responsibilities:

Design, develop, and maintain robust, scalable, and secure data applications, systems, services and platforms.

Write clean, efficient, and testable code following established standards and practices.

Participate in all phases of the software development lifecycle, including planning, estimation, development, testing, deployment, and support.

Collaborate closely with team members, including architects, business analysts, testers, and delivery leads, to ensure requirements are well-understood and implemented effectively.

Contribute to technical design discussions and help define the most appropriate solutions.

Perform code reviews and provide constructive feedback to promote knowledge sharing and code quality.

Assist with the setup and maintenance of continuous integration and deployment pipelines.

Investigate, diagnose, and resolve defects or performance issues.

Support the adoption of modern data engineering practices, tools, and technologies.

Requirements:

Deep knowledge of Python for data transformation scripting.

Deep knowledge of Databricks (or Apache Spark) for data processing.

Understanding of data lake/data warehouse architecture.

Proficiency in SQL and understanding of relational database concepts.

Experience working with structured and semi-structured data (e.g., JSON, Parquet, CSV).

Experience developing applications in cloud environments (e.g., AWS, Azure, GCP).

Good understanding of version control systems (e.g., Git).

Strong analytical and problem-solving skills.

Eagerness to learn new tools, technologies, and best practices in data engineering.

Excellent oral and written communication skills both technical and user focused.

Experience working with on/offshore team.

Important information:

Hybrid flex work model.

Candidates must be living in Portugal.

Apply for this opportunity in our website! =)