Project Overview
We are looking for an experienced Senior / Lead Data Engineer to join a long-term project focused on building reliable data pipelines, improving engineering analytics, and ensuring secure data processing within a PCI-regulated environment.
The specialist will take technical ownership of data engineering activities and provide technical guidance to two other Data Engineers on the project.
Key Responsibilities
- Design and develop scalable data ingestion and processing pipelines using AWS.
- Build baseline data extracts from CI/CD systems and Jira to support DORA and Flow Metrics.
- Implement and maintain data provenance, lineage, and traceability across pipelines.
- Prepare masked or synthetic datasets for secure testing.
- Ensure compliant handling of sensitive data within a PCI environment.
- Lead technical activities, review deliverables, and support two Data Engineers.
- Collaborate with project stakeholders to ensure data quality, reliability, and security.
Required Skills & Experience
- Strong hands-on experience in Data Engineering, preferably at Senior or Lead level.
- Solid experience with AWS data services and cloud-based data pipelines.
- Strong Python and SQL skills.
- Experience designing and developing ETL/ELT pipelines.
- Understanding of data provenance, lineage, and data governance principles.
- Experience working with sensitive data, data masking, or synthetic test data.
- Knowledge of data security and compliance requirements.
- Ability to take technical ownership and guide other engineers.
- Good communication skills in English.
Nice to Have
- Experience integrating Jira and CI/CD systems (GitHub Actions, GitLab CI, Jenkins, etc.).
- Familiarity with DORA Metrics and Flow Metrics.
- Previous experience in PCI DSS or other regulated environments.
- Experience with AWS Glue, S3, Lambda, Redshift, or Step Functions.
- Experience with Airflow or other workflow orchestration tools.
Project Timeline & Travel
- December 1, 2026: Planned project start at 50% allocation.
- December 14–18, 2026: Initial on-site visit to Portugal.
- Late December: Planned holiday project pause.
- January 4, 2027: Project restart, with planned transition to full-time allocation.
- January / Early February 2027: Second business trip to Portugal.
- Total engagement: Approximately 11-12 months.
Candidate Requirements
- Must be based in Europe to support collaboration with the client’s Portugal-based team.
- Must be available for occasional business trips to Portugal.
- Must be comfortable working in a distributed international team.
Submission Details
- Please share suitable candidate profiles, including:
- Updated CV in English.
- Current location.
- Availability and earliest possible start date.
- Expected hourly or daily rate in EUR.
- Availability for business trips to Portugal.
- Brief summary of relevant AWS Data Engineering and technical leadership experience.