Data Engineer

Tech Stack

Solid badges = required, outlined = preferred

Responsibilities

• Architect and implement high-volume data transformation pipelines using a proprietary internal ETL solution, defining logic with custom DSL to clean, enrich, and integrate disparate data sources.
• Partner closely with the Product Team to translate business requirements into technical specifications, providing detailed documentation and feedback on data model changes or architectural adjustments.
• Ensure end-to-end automation of customer-facing functionality by designing and deploying supporting scripts and microservices for complex requirements outside the main ETL framework.
• Monitor, troubleshoot, and optimize data pipelines to ensure data integrity, low latency, and high availability.
• Proactively identify bottlenecks in current ETL processes and propose improvements to DSL or underlying infrastructure for scalability and maintainability.

Soft Skills

Culture

Requirements