SR. Data Engineer - Assistant Vice President - job post

Tech Stack

Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines using Big Data technologies (e.g., Hadoop, Spark, Kafka, Hive, Parquet, Avro) to ingest, process, and transform large volumes of structured and unstructured data.
• Implement and optimize ETL/ELT processes for data ingestion, cleansing, transformation, and loading into data warehouses, data lakes, and other data stores.
• Build and maintain data pipelines outcomes as data federations layers for lambda and Data Mesh architecture using tools like Starburst with strategy for adopting AI techniques-based use cases.
• Develop and deploy microservices-based architectures to support data-intensive applications and ensure scalability, resilience, and maintainability.
• Ensure data quality, integrity, and security throughout the data lifecycle and contribute to the continuous improvement of data engineering processes, standards, and best practices.

Soft Skills

Benefits

• Medical
• Dental
• Vision
• 401k
• Life Insurance
• Disability Insurance
• Wellness Programs
• Planned Time Off
• Sick Leave
• Paid Holidays

Culture

Requirements