Lead Data Engineer

Role: Lead Data Engineer

Seniority Level: Senior

Preferred Education: Bachelor’s degree in Computer Science, Engineering, or related field

Required Experience: 7+ years of relevant experience in data engineering, data science, or software development

Key Responsibilities:

- Lead and mentor data engineering, data science, and analytics team members

- Architect and implement scalable end-to-end data pipelines and distributed data processing

- Design and optimize ETL/ELT workflows and develop REST APIs and microservices

- Build and maintain cloud infrastructure and implement enterprise data warehousing solutions

Must-Have Skills/Technologies:

- Python

- SQL

- AWS cloud services

- Docker

- Kubernetes

- Airflow

- Spark/PySpark

Good-to-Have Skills/Technologies:

- Snowflake

- ELK stack

- System integrations (Slack, Glean AI, OpenMetadata)

- GenAI / LLM-based implementations

- Containerization using Docker and advanced Kubernetes

Must-Have Soft Skills:

- Strong leadership

- Analytical thinking

- Problem-solving capabilities

- Stakeholder management

- Strong verbal & written communication skills

Good-to-Have Soft Skills:

- Self-driven and motivated

- Detail-oriented

- Patient and persistent

- Focused