Design, develop, and maintain scalable big data pipelines and architectures.
Work with large datasets from various sources and transform them for analysis.
Implement and optimize ETL processes using big data tools.
Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions.
Monitor and troubleshoot data pipelines for performance and reliability issues.
Manage and maintain big data platforms (e.g., Hadoop, Spark, Kafka).
Ensure data quality, security, and compliance with company policies.
Continuously evaluate and adopt new big data technologies and best practices.
