Design, develop, and maintain scalable big data solutions
Build and optimize data pipelines using tools like Spark, Kafka, and Hive
Develop ETL processes to ingest and transform large volumes of data from multiple sources
Collaborate with data scientists, analysts, and business stakeholders to support data needs
Implement data quality, monitoring, and governance frameworks
Optimize data storage and query performance on distributed systems
Work with cloud-based platforms like AWS, Azure, or GCP for big data workloads
Ensure data security, compliance, and privacy standards are met
