Data Engineer - Bangalore

Professional Summary :Experienced and results-driven Big Data Engineer with over 5 years of hands-on experience designing, developing, and optimizing large-scale data processing systems using Hadoop, Spark (Scala/Java/PySpark), and other components of the Big Data ecosystem. Proven ability to build scalable and fault-tolerant data pipelines, enabling efficient data ingestion, transformation, and analytics.

Key Expertise:

• Big Data Tools: Hadoop (HDFS, YARN, MapReduce), Spark (Core, SQL, Streaming, MLlib)

• Languages: Scala, Java, Python (PySpark)

• Data Ingestion & Processing: Kafka, Flume, Sqoop, Nifi

• Data Warehousing & Querying: Hive, Impala, HBase, Pig

• Workflow Orchestration: Oozie, Airflow

• Cloud & DevOps: AWS EMR, S3, Lambda, Docker, Git, Jenkins

• Databases: MySQL, PostgreSQL, NoSQL (MongoDB, Cassandra)

• Monitoring & Logging: Grafana, Prometheus, ELK Stack

• Other Skills: Agile/Scrum, CI/CD pipelines, Performance Tuning