Lead Data Engineer / Senior Data Engineer

Lead Data Engineer / Sr. Data Engineer

Experience: 7+ Years

Summary:

The Lead Data Engineer will design and implement data solutions that support the organization's

strategic business goals.

Responsibilities:

Focuses on data modelling, database design, performance optimization and ETL pipeline.

Tests, monitors, manage and validate data warehouse activity including data extraction,

transformation, movement, loading, cleansing, and updating processes.

Design and building simple (non - complex) reusable components of larger process or

framework to support analytics products with guidance from experienced peers

Participate in design, code, test plans and dataset implementation performed by other data

engineers in support of maintaining data engineering standards

Implement automated workflows and routines using workflow scheduling tools

Skills Needed:

5+ years' experience developing Data & Analytic solutions

Experience with data warehousing, Data Lake, analytic processes, and methodologies.

Proficient experience with SQL queries functionality, Power BI, Tableau, Business Intelligence

software, and ETL tools.

Strong knowledge of data integration, data quality and multi-dimensional design.

Experience in Data Migration from on-premises databases to Cloud.

Knowledge with AWS/Azure/GCP data technologies is a plus.

Knowledge of web services (e.g., SOAP and REST)

Experience with scripting languages such as Shell, Python

Experience of Big Data platforms, enabling non-technical users to gain insights

Experience in big data tools like spark, pyspark,

Hands on experience with modern data storage systems (e.g. S3, Snowflake, Athena, Glue)

Experience with workflow scheduling tools such as Airflow

Added Advantage:

Certifications on Snowflake, AWS /Azure/GCP