Python, PySpark, Apache Airflow, Databricks, Azure Data Factory, SQL, Neo4j, Graph DB

Date Of Requisition

Sep'25

ECMS REQ ID/ Unique ID

538700

PU

DNASURE

Number of Openings

5

Country

India

Detailed JD (Roles and Responsibilities)

Job Description:

We are looking for a skilled Sr. Data Engineer to join our team. A Data Engineer is a professional who designs, constructs, tests, and maintains architectures such as databases and large-scale processing systems. They are responsible for developing and translating computer algorithms into prototype code and maintaining, organizing, and identifying trends in large datasets. Data engineers essentially Client the groundwork for data analysis and systems that Data Scientists use for their analytics and business intelligence work. They manage and optimize data pipelines, create secure databases, and handle data cleansing.

Responsibilities:

1. Design, construct, install, test, and maintain highly scalable data management systems.

2. Develop and implement data architecture and database designs.

3. Build large-scale data processing systems.

4. Ensure systems meet business requirements and industry practices.

5. Integrate new data management technologies and software engineering tools into existing structures.

6. Collaborate with data scientists and architects on several projects.

7. Neo4j, Graph DB, Python, Spark, Azure Databricks / Azure Synapse, SQL

Data Engineers must have strong technical skills including a deep understanding of database structure, data modeling, and computer science fundamentals. Common knowledge and skills often associate with languages like Python, Java, Scala; and technologies like Hadoop, SQL, and MongoDB.

Requirements:

• Experience in Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF).
• The ideal candidate should have experience in Fabric Data Layer Engineering Lead ,PowerBI, ETL, SSMS, AWS, Power BI Report Server, Azure Synapse, Spotfire, Azure Data Bricks, Azure Data Factory, HIVE, Hadoop, NIFI, Kafka, Python 3.x, API Development, Embedded Systems, Tokenization, Search Index Configuration, Open AI Integration.
• SQL DBA, Stored procedure, table trigger statements, bulk update/archival jobs.
• Must have strong Python, Databricks and Pyspark.
• In depth knowledge in SQL development including writing complex stored procedure, Performance tuning.
• Require SQL expertise to analyze PBI code structure- removal of garbage and optimizing query.
• Good Knowledge on SSIS

Experience in developing and maintaining data security policies and procedures

Total Experience

5-8 yrs

Relevant Experience

5+ yrs

Mandatory skills

Python, PySpark, Apache Airflow, Databricks, Azure Data Factory, SQL, Neo4j, Graph DB

Desired skills

Power BI

Domain (Industry)

Service

Work Location

India

Background check (Before onboarding / After onboarding)

After onboarding

BGV Vendor

Any

Mode of Interview- Telephonic/Face to Face/Video Interview

Face to Face and Video Interview

WFO / WFH / Hybrid

Hybrid

Shift Details (Time)

General shift (depends on project requirement)

Vendor Rate in currency of Work Location

7000 to 8000 INR/day