MS Fabric Engineer
Key Responsibilities
Data Engineering & Development
Build and maintain data ingestion pipelines using Data Factory, Dataflows Gen2, Pipelines, and event driven patterns.
Develop Lakehouse structures using Delta Lake, Notebooks (PySpark), and medallion architecture.
Implement Fabric Data Warehouse objects (tables, stored procedures, views, SQL endpoints).
Create and optimize semantic models for Power BI, including Direct Lake datasets.
Develop KQL databases and real time analytics components where required.
Operational Delivery
Implement CI/CD pipelines for Fabric using Git integration and DevOps best practices.
Monitor, troubleshoot, and optimize Fabric workloads for performance and cost.
Ensure data quality through validation rules, profiling, and automated checks.
Support production deployments, incident resolution, and environment management.
Collaboration & Stakeholder Support
Work with Hiscox business teams to understand data requirements and translate them into technical solutions.
Collaborate with Solution Architects to ensure alignment with overall platform design.
Provide technical guidance to analysts, report developers, and data consumers.
Governance, Security & Compliance
Apply data governance standards using Purview integration, lineage, and metadata management.
Implement access controls, workspace security, and data protection policies.
Ensure compliance with insurance regulatory requirements (e.g., GDPR, Solvency II, IFRS 17).
Continuous Improvement
Contribute to reusable frameworks, templates, and accelerators for Fabric engineering.
Stay updated with new Fabric features and recommend adoption where beneficial.
Participate in code reviews, design sessions, and engineering best practice forums.
________________________________________
Required Skills & Experience
Technical Expertise
4-8 years of experience in data engineering, with strong Azure analytics background.
Hands on experience with Microsoft Fabric, including:
o Data Engineering (Lakehouse, Notebooks, Pipelines)
o Data Factory (Dataflows Gen2, Pipelines)
o Data Warehouse (SQL Endpoint, Direct Lake)
o Power BI (datasets, DAX, semantic models)
o OneLake & Delta Lake
Strong skills in SQL, PySpark, Python, and ETL/ELT development.
Experience with Azure services such as ADLS, ADF, Databricks, Synapse, Event Hub, and Key Vault.
Domain Knowledge
Experience working with insurance data (policies, claims, pricing, exposure, risk) is highly desirable.
Understanding of regulatory reporting (Solvency II, IFRS 17) is a plus.
Soft Skills
Strong problem solving and analytical skills.
Ability to work in agile, cross functional teams.
Clear communication and documentation abilities.
________________________________________
Nice-to-Have
Microsoft Fabric or Azure Data Engineer certifications.
Experience migrating from Synapse/Databricks to Fabric.
Familiarity with Lloyd's market data structures.
________________________________________
Engagement Details
Location: Hybrid/Remote with occasional visits to NTT offices (Delhi/NCH).
Reporting: Works under the MS Fabric Solution Architect and collaborates with Hiscox Data Platform teams.
Duration: Multi phase program aligned with Hiscox's data modernization roadmap.