Sr Data Engineer
Job Description
\n
\n
Experience Summary
\n6–8 years of Data Engineer specialized in building document and knowledge-oriented data pipelines for regulatory/compliance domains, with strong capabilities in structured transformations, knowledge graphs, and containerized platform integration.
\nCore Responsibilities / Focus
\n- \n
- \n
Build and operate data ingestion and transformation pipelines for legal/regulatory content
\n - \n
Normalize and transform heterogeneous source formats (e.g., XML/HTML/structured exports) using tools such as XSLT
\n - \n
Implement pipelines for embeddings generation, indexing, and enrichment for downstream AI/RAG systems
\n - \n
Design and manage RDF-based knowledge representations and SPARQL-accessible datasets
\n - \n
Integrate storage and processing components across containerized/cloud environments
\n - \n
Support event-driven or integration-heavy workflows (e.g., via Apache Camel, message brokers)
\n - \n
Ensure reproducibility, maintainability, and operational handover of data pipelines
\n
Core Skills (Must-Have)
\n- \n
- \n
Python
\n - \n
Docker / Docker Compose
\n - \n
Kubernetes
\n - \n
Knowledge Graphs (RDF)
\n - \n
SPARQL
\n - \n
XSLT
\n - \n
/Java
\n - \n
Embeddings pipelines / vector preparation
\n - \n
Azure Storage (or equivalent cloud storage services)
\n - \n
Apache Camel
\n - \n
Git
\n
Preferred / Nice-to-Have
\n- \n
- \n
Docling (or similar Document conversion)
\n - \n
CloudEvents
\n - \n
Kafka (or other message brokers)
\n - \n
Event-based systems / event-driven architecture
\n - \n
Dev Containers
\n - \n
GitOps
\n - \n
Documentation practices
\n
Domain Advantage
\nExperience processing legal/regulatory source documents and preserving semantic structure / provenance
\nFamiliarity with content domains such as EU regulation, privacy, ESG, and compliance frameworks
\n\nQualifications\n
\n
\n
Educational qualification:
\nBE/B.Tech or Equivalent Degree
\nExperience :
\n6-8 Years
\nMandatory/requires Skills :
\n Strong hands-on expertise in Python, Docker / Docker Compose, Kubernetes, Knowledge Graphs,Java (RDF),SPARQL,XSLT,Embeddings pipelines / vector preparation, Azure Storage (or equivalent cloud storage services),
Apache Camel,Git
\nPreferred Skills :
\n\n