GCP + Databrick + SQL | 3 to 5 Years | IST Time| Bangalore | Onsite
Job Description:
Role:GCP+DataBricks+ SQL
Key Responsibilities:
Design and implement scalable data pipelines using Databricks, ensuring optimal data processing and storage.
Develop complex SQL stored procedures, views, and scripts for efficient data manipulation and retrieval.
Conduct performance tuning of SQL queries and database systems to ensure high performance and responsiveness.
Utilize Delta Lake for reliable data storage and management, ensuring data consistency and integrity.
Work with Google Big Query for large-scale data analytics, optimizing queries for performance and cost-efficiency.
Collaborate with the reporting team to provide tailored views and tables that support their reporting and analytics requirements.
Monitor and optimize the performance of data pipelines and infrastructure, ensuring high availability and scalability.
Implement data governance and security best practices to protect sensitive information and ensure compliance with regulations.
Stay up to date with emerging technologies and industry trends in data engineering, and recommend improvements to our data architecture and processes.