Job Description:
1. Develop and deploy scalable data ingestion and transformation processes using GCP services to move and process data efficiently.
2. Set up and optimize cloud-based data storage solutions like BigQuery for analytical workloads and Cloud Storage for unstructured data.
3. Implement data validation, error checks, and cleaning processes to maintain data accuracy, completeness, and consistency.
4. Fine-tune SQL queries, database performance, and data pipelines for efficiency and reliability, using tools and techniques for scalability.
Essential Skills: Big Query and Big Table, Pyspark with 6-8 yrs of exp |
