Title:: GCP Data Engineer role with Snowflake
Candidate should have experience with Snowflake Data Clean Room, no submission will be entertained with out this skill set.
Location:: Remote
JD
Key Responsibilities
Design, develop and optimize scalable data pipelines and ETL workflows using Google Cloud Platform (GCP), particularly leveraging BigQuery, Dataflow, Dataproc and Pub/Sub.
Design and manage secure, efficient data integrations involving Snowflake and BigQuery.
Write, test and maintain high-quality Python code for data extraction, transformation and loading (ETL), analytics and automation tasks.
Use Git for collaborative version control, code reviews and managing data engineering projects.
Implement infrastructure-as-code practices using Pulumi for cloud resources management and automation within GCP environments.
Apply clean room techniques to design and maintain secure data sharing environments in alignment with privacy standards and client requirements.
Collaborate with cross-functional teams (data scientists, business analysts, product teams) to deliver data solutions, troubleshoot issues and assure data integrity throughout the lifecycle.
Optimize performance of batch and streaming data pipelines, ensuring reliability and scalability.
Maintain documentation on processes, data flows and configurations for operational transparency.
________________________________________
Required Skills
Strong hands-on experience with GCP core data services: BigQuery, Dataflow, Dataproc and Pub/Sub.
Proficiency in data engineering development using Python.
Deep familiarity with Snowflake-data modeling, secure data sharing and advanced query optimization.
Proven experience with Git for source code management and collaborative development.
Demonstrated ability using Pulumi (or similar IaC tools) for deployment and support of cloud infrastructure.
Practical understanding of cleanroom concepts in cloud data warehousing, including privacy/compliance considerations.
Solid skills in debugging complex issues within data pipelines and cloud environments.
Effective communication and documentation skills.
#L!-CEIPAL
...Experienced Box Truck Driver Fort Walton Beach, FL Pay: $18 an hour Schedule: Monday Friday, 7:30 AM 5:00 PM About the Role: We are seeking an experienced Box Truck Driver to join our team in Fort Walton Beach. This is a long-term opportunity for...
...perfect fit for you. No prior bus driving experience? No problem! Well provide full paid... ...of Minnesota Commercial Drivers License (CDL) with passenger and school bus endorsements... ...depending on experience. ~ Flexible, local and part-time (no nights or weekends)....
...Job Title: Supply Chain Contract Specialist Location: Edison, NJ 08837 Duration: 19 Months | Hours: 40/week | Schedule... ...AM 4:30 PM Pay: $40/hr Job Summary "Navitas Healthcare, LLC" is seeking Supply Chain Contract Specialist for an...
...Overview DK Security is Michigans fastest growing security company. Established in 1995, we began as an investigations firm and quickly expanded to provide uniform security, event staff security, loss prevention services, and much more based on the needs of our clients...
...Work from Home Data Entry & Office Administration Remote Entry-Level Role About the Job We are seeking motivated individuals in Hemet, California, USA , for an entry-level remote position in data entry, office administration, and online research. This...