Data Engineer - Remote
San Francisco, California
Contract/Temporary
$55.00 - $65.00 per Hour
LHH is partnering with a leading company to find a passionate and experienced Sr. Data Engineer to join their data platform team. In this role, you will be instrumental in building a highly reliable and trustworthy data lakehouse that is leveraged across the organization to derive insights and make real-time decisions. You will drive new data projects, build reliable data pipelines, set up robust monitoring and alerting systems, and develop data solutions to support a diverse set of use cases.
This company values a fun, collaborative, and team-oriented work environment, where accomplishments are celebrated.
Responsibilities
Design and develop data pipelines using tools like Apache Airflow or leveraging Snowflake's external tables functionality.
Translate HiveQL queries to Snowflake SQL, ensuring compatibility and efficient data processing.
Utilize dbt to model and transform data within Snowflake, adhering to best practices for data governance and maintainability.
Configure and manage data pipelines in GCP to orchestrate data movement and processing tasks.
Collaborate with data analysts and stakeholders to understand data requirements and ensure a successful migration outcome.
Monitor and optimize data pipelines for performance and scalability.
Develop and implement automated testing procedures to validate data quality and integrity after migration.
Document the migration process and provide ongoing support for the migrated data warehouse on Snowflake.
Requirements
Minimum 5+ years of experience as a Data Engineer with a proven track record of successful data warehouse/data lake implementation and management.
Deep understanding of leveraging Snowflake to build highly performant and resilient data warehouses.
Strong expertise in HiveQL, SQL, and experience with data warehousing/lake house concepts (dimensional modeling, data quality, etc.).
Strong programming knowledge in Python.
Experience with Apache Spark for large-scale data processing (a plus).
Proficiency in dbt for data modeling and transformation in Snowflake preferred.
Experience working with Google Cloud Platform (GCP) and its data storage services (GCS, BigQuery - a plus).
Excellent written and verbal communication skills with the ability to collaborate effectively with cross-functional teams.
Strong problem-solving skills and a passion for building efficient and scalable data solutions.
Snowflake certification preferred.
Preferred Qualifications
Strong understanding of data architectures and patterns.
Experience in DataOps implementation and support.
Experience in MLOps implementation and support.
Experience in building and supporting AI/ML platforms.
About the Company
The company is a leading platform providing innovative solutions to individuals and businesses. They are committed to delivering high-quality services and continuously innovating to meet the evolving needs of their clients. This role offers an exciting opportunity to be part of a dynamic team, contribute to impactful projects, and grow within a supportive and rewarding environment.
Benefit offerings include medical, dental, vision, life insurance, short-term disability, additional voluntary benefits, EAP program, commuter benefits and 401K plan. Our program provides employees the flexibility to choose the type of coverage that meets their individual needs. Available paid leave may include Paid Sick Leave, where required by law; any other paid leave required by Federal, State, or local law; and Holiday pay upon meeting eligibility criteria. Applicants must be authorized to work for any employer in the U.S. and sit stateside. Our client is unable to sponsor or take over sponsorship of an employment Visa at this time. **Please no C2C applicants*
Pay Details: $55.00 to $65.00 per hour Search managed by: Eben MahoneyBenefit offerings available for our associates include medical, dental, vision, life insurance, short-term disability, additional voluntary benefits, EAP program, commuter benefits and a 401K plan. Our benefit offerings provide employees the flexibility to choose the type of coverage that meets their individual needs. In addition, our associates may be eligible for paid leave including Paid Sick Leave or any other paid leave required by Federal, State, or local law, as well as Holiday pay where applicable.
Equal Opportunity Employer/Veterans/Disabled
To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.lhh.com/us/en/candidate-privacy
The Company will consider qualified applicants with arrest and conviction records subject to federal contractor requirements and/or security clearance requirements.
Data Engineer - Remote
LHH
29 days ago
$55.00 - $65.00 per Hour
Contract/Temporary
San Francisco, California
LHH is partnering with a leading company to find a passionate and experienced Sr. Data Engineer to join their data platform team. In this role, you will be instrumental in building a highly reliable and trustworthy data lakehouse that is leveraged across the organization to derive insights and make real-time decisions. You will drive new data projects, build reliable data pipelines, set up robust monitoring and alerting systems, and develop data solutions to support a diverse set of use cases.
This company values a fun, collaborative, and team-oriented work environment, where accomplishments are celebrated.
Responsibilities
Design and develop data pipelines using tools like Apache Airflow or leveraging Snowflake's external tables functionality.
Translate HiveQL queries to Snowflake SQL, ensuring compatibility and efficient data processing.
Utilize dbt to model and transform data within Snowflake, adhering to best practices for data governance and maintainability.
Configure and manage data pipelines in GCP to orchestrate data movement and processing tasks.
Collaborate with data analysts and stakeholders to understand data requirements and ensure a successful migration outcome.
Monitor and optimize data pipelines for performance and scalability.
Develop and implement automated testing procedures to validate data quality and integrity after migration.
Document the migration process and provide ongoing support for the migrated data warehouse on Snowflake.
Requirements
Minimum 5+ years of experience as a Data Engineer with a proven track record of successful data warehouse/data lake implementation and management.
Deep understanding of leveraging Snowflake to build highly performant and resilient data warehouses.
Strong expertise in HiveQL, SQL, and experience with data warehousing/lake house concepts (dimensional modeling, data quality, etc.).
Strong programming knowledge in Python.
Experience with Apache Spark for large-scale data processing (a plus).
Proficiency in dbt for data modeling and transformation in Snowflake preferred.
Experience working with Google Cloud Platform (GCP) and its data storage services (GCS, BigQuery - a plus).
Excellent written and verbal communication skills with the ability to collaborate effectively with cross-functional teams.
Strong problem-solving skills and a passion for building efficient and scalable data solutions.
Snowflake certification preferred.
Preferred Qualifications
Strong understanding of data architectures and patterns.
Experience in DataOps implementation and support.
Experience in MLOps implementation and support.
Experience in building and supporting AI/ML platforms.
About the Company
The company is a leading platform providing innovative solutions to individuals and businesses. They are committed to delivering high-quality services and continuously innovating to meet the evolving needs of their clients. This role offers an exciting opportunity to be part of a dynamic team, contribute to impactful projects, and grow within a supportive and rewarding environment.
Benefit offerings include medical, dental, vision, life insurance, short-term disability, additional voluntary benefits, EAP program, commuter benefits and 401K plan. Our program provides employees the flexibility to choose the type of coverage that meets their individual needs. Available paid leave may include Paid Sick Leave, where required by law; any other paid leave required by Federal, State, or local law; and Holiday pay upon meeting eligibility criteria. Applicants must be authorized to work for any employer in the U.S. and sit stateside. Our client is unable to sponsor or take over sponsorship of an employment Visa at this time. **Please no C2C applicants*
Pay Details: $55.00 to $65.00 per hour Search managed by: Eben MahoneyBenefit offerings available for our associates include medical, dental, vision, life insurance, short-term disability, additional voluntary benefits, EAP program, commuter benefits and a 401K plan. Our benefit offerings provide employees the flexibility to choose the type of coverage that meets their individual needs. In addition, our associates may be eligible for paid leave including Paid Sick Leave or any other paid leave required by Federal, State, or local law, as well as Holiday pay where applicable.
Equal Opportunity Employer/Veterans/Disabled
To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.lhh.com/us/en/candidate-privacy
The Company will consider qualified applicants with arrest and conviction records subject to federal contractor requirements and/or security clearance requirements.