San Francisco Bay Area, CA

Engineer Jobs in San Francisco Bay Area, CA

3 jobs found

Include remote jobs

6d ago

Senior Scientific Data Engineer

Lawrence Berkeley National Laboratory San Francisco Bay Area, CA

San Francisco Bay Area, CA

6d ago

$139k - $235k/yr Full time Python Senior Apache Airflow

Apply Now

Job Description

Senior Scientific Data Engineer at Lawrence Berkeley National Laboratory in the San Francisco Bay Area, focusing on core scientific data systems, data workflows, and AI-ready data pipelines.

Responsibilities

Contribute to the design, development, and enhancement of JGI’s core scientific data and compute capabilities within a skilled engineering team.
Architect, build, deploy, and operate production automated systems, APIs, and workflows for genomic data movement, metadata management, job orchestration, data access, and large‑scale scientific computing.
Identify technical issues and integration gaps, driving continuous improvements across systems and processes.
Increase reliability, scalability, observability, interoperability, and maintainability of shared production data platforms while enabling sustainable operations.
Promote engineering best practices through technical reviews, knowledge sharing, and team process optimization.

Requirements

Bachelor’s degree (or equivalent knowledge/training) in Computer Science or related field, plus at least 8 years of relevant experience delivering production software and data systems that support metadata management, workflow orchestration, data lifecycle operations, and broad user data access, or an equivalent combination of education and experience.
Strong foundation in software and data engineering for data‑intensive distributed systems, including system design, concurrency, performance, and testing.
Experience with database and data storage technologies, including relational databases, object storage, and systems handling structured, semi‑structured, and large‑scale data.
Hands‑on experience with data engineering and event‑driven technologies such as Airflow or Kafka.
Experience using AI coding assistants (for example Claude Code, Codex, Cursor) with demonstrated ability to review and validate generated software for correctness, quality, security, maintainability, and production suitability.
Proficiency in Python and experience with one or more additional programming languages.
Excellent communication skills, including the ability to present complex technical information to internal teams and stakeholders.
Proven ability to collaborate effectively with users, stakeholders, and engineering teams to deliver results in a multidisciplinary environment.

Technologies

Python
Airflow
Kafka
Claude Code
Codex
Cursor
WDL
Nextflow

Benefits

Comprehensive health coverage and retirement options including pension or 401K‑style plans
Supportive culture with focus on belonging and team investment
Winter Holiday Shutdown each year
Parental bonding leave for both mothers and fathers
Pet insurance
Relocation assistance

Desired Qualifications

Master’s degree (or equivalent knowledge) in Computer Science or related field
Experience with genomics, bioinformatics, and/or next‑generation sequencing data
Proficiency with scientific workflow languages or systems such as WDL and Nextflow
Experience with full‑stack or front‑end application development
Background working in high performance computing environments

Additional Information

Application deadline: Priority consideration for resumes and cover letters by June 1, 2026; applications accepted until the posting is removed
Appointment type: Full‑time, exempt from overtime, 2‑year term with benefits eligibility; potential for extension or conversion to a Career appointment based on performance, funds, and needs
Salary range: Budgeted range of $139,440 to $174,312 annually; aligns with the broader $139,440 to $235,308 range for this job code; final salary depends on qualifications and experience
Background check: Required; convictions reviewed for relevance to responsibilities; a history does not automatically disqualify
Work modality: Hybrid schedule (remote and on‑site) at 1 Cyclotron Road, Berkeley, CA; must reside within 150 miles; flexible telework possibilities rare
Relocation assistance: Eligible
Work authorization: Must be legally authorized to work in the United States; no visa sponsorship provided
Misconduct disclosure: Finalist must disclose any relevant misconduct decisions within the last seven years

View full job page →

14d ago

Staff Data Engineer, Analytics

Discord San Francisco Bay Area, CA

San Francisco Bay Area, CA

14d ago

$248k - $279k/yr Full time Senior Analytics Business Intelligence

Apply Now

Job Description

Discord is seeking a Staff Data Engineer, Analytics to steer the technical strategy and architecture of its analytics data infrastructure. You will own the transformation and semantic layer and end-to-end metrics in collaboration with Data Science, Product, Finance, and Engineering.

The role is based onsite in the San Francisco Bay Area, CA, with a compensation range of USD 248,000 to 279,000 per year. This position requires at least seven years of relevant experience.

Below is a structured overview of the responsibilities, requirements, and technologies involved.

Responsibilities

Define the technical strategy and architectural direction for analytics data infrastructure, building and maintaining enterprise-scale curated datasets and data models.
Own end-to-end metric definitions, partnering with stakeholders to determine what to measure, designing production data models, and surfacing metrics and dimensions in dashboards and reports.
Design and implement sophisticated data models and analytical frameworks using SQL, Python, and modern data stack technologies.
Develop data quality programs, monitoring, anomaly detection, and alerting at scale, with governance, lineage tracking, and change-management practices appropriate for externally reported numbers.
Drive adoption of consistent data modeling patterns, naming conventions, documentation norms, and metric governance standards across the data organization.
Lead cross-functional technical initiatives across product verticals and mentor engineers to accelerate delivery and harden data systems.
Navigate ambiguity and make sound technical decisions with incomplete information, balancing short-term delivery with long-term infrastructure investment.

Requirements

7+ years of experience in analytics or data engineering with a strong focus on building curated, consumer-facing datasets.
7+ years of experience designing, developing, and maintaining robust data models from structured and unstructured sources.
Expert-level SQL and strong Python skills, with solid fundamentals in version control and CI/CD.
Proven experience implementing data quality audits, monitoring systems, and automated remediation for massive datasets.
Experience building and owning executive-level dashboards and reports using BI tools such as Looker, Tableau, or similar.
Strong business acumen and communication skills, comfortable translating ambiguous business questions into concrete metric definitions and explaining complex implementations to audiences ranging from engineers to executive leadership.
Track record of hands-on collaboration with Data Science, Finance, and Product teams.

Technologies

SQL
Python
Looker
Tableau
dbt
BigQuery

Benefits

Equity

Bonus Points

Passion for Discord or online communities
Experience building or contributing to a semantic layer or metrics store
Experience with modern analytics and data engineering tools and workflows (dbt, BigQuery, or similar)
Experience defining and governing metric standards across a data organization
Experience with reporting infrastructure subject to external audit or SOX compliance

View full job page →

14d ago

Lead Scientific Data Engineer

Lawrence Berkeley National Laboratory San Francisco Bay Area, CA

San Francisco Bay Area, CA

14d ago

$159k - $268k/yr Full time Python Apache Airflow Big Data

Apply Now

Job Description

Join Lawrence Berkeley National Laboratory's Joint Genome Institute in the San Francisco Bay Area on a hybrid schedule. This senior leadership role offers a salary range of USD 158,808 to 267,996 per year and a strong benefits package, including top-tier health and retirement options, a culture that values belonging, a Winter Holiday Shutdown, parental bonding leave, and pet insurance. The position focuses on providing technical leadership for core genomic data systems, data management, job orchestration, and platform integration to enable AI driven scientific discovery.

Benefits

Exceptional health and retirement benefits, including pension or 401K style plans
A culture where you’ll belong, with strong investment in our teams
Winter Holiday Shutdown each year in addition to vacation and sick time
Parental bonding leave for both mothers and fathers
Pet insurance

Responsibilities

Provide senior technical leadership for JGI’s core scientific data and compute platforms by developing roadmaps, data system architectures, and long-term strategy
Lead the design and deployment of production automated systems, APIs, and workflows supporting genomic data movement, metadata management, job orchestration, data access, and large-scale scientific computing
Improve reliability, scalability, observability, interoperability, and maintainability of shared production data systems while ensuring sustainable operations
Collaborate with product managers, scientists, and users to drive cross-team technical alignment and integration decisions addressing complex challenges and shared priorities

Requirements

Bachelor’s Degree in Computer Science or a related field and a minimum of 12 years of professional experience with large-scale scientific data and compute infrastructures, or an equivalent combination of education and experience
Proven experience leading the design, development, integration, and operation of production software and data systems supporting metadata management, workflow orchestration, data lifecycle operations, and broad user data access
Advanced knowledge of data and software engineering fundamentals for data-intensive distributed systems, including system design, concurrency, performance, and testing
Broad experience with databases and data storage technologies, including relational databases, object storage, and systems for managing structured, semi-structured, and large-scale data
Experience with data engineering and event-driven technologies such as Airflow or Kafka
Strong experience using AI coding agents such as Claude Code, Codex, or Cursor, including judgment in reviewing and validating generated software for production quality, security, and maintainability
Proficiency in Python and experience with one or more additional programming languages
Excellent communication skills, including the ability to present complex technical information to diverse audiences
Demonstrated ability to lead through influence in interdisciplinary environments, aligning users, stakeholders, and engineering teams around shared requirements and implementation plans

Technologies

Airflow
Kafka
Claude Code
Codex
Cursor
Python
WDL
Nextflow

About JGI

The Joint Genome Institute (JGI) is a global leader in genome science, helping shape the future of biological discovery through advanced genomic capabilities, expert support, and large-scale, AI-ready data resources. As a DOE Office of Science user facility supported by the Biological and Environmental Research (BER) program, JGI advances BER’s mission to achieve a predictive understanding of complex biological, Earth, and environmental systems in support of the nation’s energy and infrastructure.

View full job page →

Engineer Jobs in San Francisco Bay Area, CA

Senior Scientific Data Engineer

Staff Data Engineer, Analytics

Lead Scientific Data Engineer

Get Job Alerts