Principal Data Engineer, Atlassian

Principal Data Engineer

Atlassian

Location:

United States, San Francisco

Category:

IT - Software Development

Contract Type:

Employment contract

Salary:

168700.00 - 271100.00 USD / Year

Save Job

Apply Position

Job Description:

Atlassian is looking for a Principal Data Engineer to join our Data Engineering Team and play a tech lead & architect role to build world-class data solutions and applications that power crucial business decisions throughout the organization.

Job Responsibility:

Own the technical evolution of the data engineering capabilities and be responsible for ensuring solutions are being delivered incrementally, meeting outcomes, and promptly escalating risks and issues
Establish a deep understanding of how things work in data engineering, use this to direct and coordinate the technical aspects of work across data engineering, and systematically improve productivity across the teams
Maintain a high bar for operational data quality and proactively address performance, scale, complexity and security considerations
Drive complex decisions that can impact the work in data engineering. Set the technical direction and balance customer and business needs with long-term maintainability & scale
Understand and define the problem space, and architect solutions. Coordinate a team of engineers towards implementing them, unblocking them along the way if necessary
Lead a team of data engineers through mentoring and coaching, work closely with the engineering manager, and provide consistent feedback to help them manage and grow the team
Work with close counterparts in other departments as part of a multi-functional team, and build this culture in your team

Requirements:

You have 12+ years of experience in a Data Engineer role as an individual contributor
You have at least 2 years of experience as a tech lead for a Data Engineering team
You are an engineer with a track record of driving and delivering large (multi-person or multi-team) and complex efforts
You are a great communicator and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success
Experience with building streaming pipelines with a micro-services architecture for low-latency analytics
Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
Experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools
Experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka)
Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a 'Streaming First' mindset to drive Atlassian's business growth and improve the product experience

Nice to have:

Built and designed Kappa or Lambda architecture data platforms and services
Experience implementing Master Data Management (MDM) solutions
Built pipelines using Databricks and is well-versed with their APIs

What we offer:

health coverage
paid volunteer days
wellness resources

Additional Information:

Job Posted:

March 19, 2025

Employment Type:

Fulltime

Work Type:

Remote work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.