Senior Data Engineer, Atlassian

Senior Data Engineer

Atlassian

Location:

India, Bengaluru

Category:

IT - Software Development

Contract Type:

Employment contract

Salary:

Not provided

Save Job

Apply Position

Job Description:

Atlassian is looking for a Senior Data Engineer to join our Go-To Market Data Engineering (GTM-DE) team responsible for building our data lake, maintaining big data pipelines/services, and facilitating the movement of billions of messages each day. You'll work directly with business stakeholders and engineering teams to enable growth and retention strategies. You'll help ingest data faster, make data pipelines more efficient, and build micro-services to enable self-serve capabilities at scale.

Job Responsibility:

Help our stakeholder teams ingest data faster into our data lake
Make our data pipelines more efficient
Build micro-services, architect, design, and enable self-serve capabilities at scale
Work on an AWS-based data lake backed by open source projects such as Spark and Airflow
Identify ways to make our platform better and improve user experience
Apply strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake

Requirements:

A BS in Computer Science or equivalent experience
At least 5+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer
Strong programming skills (Python, Java or Scala preferred)
Experience writing SQL, structuring data, and data storage practices
Experience with data modeling
Knowledge of data warehousing concepts
Experience building data pipelines, platforms, micro services, and REST APIs
Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
Experience in modern software development practices (Agile, TDD, CICD)
Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies
A willingness to accept failure, learn and try again
An open mind to try solutions that may seem crazy at first
Experience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)

Nice to have:

Experience building self-service tooling and platforms
Built and designed Kappa architecture platforms
Built pipelines using Databricks and well versed with their API’s
Contributed to open source projects (Ex: Operators in Airflow)

What we offer:

Health coverage
Paid volunteer days
Wellness resources

Additional Information:

Job Posted:

March 19, 2025

Employment Type:

Fulltime

Work Type:

Remote work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.