Senior Data Engineer, Atlassian

Senior Data Engineer

Atlassian

Location:

India, Bengaluru

Category:

IT - Software Development

Contract Type:

Employment contract

Salary:

Not provided

Save Job

Apply Position

Job Description:

Atlassian is looking for a Senior Data Engineer to join our Go-To Market Data Engineering (GTM-DE) team which is responsible for building our data lake, maintaining our big data pipelines / services and facilitating the movement of billions of messages each day. We work directly with the business stakeholders and plenty of platform and engineering teams to enable growth and retention strategies at Atlassian. We are looking for an open-minded, structured thinker who is passionate about building services that scale.

Job Responsibility:

Help our stakeholder teams ingest data faster into our data lake
Make our data pipelines more efficient
Build micro-services
Architect, design, and enable self-serve capabilities at scale
Apply your strong technical experience building highly reliable services
Manage and orchestrate a multi-petabyte scale data lake
Transform vague requirements into solid solutions
Solve challenging problems creatively

Requirements:

A BS in Computer Science or equivalent experience
At least 5+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer
Strong programming skills (Python, Java or Scala preferred)
Experience writing SQL, structuring data, and data storage practices
Experience with data modeling
Knowledge of data warehousing concepts
Experience building data pipelines, platforms, micro services, and REST APIs
Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
Experience in modern software development practices (Agile, TDD, CICD)
Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies
A willingness to accept failure, learn and try again
An open mind to try solutions that may seem crazy at first
Experience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)

Nice to have:

Experience building self-service tooling and platforms
Built and designed Kappa architecture platforms
Built pipelines using Databricks and well versed with their API’s
Contributed to open source projects (Ex: Operators in Airflow)

What we offer:

Health coverage
Paid volunteer days
Wellness resources

Additional Information:

Job Posted:

March 19, 2025

Employment Type:

Fulltime

Work Type:

Remote work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.