Senior Data Engineer, Atlassian

Senior Data Engineer

Atlassian

Location:

India, Bengaluru

Category:

IT - Software Development

Contract Type:

Employment contract

Salary:

Not provided

Save Job

Apply Position

Job Description:

Atlassian is looking for a Senior Data Engineer to join their Go-To Market Data Engineering (GTM-DE) team, responsible for building their data lake, maintaining big data pipelines/services, and facilitating the movement of billions of messages each day. The successful candidate will collaborate with business stakeholders and various engineering teams to drive growth and retention strategies. Enthusiasm for solving challenging problems and creating scalable services is crucial.

Job Responsibility:

Help our stakeholder teams ingest data faster into our data lake
Make our data pipelines more efficient
Build micro-services, architecting, designing, and enabling self serve capabilities at scale
Apply your strong technical experience in building highly reliable services on managing and orchestrating a multi-petabyte scale data lake
Transform vague requirements into solid solutions
Identify ways to make our platform better and improve our users' experience

Requirements:

A BS in Computer Science or equivalent experience
At least 5+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer
Strong programming skills (Python, Java or Scala preferred)
Experience writing SQL, structuring data, and data storage practices
Experience with data modeling
Knowledge of data warehousing concepts
Experience building data pipelines, platforms, micro services, and REST APIs
Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
Experience in modern software development practices (Agile, TDD, CICD)
Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies
A willingness to accept failure, learn and try again
An open mind to try solutions that may seem crazy at first
Experience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)

Nice to have:

Experience building self-service tooling and platforms
Built and designed Kappa architecture platforms
Built pipelines using Databricks and well versed with their API’s
Contributed to open source projects (Ex: Operators in Airflow)

What we offer:

Health coverage
Paid volunteer days
Wellness resources

Additional Information:

Job Posted:

March 19, 2025

Employment Type:

Fulltime

Work Type:

On-site work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.