Data Engineer

Atlassian • Full-time • Remote • 2w ago

The Finance Data Engineering team focuses on empowering data-informed decisions through the development of scalable data products. Collaborating with data science and engineering teams, you will play a pivotal role in delivering valuable insights into financial data by developing robust pipelines, implementing data quality processes, creating conformed data models, and building effective visualizations.

Joining our team means engaging with highly intelligent and straightforward colleagues. We thrive on posing challenging questions and encouraging one another to enhance our output continuously. While we value individual drive, we also emphasize collaboration. Our primary focus is on driving growth by delivering precise data and valuable insights to partners throughout the organization.

As a Data Engineer in this role, you will directly report to the Sr Data Engineering Manager located in North America.

Working at Atlassian

Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.

As a Data Engineer in the DE team, you will have the opportunity to apply your strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You enjoy working in a fast paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code and test cases.

Below are the key responsibilities:

Partner with Product Managers, Engineering, analytics, and business teams to review and gather the data/reporting/analytics requirements and build trusted and scalable data models, data extraction processes, and data applications to help answer complex questions.
Design and implement data pipelines to ETL data from multiple sources into a central data warehouse.
Improve data quality by using and improving internal tools/frameworks to automatically detect DQ issues.
Develop and implement data governance procedures to ensure data security, privacy, and compliance.
Implement new technologies to improve data processing and analysis.
Coach junior data engineers to improve their skills.

On your first day, we'll expect you to have:

A BS in Computer Science or equivalent experience
At least 5+ years professional experience as a Software Engineer or Data Engineer
Strong programming skills (Python, Java or Scala preferred)
Experience writing SQL, structuring data, and data storage practices
Experience with data modeling
Knowledge of data warehousing concepts
Experience building data pipelines, platforms
Experience with Databricks, Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
Experience in modern software development practices (Agile, TDD, CICD)
Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies.
A willingness to accept failure, learn and try again
An open mind to try solutions that may seem crazy at first
Experience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)

It's preferred that you have:

Experience building self-service tooling and platforms
Built and designed Kappa architecture platforms
Contributed to open source projects (Ex: Operators in Airflow)
Experience with Data Build Tool (DBT)

Benefits & Perks

Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more. To learn more, visit go.atlassian.com/perksandbenefits.

About Atlassian

At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together.

We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.

To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.

To learn more about our culture and hiring process, visit go.atlassian.com/crh.