Senior Data Engineer
We are the company behind WordPress.com, Jetpack, WooCommerce, and Tumblr! We are looking for a Senior Data Engineer with experience in Spark/Scala to join our team of data scientists and engineers to build, deploy, and iterate on large-scale data pipelines and applications.
How do we work
- We’re kind to each other and our users – we strive to build a positive, supportive, and inclusive culture of cohesive teams focused on delivering value to our customers.
- We work as a global and distributed workforce resulting in a unique way of working built around our creed.
- We offer flexible work arrangements allowing our team members to work when they feel best.
- We welcome collaboration, and you can be involved in any discussion across our many communication channels.
Enough about us, let‘s talk more about you. The Senior Data Engineer position might be a good fit if you:
- Have hands-on Data Engineering experience for around 5+ years with strong experience in big data.
- Have hands-on experience with implementing large-scale data flows, primarily focusing on Spark/Scala.
- Have production experience with open source technologies.
- Ideally, you have experience in managing and tuning on-premise Hadoop and related services in production.
- Alternatively, hands-on AWS/GCP analogs (S3/RedShift/etc. or Google Storage/Big Query/etc.) and, preferably, a strong functional programming background.
- Love working with Hive, Kafka, Airflow, Trino, etc.
- Live on the application level, however, are comfortable tuning it with OS/low-level.
- Understand that with on-premise you gain free hands to deal with OS compared to cloud solutions, gaining a much more internal understanding of the tech.
- Care about architecture, unit testing, and building reliable infrastructure and pipelines.
- Are motivated to propose technical solutions, own software architecture, evaluate technologies and infrastructure, and develop technical roadmaps for future applications.
- Bring programming skills in multiple programming languages and paradigms. In addition to Scala and Spark, you are likely to encounter Python, Java, PHP, and SQL in this role and the idea of using them on a regular basis should not be a blocker for you.
- Are familiar with professional software engineering methods and standards such as coding conventions, code reviews, continuous integration, build processes, testing, and operations.
- Are open and able to travel 3-4 weeks per year to meet your teammates in person. We hold an annual all-company meeting every year, and meet up with our teams for a week once or twice per year. Important note: at the moment all company travel has been suspended due to COVID-19. Automattic is monitoring government and health agency reports closely and responding however possible to prioritize safety and well-being for our team and communities.
Like all positions at Automattic, you’ll work remotely, and can be based wherever you live.
How to apply
Please answer the following questions in the application form. Applications without these questions answered will not be considered:
- Tell us some details about an interesting at-scale data problem you’ve worked on. What made it interesting or challenging?
- Include a link to a recent favorite blog post or paper about working with lots of data.
- What questions do you have for us?
We’re a distributed company with more than 1800 Automatticians in 96 countries speaking 90+ different languages. We democratize publishing and commerce so anyone with a story can tell it, and anyone with a product can sell it, regardless of income, gender, politics, language, or country.
We believe in Open Source and the vast majority of our work is available under the GPL.
Diversity, Equity, and Inclusion at Automattic
We’re improving diversity, equity, and inclusion in the tech industry. At Automattic, we want people to love their work and show respect and empathy to all. We welcome differences and strive to increase participation from traditionally underrepresented groups. Our DEI committee involves Automatticians across the company and drives grassroots change. For example, this group has helped facilitate private online spaces for affiliated Automatticians to gather and helps run a monthly DEI People Lab series for further learning. Diversity, Equity and Inclusion is a priority at Automattic, though our dedication influences far more than just Automatticians: We make our products freely available and translate our products into and offer customer support in numerous languages. We require unconscious bias training for our hiring teams and ensure our products are accessible across different bandwidths and devices. Learn more about our dedication to diversity, equity, and inclusion and our Employee Resource Groups.