Software Engineer - Analytics Infrastructure job at Twitter

Job Description

Twitter is looking for great engineers to build the next generation of tools for working with big data. You have a passion for building massively scalable data-crunching systems wrapped in elegant, easy to use APIs. You will tackle problems involved in processing, coordinating, and organizing hundreds of Petabytes of data spread across multiple compute clusters and data centers. You will build systems that are on the cutting edge of 'big data' infrastructure. You will open-source a lot of your work (examples of our OSS creations include Ambrose, Parquet, and Scalding). You will be relied on by dozens of engineering teams, hundreds of co-workers, and many millions of users.

Responsibilities:

Improve the scalability, resilience, observability, and efficiency of our core systems
Create new data processing systems as necessary
Build tools to simplify and automate large-scale data management and analysis
Build storage systems, libraries, and frameworks that let Twitter grow
Cooperate with other teams and contribute to the open-source community

Requirements:

BS, MS, or PhD in Computer Science or equivalent work experience
Excellent knowledge of in C++, Java, Scala, or other modern systems language
Great debugging and reasoning skills

Pluses:

Experience with distributed systems, database internals, optimizers, or performance analysis
Familiarity and/or history of contributions to Apache Pig, Apache Hive, or similar frameworks
Familiar with Cassandra, HBase, Hadoop, and related technologies
Demonstrated contributions to open-source software
Active user of Twitter

Interested in this position?

Click here to learn how to get in touch