Staff Software Engineer – Ozone/HDFS

Cloudera is looking for an exceptional and passionate software engineer with a strong distributed systems background to join the Storage Engineering team focused on building Apache Hadoop Ozone. The Storage team is responsible for primary storage and storage access layers which are core to the platform. Apache Hadoop Ozone is a new subproject of Apache Hadoop that provides a massively scalable distributed object store built on top of Hadoop Distributed Data Storage (HDDS). Ozone is designed to scale to tens of billions of files and blocks, and overcome the limitations of Hadoop Distributed File System (HDFS), namely, millions of small files and manage a huge number of datanodes. 

You will be directly involved in the design and implementation of  the core feature set of Apache Hadoop Ozone and Apache Ratis (open source RAFT implementation) and also contribute to HDFS that currently runs on thousands of nodes and has tens of petabytes of storage. Opportunity to join the team that created and wrote most of Hadoop code and make a huge impact on the big data and cloud computing industry.

Requirements:

• BS, MS or PhD in Computer Science

• Bachelors 10+ years of relevant industry experience (4+ for PhD candidate)

• Strong background in performance tuning, identifying performance bottlenecks and implementing performance optimizations

• Strong backend engineering skill set with expertise in Java, alternatively strong C++ skills but intermediate Java expertise

• Passionate about programming. Clean coding habits, attention to detail, and focus on quality

• Experience with large-scale, distributed systems design and development with a strong understanding of scaling, replication, consistency and high availability

• Solid experience with system software design and development with a strong understanding of computer architecture, storage, network and IO subsystems, and distributed systems

• Hands on programmer with strong data-structures and algorithms skillset

• Strong communication skills

Big pluses:

• Strong background in a distributed storage system including file systems, database storage internals, no-sql storage or distributed hash tables

• Strong understanding of Apache Hadoop and over 3+ years experience in systems software, including file systems

• Recognized contributions to open source projects

• Experience using projects in Apache Hadoop ecosystem such as Pig, MapReduce, HBase etc. is a big plus

• Good Understanding in scalable distributed file system development, RAFT replication framework or equivalent distributed consensus frameworks

Job Perks

Health and wellness

• Comprehensive medical, dental, and vision plans
• Life & disability
• On-site gyms at various locations
• Gym reimbursement
• Employee assistance program

Financial

• Competitive Retirement saving plans
• Employee Stock Purchase Program
• Flexible spending accounts
• Equity
• Variable incentive plans
• Commuter checks

Family

• Paid medical disability & child bonding leaves
• Family youth intern program
• Bring Your Child to Work Day
• Bring Your Parents to Work Day

Personal growth

• Volunteer time off policy
• Quarterly team building offsites
• Seminars
• Tuition reimbursement
• Hackathons
• Mentorship of interns

Perks

• Generous time off policies
• Free and catered lunches based on office location
• Casual dress code
• Social gatherings
• Discount programs
• T-shirt enthusiasm

Global

• Global wellness challenges
• Business travel insurance
• Redpoint global crisis management services