Business Area:
Engineering
Seniority Level:
Mid-Senior level
At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.
The Cloudera Product Engineering Team is seeking a talented Staff Software Development Engineer to drive continuous improvement in our Data Platform. You will play a critical role in the development, testing, and delivery of high-quality features for the CDP platform, specifically focusing on the Cloudera REST Catalog and Cloudera Lakehouse Optimizer.
As a Staff Software Engineer, you will work on complex issues requiring in-depth evaluation of variable factors. You will exercise independent judgment in selecting methods and techniques to obtain results, and you will be expected to lead, mentor, and guide a group of junior engineers while ensuring project milestones are met.
What you'll do
Design and develop features in Cloudera Iceberg REST Catalog and Cloudera Lakehouse Optimizer product areas.
Develop comprehensive strategies for automated testing (incorporating negative, regression, and end-to-end testing) and performance testing. Leverage AI/tools where applicable to write new tests for existing and new features.
Build advanced automated testing frameworks, tools, and suites in Python (pytest), Shell, or Java (TestNG/JUnit) to ensure upgradeability, scalability, and stability.
Design, automate, and execute tests that ensure product reliability under stress, effective failure recovery, and seamless version upgrades with minimal downtime. Verify horizontal/vertical scaling behavior.
Work with documentation team to create or enhance product documentation. Author blogs on product features or best practices to promote adoption and awareness
Partner closely with Dev/PM teams to ensure code testability, build necessary test hooks, and define project schedules and resource allocation models for successful delivery.
Lead, mentor, and guide junior engineers. Advocate for engineering best practices, quality standards, and continuous resilience validation within CI/CD pipelines (Jenkins).
Engage with customers, seek their feedback and enhance product usability and visibility. Debug system-level deployment issues, conduct root cause analysis, and resolve failures.
Requirements
8 years of related experience with a Bachelor’s degree; or 6 years and a Master’s degree; or a PhD with 3 years of experience; or equivalent experience.
Strong knowledge in at least one of: Java or C++.
Hands-on experience with Unix/Linux and DevOps technologies (Docker, Kubernetes, Ansible, Jenkins, Github, Maven).
Strong knowledge of QA methodology, test case/plan creation, and automation framework debugging.
Working knowledge of AWS/Azure/GCP cloud environments.
Experience with upgrades, scalability in distributed systems, and Airflow frameworks.
General knowledge of large-scale distributed systems and/or data management systems.
Excellent communication and collaboration skills. Proven ability to work from broad specifications to independently resolve challenging design/enhancement issues and troubleshoot production failures.
You may also have:
Working knowledge of the Hadoop ecosystem.
Experience with Generative AI applications.
Demonstrated history of leading a group of engineers to deliver on a complex project plan.