Data Engineering Team Lead

Similarweb is the leading digital intelligence platform used by over 3500 global customers. Our wide range of solutions power the digital strategies of companies like Google, eBay, and Adidas. We help our customers succeed in today’s digital world by giving them access to data-driven insights, competitive benchmarks, strategic analysis, and more. In 2021, we went public on the New York Stock Exchange, and we haven’t stopped growing since! We are looking for a Data Engineering Team Lead to drive the development and optimization of our data infrastructure. So, what will you be doing all day? Team Management Serve as the direct manager for data engineers, providing regular feedback, career guidance, and technical mentorship. Translate business requirements into actionable technical roadmaps; prioritize and assign daily tasks using sprint methodologies. Cultivate a collaborative, high-performance team culture focused on continuous improvement and engineering excellence. Cultivate a collaborative, high-performance team culture rooted in a delivery mindset, a business-driven focus, and engineering excellence. Hands on Engineering Design, build, and maintain robust, scalable data pipelines capable of processing massive datasets. Oversee and maintain multiple development and production environments to ensure seamless deployment and high availability. Design and implement highly cost-efficient cloud data infrastructure, constantly monitoring and optimizing resource utilization. Research, develop, and integrate AI models and autonomous agents into the data ecosystem to automate pipeline monitoring, optimize data curation, and unlock intelligent data-driven capabilities. Required Skills & Qualifications Technical Requirements 5+ years of experience in data engineering, with 2+ years in a leadership role. Strong hands-on experience handling massive datasets using PySpark, Spark, or Hadoop. Advanced proficiency in Python. Proven experience working within AWS (or alternative major cloud infrastructure). Practical experience working with LLMs, AI frameworks, or vector databases to build automated, agentic data workflows. Solid understanding of Docker and Kubernetes for containerizing and orchestrating data workloads. Experience managing complex, multi-stage development and production lifecycles Leadership & Soft Skills Excellent interpersonal and communication skills with a natural ability to connect with, motivate, and mentor team members. Strong organizational skills with a track record of planning, scoping, and prioritizing team tasks effectively. A strategic thinker who can balance immediate operational needs with long-term infrastructure scalability and cost-efficiency. Why you’ll love being a Similarwebber: You’ll actually love the product you work with: Our customers aren’t our only raving fans. When we asked our employees why they chose to come work at Similarweb, 99% of them said “the product.” Imagine how exciting your job is when you get to work with the most powerful digital intelligence platform in the world. You’ll find a home for your big ideas: We encourage an open dialogue and empower employees to bring their ideas to the table. You’ll find the resources you need to take initiative and create meaningful change within the organization. We offer competitive perks & benefits: We take your well-being seriously, and offer competitive compensation packages to all employees. We also put a strong emphasis on community, with regular team outings and happy hours. You can grow your career in any direction you choose: Interested in becoming a VP or want to transition into a different department? Whether it’s Career Week, personalized coaching, or our ongoing learning solutions, you’ll find all the tools and opportunities you need to develop your career right here. Diversity isn’t just a buzzword: People want to work in a place where they can be themselves. We strive to create a workplace that is reflective of the communities we serve, where everyone is empowered to bring their full, authentic selves to work. We are committed to inclusivity across race, gender, ethnicity, culture, sexual orientation, age, religion, spirituality, identity and experience. Our culture of equality and mutual respect also helps us better understand and serve our customers in a world that is becoming more global, more diverse, and more digital every day. We will handle your application and information related to your application in accordance with the Applicant Privacy Policy available here.