Data Engineering Tech Lead

Description We're building the data foundation that will power Nimble at massive scale. We're looking for a battle-tested Data Engineering Tech Lead who has built and scaled data infrastructure at companies where the bar is exceptionally high. This is a ground-up, architect-and-build role. You'll own the entire data infrastructure layer - caching, indexing, storage architecture, scalability patterns - and set the standard for how data flows across the organization at scale. Responsibilities Own and architect Nimble's entire data infrastructure from the ground up - storage, caching, indexing, and platform foundations. Make the hard technology calls: which databases, caching layers, orchestration systems, and data patterns we adopt - and why - based on scale, performance, and long-term engineering excellence. Drive data scalability across the engineering organization, partnering closely with platform, backend, and product engineers. Lead hands-on - you design, you build, you review, you mentor. Requirements 10+ years in data engineering, with significant time spent at fast-moving, high-scale tech companies. Deep expertise in database architecture across OLTP, OLAP, NoSQL, and columnar systems, including MongoDB/Atlas, PostgreSQL, Redis, Elasticsearch, ClickHouse, and Couchbase. Proven hands-on experience with DAG-based workflow orchestration systems such as Apache Airflow, Temporal, Prefect, Dagster, or similar - designing, scaling, and operating complex pipeline workflows in production. Hands-on with cloud-native data infrastructure (AWS/GCP/Azure) and deep experience with data lake platforms - Databricks, Snowflake, BigQuery, or similar - including streaming and batch pipelines at scale. Hands-on experience with event-driven architectures and event sourcing patterns (e.g., Kafka, Kinesis, or similar), with strong command of distributed systems principles - partitioning, replication, consistency trade-offs. Who You Are Exceptional communicator - able to lead cross-functional design and implementation, work fluidly with engineers, product managers, and senior stakeholders, and drive execution across organizational boundaries. A true people person - thrives working alongside talented teams, leaves ego at the door, and brings a can-do attitude to every challenge. About us Nimble is the real-time web search platform built for enterprise accuracy, completeness, and trust. We run Web Search Agents that actively navigate live websites using real browsers and reasoning, turning the public web into governed, decision-grade data for AI systems and high-stakes business use. Unlike index-based “AI search” tools or brittle legacy scraping, Nimble makes the live web queryable on demand, delivering structured outputs that teams can verify and rely on. Our platform powers use cases where correctness matters: financial due diligence, real-time pricing and promotions, market intelligence, and AI systems that depend on fresh, complete data. Trusted by leading enterprises like Home Depot, Uber, and Coca-Cola and backed by top-tier investors, Nimble sits at the intersection of AI, automation, and real-time web intelligence. As demand accelerates across AI, LLMs, and data-driven decisioning, we’re scaling quickly and looking for high-energy, driven teammates who thrive in fast-moving environments and want to help define a new category. Why join Nimble? Work on a deeply technical platform powering real-time AI and enterprise decisions Help define the future of Web Search Agents and live web intelligence Build alongside a sharp, mission-driven team that moves fast, ships often, and takes ownership