Perplexity

Member of Technical Staff (Index Engineer, Search Crawler)

Listed by employer · Checked

Posted within 60 days ·

  • Workplace not specified
  • FullTime
  • Search
  • London
  • Belgrade
  • Ireland
Work arrangement
Not stated
Employment
FullTime
Stated compensation
Not specified
Stated sponsorship
Not stated
Apply on company website ↗
01 / A QUICK CHECK BEFORE YOU APPLY

Does the location policy fit?

Choose where you would work from. We’ll compare it with the posting’s stated requirements.

Choose the country you will work from. You can change this anytime.

Country and sponsorship changes take effect when you click Check eligibility.

Choose a country to check geographic compatibility. The source requirements are available below.

Source: ashbyChecked Original posting ↗

Requirements

1 with evidence8 unclear or unstated
Minimum experience (years)
5
“5+ years of experience building production backend or data infrastructure systems.”
See matched passage in original description ↓
Employment type
FullTime
9 fields not stated in this posting
Remote policy
Unclear
Employer sponsorship
Not specified
Geographic scope
Not specified
Degree requirement
Not specified
Security clearance
Not mentioned
Timezone / hours
Not specified
Citizenship requirement
Not mentioned
Work authorization
Not specified
Compensation
Not specified

These details were not stated in the tracked posting. Confirm with the employer.

READ IT IN THE EMPLOYER’S OWN WORDS

Original job description

Reading view uses normalized posting text so exact evidence excerpts can be highlighted.

AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously. Responsibilities Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.
Read full descriptionShow less description
Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency. Work on storage formats, compaction, and update mechanisms that keep data accessible and current. Keep pipelines reliable and predictable under high-throughput conditions. Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves. Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals. Monitor throughput, resource usage, and cost, and drive optimisations as business needs change. Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements. Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals. Qualifications 5+ years of experience building production backend or data infrastructure systems. Strong programming experience in Go, C++, or Rust. Experience with high-throughput data processing systems and very large datasets. Experience building or operating databases, storage systems, data planes, or indexing pipelines. Strong understanding of distributed systems, fault tolerance, consistency, and scalability. Experience running production systems and handling operational incidents. A systems-thinking mindset and the ability to reason about end-to-end data flows.
Original formatting and links

AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.

Responsibilities

  • Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.

  • Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.

  • Work on storage formats, compaction, and update mechanisms that keep data accessible and current.

  • Keep pipelines reliable and predictable under high-throughput conditions.

  • Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.

  • Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.

  • Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.

  • Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.

  • Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.

Qualifications

  • 5+ years of experience building production backend or data infrastructure systems.

  • Strong programming experience in Go, C++, or Rust.

  • Experience with high-throughput data processing systems and very large datasets.

  • Experience building or operating databases, storage systems, data planes, or indexing pipelines.

  • Strong understanding of distributed systems, fault tolerance, consistency, and scalability.

  • Experience running production systems and handling operational incidents.

  • A systems-thinking mindset and the ability to reason about end-to-end data flows.

Matched by role category. Review each posting’s requirements before applying.

THE JOB ELIGIBILITY CHECKER

Check a job