Member of Technical Staff (Backend Software Engineer, Search Crawler)
Listed by employer · Checked
Older posting · still listed ·
- Work arrangement
- Not stated
- Employment
- FullTime
- Stated compensation
- Not specified
Does the location policy fit?
Choose where you would work from. We’ll compare it with the posting’s stated requirements.
Choose a country to check geographic compatibility. The source requirements are available below.
The employer’s posting date is more than 60 days ago. It remained listed at our last successful check; it may be a long-running or evergreen opening. Confirm availability on the original posting before applying.
Browse jobs posted in the past 60 days →This checks the posting’s stated requirements, not your legal right to work. Confirm details with the employer.
Requirements
1 with evidence8 unclear or unstated- Minimum experience (years)
- 5
“Minimum of 5 years of software development experience, with strong knowledge of data structures and algorithms in at least one of the following languages: Python, C++, Rust, or Go.”
See matched passage in original description ↓ - Employment type
- FullTime
9 fields not stated in this posting
- Remote policy
- Unclear
- Employer sponsorship
- Not specified
- Geographic scope
- Not specified
- Degree requirement
- Not specified
- Security clearance
- Not mentioned
- Timezone / hours
- Not specified
- Citizenship requirement
- Not mentioned
- Work authorization
- Not specified
- Compensation
- Not specified
These details were not stated in the tracked posting. Confirm with the employer.
Original job description
Reading view uses normalized posting text so exact evidence excerpts can be highlighted.
Show less description
Original formatting and links
We are seeking an experienced Backend Software Engineer to join our Crawler team. In this role, you will design, develop, and operate systems that ingest, process, and manage web-scale data in support of our next generation of advanced search technologies. This is a critical, high-impact engineering position, requiring expertise across both backend and frontend components of our data acquisition stack.
Responsibilities
Take ownership of and lead projects focused on developing large-scale web crawlers, ingestion pipelines, and data processing systems.
Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management.
Collaborate closely with Search and Infrastructure teams to ensure the reliable, high-quality ingestion and processing of billions of web pages.
Architect and implement fullstack features and scalable distributed systems that handle high-load and real-time data operations.
Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability.
Qualifications
Minimum of 5 years of software development experience, with strong knowledge of data structures and algorithms in at least one of the following languages: Python, C++, Rust, or Go.
Experience with large-scale web crawlers is highly desirable.
Proven experience building, deploying, and optimizing high-load, distributed, and hardware-adjacent services.
Deep understanding of cloud infrastructure, with hands-on experience in Kubernetes (K8s) and AWS.
Demonstrated passion for writing clean, efficient, and scalable systems.
Matched by role category. Review each posting’s requirements before applying.