Job Title: Technical Lead - Data Processing Infrastructure / Data Platform
Location: Austin, TX
Salary Range: $200,000 Per Year
Job Type: Direct Hire

Sponsorship: Yes, Company provides visa sponsorship

Job Overview

A leading autonomous mobility company seeks a Technical Lead to define and build a scalable, user-friendly compute platform for Simulation and ML teams (Perception, Prediction, Planner). You will set the strategic vision for data processing infrastructure, ensuring its scalability, robustness, and alignment with team requirements. You'll make key decisions, prototype solutions, write code, improve frameworks, and provide clear documentation and examples to support adoption.

Key Responsibilities

• Collaborate closely with Simulation and ML teams to understand requirements and use cases.

• Evaluate, integrate, and enhance open-source tools like Apache Spark, Ray, Apache Beam, and Argo.

• Prototype, develop, and refine scalable compute solutions through hands-on coding and validation.

• Lead and coordinate infrastructure engineering teams.

• Define and communicate technical vision with mentorship, documentation, and examples for adoption.

Requirements

• Strong proficiency in Python; C++ experience highly desirable.

• Hands-on experience with distributed computing frameworks like Apache Spark, Ray, Apache Beam, Apache Airflow, Argo Workflows, and Kubernetes.

• Proven leadership in architecture design and development of data processing infrastructures.

• Excellent communication and collaboration skills.

Preferred Qualifications

• Understanding of ML/AI and experience building ML pipelines.

• Experience with sensor data from cameras, lidars, and radars in autonomous vehicles or robotics.

• Experience optimizing costs and performance of distributed computing systems.

Benefits

• Employer-subsidized healthcare (medical, dental, vision)

• Pre-tax commuter benefits

• Flexible Spending Account (FSA)

• Employer-covered disability and life insurance

• 401(k) retirement plan

• Generous PTO

• Covered lunches and more