Big Data Engineer IV
OpenXCompany at a Glance
You will work in all aspects of agile application development, including our enterprise platform that interfaces with a multitude of services that are dependent on to deliver billions of requests per day. Your opinions will be important in all phases of product development, starting from requirements to validation and deployment.
Working on the enterprise platform, you will be working with multiple distributed teams to architect, create, and deliver new features and functionality in order to deliver the best possible advertising experience in the market. Scalability, performance, and rock-solid reliability are all factors to consider with every line you code.
The Team and Project:
You will be part of the core data platform team. Our exchange handles billions of ad requests daily connecting thousands of publishers with demand partners. Each request produces data events that have to be processed to extract business value from them. Daily our applications produce more than 1PB of data.
Please note: all interview stages are run remotely!
Key responsibilities:
- Design large-scale data processing systems.
- Work with Product to drive the requirements, and own the project end-to-end.
- Analyze and improve the efficiency, scalability, and stability of applications.
- Think long-term and be unsatisfied with band-aids.
- Identify unnecessary complexity and remove it.
Required Qualifications:
- 8+ years experience in Java, Scala or Python development
- 3+ years of experience in Big Data systems development
- Experience building complex data pipelines, including SQL-based transformations with tools such as dbt or Dataform, and large-scale data processing with distributed frameworks such as Apache Spark.
- Expertise using BigQuery or other data warehouses including performance tuning and monitoring.
- Understands data orchestration tools like Airflow to extend it with new data pipelines and troubleshoots its operational issues.
- Cloud experience with Google Cloud Platform or AWS, k8s, and Docker.
- Understanding
Opens the company's application page
Listed via
Himalayas
himalayas.app
Similar roles
Junior Backend (Golang) Engineer
Symphony Solutions
Senior Fullstack Developer - Freelancer (Ruby on Rails and TypeScript)
Monterail
(Senior) Specialist Data Analytics (w/m/d)
Consileon Business Consultancy GmbH
DESARROLLADOR/A FULLSTACK / IA (TELETRABAJO)
IRIUM
Design & Tech
Related reads from TCHNX
How Passive Data Collection is Reshaping UX Research
As users grow weary of surveys and interviews, researchers are turning to ambient behavioural signals from keystroke dynamics to micro-interactions to understand product experience without asking a single question.
Why Gen Z is Rejecting Performative Productivity
After a decade of glorifying the grind, a cultural shift is underway. Young professionals are abandoning side hustles not out of laziness, but as an act of resistance against late capitalism's demand for constant monetization.
The Inference Economy: Why AI’s Biggest Cost Shift Is Happening After Training
A major shift in AI economics is reshaping the industry. As training frontier models becomes more expensive and inference becomes dramatically cheaper, companies are being forced to rethink how they build, deploy, price, and monetise intelligent systems.