Backend Software Engineer (Python, Java, Postgres, Druid, Kubernetes, Flink, Java, AWS)

Summary:
I am hiring for a Virtual Assistant Software Engineer position. As a virtual assistant you will assist me in my day to day work both as a project manager and as a Software Engineer for my current company and will be supporting me in working on project deliverables.

Looking for:
Have experience building distributed systems
Are excited to help to accelerate the ability of companies to deploy machine learning as part of their core products and services
Thrive on challenging technical problems, i.e., large-scale data infrastructure that supports both batch and near-real time use case
Are familiar with technologies like AWS, Kubernetes, Python, and concepts related to streaming and batching applications

Duties:
Design and build the core backend systems powering our product
Daily Post-Mortem
After the end of each day you will provide a day to day (only a paragraph) summary of what you’ve worked on, any blockers, etc, so that I may provide updates to the team.
High level system design planning may be necessary. I will send the requirements and ask for input or to develop a system design plan (not in depth)

Tech Stack:
The tech stack you will get to work with is Python, Kubernetes, Flink, Java, AWS tools like Kinesis, Athena and Glue, Terraform, and Iceberg. The frontend is a Typescript React application.

Our backend is mostly Python. We have a rate-limiter service written in Go, and are moving some of our ingestion logic over to Java, but that's new. We use PostgreSQL as a metadata store, and Druid for event data.

Within our ingestion pipeline we use Amazon Kinesis Data Firehose. Some ingestion paths are now using Flink stream processing.

Don’t worry about expertise in these. These can be picked up and learned on the fly.