The Data Platform team enables our customers to ingest and perform real time analytics on critical security insights and intelligence data stored in our vast Data Lake and empower internal engineering teams to leverage the best datastore technology for their needs. Our Big Data technology stack consists of Kafka, Google PubSub, ClickHouse, Google BigQuery etc.

We’re looking for software engineers with a background in distributed systems and are excited about the opportunity to work on large-scale data systems that can crunch terabytes of data and deliver results in seconds. In this role, you’ll partner with industry experts in security and big data, product and engineering teams to conceptualize, design and build innovative solutions for hard problems. 

This is a great opportunity to join a small team of smart people, learn and hone your skills in distributed data systems in a fun and collaborative environment.

What you will be doing

• Build next generation data pipelines to provide near real-time ingestion of security insights and intelligence data
• Architect highly scalable data pipelines and solve real-time stream processing challenges at scale
• Partner with industry experts in security and big data, product and engineering teams to conceptualize, design and build innovative solutions for hard problems on behalf of our customers.
• Evaluate open source technologies to find the best fit for our needs and also contribute to some of them!
• Help other teams architect their systems on top of the data platform and influence their system design.
• This is a great opportunity to work with smart people in a fun and collaborative environment.
  

Required skills and experience

• 10+ years of industry experience building highly scalable distributed Data systems
• Programming experience in Python, Java or Golang
• Excellent data structure and algorithm skills
• Proven good development practices like automated testing, measuring code coverage.
• Experience building real-time stream processing systems using engines like Flink, Spark or similar
• Experience with distributed datastores like Druid, Mongo, Cassandra, BigQuery or similar
• Excellent written and verbal communication skills
• Bonus points for contributions to the open source community

1. HR Interview
   
2. Online coding test
3. Face 2 face Video Interview (including technical interview and cultural fit)