Senior Software Engineer

Manan Monga

Building real-time data pipelines and distributed security systems at scale.

View Experience Email GitHub LinkedIn

About

A bit about me.

Manan Monga

I'm a Senior Software Engineer at SecurityScorecard, where I architect real-time data streaming infrastructure using Apache Flink and Kafka - ingesting billions of daily security observations with stateful enrichment at scale.

Previously at Securonix, I built high-performance SIEM cloud applications on AWS and led cloud security engineering, including a Redis optimization that reduced cloud costs by $2.3M per year in collaboration with the AWS Elasticache team.

I hold an MS in Computer Science (Cybersecurity) from Boston University and conducted research on privacy-sensitive contact tracing at BU's Hariri Institute for Computing.

Outside of work I play soccer, cook from Gordon Ramsay's YouTube videos, and will enthusiastically argue that Manchester City are the best team in the land and all the world.

Skills

Technologies & Tools.

Languages

Java TypeScript JavaScript SQL Python Solidity

Frameworks

Apache Flink NestJS Spark Ray gRPC

Data & Streaming

Kafka ClickHouse HBase Redis Protobuf

Cloud & Infra

AWS Linux Git JUnit Mockito

Experience

Work History.

SecurityScorecard Austin, TX
Senior Software Engineer
April 2025 – Present
  • Architected real-time data streaming using Apache Flink, building pipelines that ingest billions of daily security observations from Kafka with stateful enrichment
  • Engineered sub-second analytics by sinking enriched data into ClickHouse with complex stateful merge logic and side-output fan-outs
  • Scaled a cross-platform Protobuf contract layer for 50+ definitions with schema governance via Buf and automated codegen across Java, TS, Scala, and Python
  • Developed a NestJS gRPC microservice for observation querying and vendor risk scoring with dynamic ClickHouse aggregations
Securonix Addison, TX
Software Engineer
Oct 2022 – Apr 2025
  • Built high-performance SIEM cloud applications on AWS
  • Designed analytics including Beaconing, Rarity analysis, Behavior analytics, and Peer analytics using Spark Streaming, Kafka, HBase, and Redis
  • Collaborated with the AWS Elasticache team to reduce cloud expenses by $2.3M/year through Redis read-replica optimization
Securonix Addison, TX
Cloud Security Engineer
Jun 2021 – Sep 2022
  • Delivered architecture solutions aligned with client business needs, enhancing build and deployment quality
  • Boosted team productivity through standardized procedures and internal documentation
  • Represented cloud team in the Office of the CTO for feature design tailored to customer requirements
Boston University - Hariri Institute for Computing Boston, MA
Graduate Research Assistant
Apr 2020 – May 2021
  • Led research team building a cross-platform React-Native app for privacy-sensitive COVID-19 contact tracing
  • Implemented Bluetooth Low Energy chirps for mobile exposure detection within COVID transmission range
  • Investigated exposure notification frameworks with MA state government

Projects & Writing

Blog Posts & Projects.

Writing

Engineering posts

Why I chose Flink over Spark, and what it took to prove it was worth it

How 50 deploy-measure-adjust cycles got MOP-v2 from 9M to 35M+ records/min with zero new infrastructure.

Read more
🔄

Stateful stream enrichment with Debezium CDC: the multi-speed join problem

What happens when two Kafka streams move at completely different speeds - and how Flink's idle timeout saves you.

Read more
🌐

Cross-region state sync without a central database

Eventual consistency via Kafka + ReplicatedReplacingMergeTree - and why that tradeoff was the right one.

Read more
📊

Designing a reporting layer on 18 billion rows without exploding your infrastructure

Profile first, design second. How a 29x data reduction and a query-time JOIN saved 170 GB and an entire cluster.

Read more
📦

The invisible infrastructure: building schema publishing for three languages

50+ Protobuf definitions, three build systems, Buf governance, and CI/CD that makes the right thing automatic.

Read more
💸

How a Redis network bottleneck cost $2.3M/year - and how I found it

NIC saturation, retry logic hiding a real problem, and what it took to convince an AWS service team to act.

Read more
📉

Replacing $300K/month of Datadog with AWS Timestream

Kinesis + Timestream + Grafana. Same observability coverage, a fraction of the cost.

Read more
🗄️

Why I used SQLite as a Kafka replay buffer, and why it was the right call

2,000 dropped events/month → 400. Why the simplest durable store was the right one for this access pattern.

Read more

Earlier work

Research & projects