Distributed Systems Architect: Bare-Metal and High-Scale
Engineering
About the role
Distributed Systems Architect: Bare-Metal and High-Scale
You will own the architectural blueprints for Analog's on-premises open-source infrastructure, designing the clustering, replication, and failover topologies across messaging, streaming, and database layers that our DevOps team then automates at scale across client deployments. This is a hands-on, implementation-grade architecture role where the quality of your output directly determines whether a physically isolated or air-gapped client environment survives hardware failure at petabyte scale.
What You'll Do
Open-Source Infrastructure Mapping
- Map Analog's Azure PaaS components to open-source equivalents: Event Hub to Kafka/Redpanda, IoT Hub to EMQX, ADX to ClickHouse or Apache Druid, and Blob Storage to Ceph/MinIO
- Produce side-by-side equivalence assessments documenting feature gaps, operational differences, and migration risk for each component transition
- Validate client hardware specifications and assess compliance with air-gap security
requirements
prior to each deployment
Cluster and Topology Design
- Design multi-node clustering, rack-aware replication, and quorum topologies for bare-metal Kafka/Redpanda and PostgreSQL (Patroni) clusters
- Design resilience protocols for hardware and network switch failures in physically isolated or air-gapped client environments
- Architect RocksDB state backend tuning for stateful Apache Flink workloads, including compaction strategy, block cache sizing, and write-ahead log configuration
Linux and Hardware Optimization
- Tune Linux kernel parameters, NUMA bindings, network ring buffers, and NVMe I/O scheduler configurations to eliminate hardware bottlenecks under petabyte-scale write workloads
- Define CPU affinity, IRQ balancing, and huge page configurations for latency-sensitive broker and database processes
- Author reproducible benchmark harnesses to validate configuration changes against client hardware before production rollout
Blueprints and DevOps Enablement
- Deliver precise, implementation-r…