mitali rust and systems. lately pretty deep in inference.

01projects

where does state live, and what survives when something dies?

• ralph (opens in new tab)

  runtime · Rust · vLLM · SQLite

  a runtime that keeps an llm chat alive when the worker dies.

  proofsurvives real worker sigkills. tested against vllm on a gpu.

  still pushing on migration and faster recovery.

  how it works

  whya crash, a restart or a full gpu usually means the conversation is gone. i wanted a session to have its own id.

  insiderust cli + daemon, sqlite wal for history, kv checkpoints on disk. it hibernates idle sessions and hands them off over ssh.

  learninga chat is tokens, history and a kv cache that dies with the process.

  ralph / src/state.rspub enum SessionState {
      Created,
      Starting,
      Active,
      Pausing,
      Paused,
      Resuming,
      Hibernating,
      Hibernated,
      Recovering,
      Moving,
      Moved,
      Failed,
      Stopped,
  }

• sigil (opens in new tab)

  containers · Rust · cgroups

  a container runtime with no docker underneath.

  proofpid 1 reaps orphans, forwards signals and returns the real exit status.

  this rabbit hole got deep fast

  how it works

  whyi wanted to see what a container actually is.

  insideclone() with namespace flags, pivot_root into a private rootfs, a cgroup v2 memory limit.

  learninga container is a process with a few lies told to it.

  sigil / src/isolation/fs.rspivot_root(rootfs, &old_root)?;
  chdir("/")?;
  umount2("/.old_root", MNT_DETACH)?;

• veridian (opens in new tab)

  git · Rust · SHA-1

  git, from scratch, in rust.

  proofwrites real git objects (blob, tree, commit), zlib + sha-1 on disk.

  file contents→95d09f2b10159347eece71399a7e2e907ea3df4f

  how it works

  whyto learn how git actually stores things.

  insideobjects are named by their own contents, so one changed byte changes every hash above it.

  learninga commit is just a hash pointing at a hash.

  veridian / src/commands/hash_object.rslet header = format!("blob {{}}\0", data.len());
  let mut store_data = header.into_bytes();
  store_data.extend_from_slice(&data);

• conflux (opens in new tab)

  collab · Rust · Yrs · Axum

  a backend for editing the same document at once.

  proofbounded queue per client. slow clients get dropped, not waited on.

  how it works

  whyi wanted to understand how collaborative editors stay consistent.

  insidecrdt sync with yrs over websockets and jwt. every room is its own actor and cleans up when the last person leaves.

  learningstate lives in the room, not in the socket.

  conflux / src/room_manager.rslet handle = spawn_room(
      document_id.to_string(),
      self.idle_timeout,
  );

02experience

• software engineer @ Math Inc

  may to aug 2026

  distributed backend and internal infrastructure in rust. storage, networking and developer tools, with reliability as the main constraint. owned features from architecture to deployment.

  Rust · Python · Tokio · PostgreSQL · OpenAPI · Docker · Linux · S3

• software engineer @ CLR3

  dec 2025 to may 2026

  real-time data pipelines for on-chain defi analytics. stream processing and rule evaluation on kafka, pyflink, clickhouse and redis, tuned with batching and parallelism so less data moved between services.

  Python · Kafka · PyFlink · ClickHouse · Redis · Kubernetes · Docker