Probal Bose

Projects

Things I've built

Tools that grew out of my research and writing. Some are being prepared for public release, and I'll link each one here when it's out.

δ

Order book research pipeline

Public release in preparation

A pipeline for research-grade cryptocurrency market data. It streams live order book and trade data from 13 Binance trading pairs into Kafka and TimescaleDB, rebuilds the full order book, and runs a gap-aware validity framework that separates recoverable gaps from ones that can never be filled.

PythonKafkaTimescaleDBWebSocketsMarket microstructure

ζ

jsonlz

Release to be announced

A compression format for JSON Lines order book data. It uses delta encoding designed for order books and adaptive arithmetic coding, with a CRC32 check on every block. On BTCUSDT order book data it compresses about 16 times, against about 8 times for gzip at its highest setting.

CompressionArithmetic codingFile formats

β

The book build system

Behind Reading the Greek

One source for 2 editions. Quarto and XeLaTeX produce the print interior with bleed and thumb tabs, and a custom EPUB pipeline produces the Kindle edition. Every diagram is drawn in Python and checked by an automated layout audit, and every code listing is run and compared with the output printed in the book.

QuartoLaTeXEPUBMatplotlibLua filters