Jia Cache

High-performance distributed caching built on MVP.Express

Coming SoonDistributed Cache

Overview

Jia Cache is an upcoming high-performance distributed caching solution built entirely on the MVP.Express stack. It leverages the zero-copy capabilities of Myra Transport and Myra Codec to deliver unprecedented caching performance.

Planned Features

Performance

  • Sub-millisecond latency for cache operations
  • Zero-copy value retrieval directly to application buffers
  • Off-heap storage eliminating GC pressure
  • io_uring networking for maximum throughput

Distribution

  • Consistent hashing for data distribution
  • Replication for fault tolerance
  • Automatic failover with leader election
  • Cross-datacenter replication support

Data Structures

  • Key-Value: Basic get/set/delete operations
  • Lists: Ordered collections with push/pop
  • Sets: Unique value collections
  • Sorted Sets: Score-ordered unique values
  • Maps: Nested key-value structures

Operations

  • Atomic operations: CAS, increment, append
  • TTL support: Per-key expiration
  • Eviction policies: LRU, LFU, random
  • Pub/Sub: Real-time notifications

Architecture Preview

┌─────────────────────────────────────────────────────────────┐
│                     Client Application                       │
├─────────────────────────────────────────────────────────────┤
│                      JIA-Cache Client                         │
│              (connection pooling, routing)                   │
├─────────────────────────────────────────────────────────────┤
│                    RPC Framework Layer                       │
├─────────────────────────────────────────────────────────────┤
│                    Myra Transport (io_uring)                 │
└─────────────────────────────────────────────────────────────┘
┌─────────────────────────────────────────────────────────────┐
│                     JIA-Cache Cluster                         │
├──────────────────┬──────────────────┬───────────────────────┤
│     Node 1       │     Node 2       │       Node 3          │
│  ┌────────────┐  │  ┌────────────┐  │  ┌────────────┐       │
│  │Off-Heap    │  │  │Off-Heap    │  │  │Off-Heap    │       │
│  │Storage     │  │  │Storage     │  │  │Storage     │       │
│  └────────────┘  │  └────────────┘  │  └────────────┘       │
│  ┌────────────┐  │  ┌────────────┐  │  ┌────────────┐       │
│  │Replication │◄─┼─►│Replication │◄─┼─►│Replication │       │
│  └────────────┘  │  └────────────┘  │  └────────────┘       │
└──────────────────┴──────────────────┴───────────────────────┘

Target Performance

OperationTarget LatencyTarget Throughput
GET< 100µs p991M+ ops/sec/node
SET< 200µs p99500K+ ops/sec/node
Scan< 1ms p99100K+ ops/sec/node

Roadmap

  • Q3 2025: Initial alpha release with basic key-value operations
  • Q4 2025: Distribution and replication support
  • Q1 2026: Advanced data structures and Pub/Sub
  • Q2 2026: Production-ready 1.0 release

Stay Updated

Jia Cache is currently in active development. Watch the repository for updates: