mlsanityData to 14 Oct 2026

Derandomizing Dense Binary Hypervector Codebooks for Quantized Scalars

arXiv 2609.38471 ↗First posted 29 Sep 2026cs.IT cs.AI cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

Hyperdimensional computing and vector symbolic architectures often represent quantized scalar levels by dense binary codebooks whose level-to-level similarity is intended to follow a prescribed function of scalar separation. At finite dimensionality, randomized scalar codebook constructions deviate from this target because of sampling noise, random-start imbalance, update-count fluctuations, component dependence, and finite-capacity effects. We develop a transition-based derandomization framework for dense binary scalar codebooks across two target-similarity families, with similarity decaying exponentially or linearly with level separation. The framework separates the target similarity law, the derandomization variant, and the concrete generator construction, making explicit how initialization, selection, update, and capacity-handling mechanisms shape the induced similarity profile. We formalize derandomization variants that separately constrain initial Hamming weight, update-count variability, and update balance, thereby controlling distinct sources of finite-dimensional error. For each family and variant, we derive the induced mean similarity, identify realization-wise and mean target-matching regimes, and derive exact finite-dimensional expressions for bias, variance, and root-mean-square error. Simulations across dimensions, quantization ranges, reference scalar levels, and generator constructions validate the theory and show how each constraint removes or reduces a specific source of similarity mismatch. The results provide practical guidance for choosing scalar codebook generators that more closely match a desired similarity law under finite-dimensional and hardware-relevant constraints.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). First posted on arXiv 29 Sep 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025BTC-LLM: Efficient Sub-1-Bit LLM Quantization via Learnable Transformation and Binary Codebook
  2. 2026XFP: Quality-Targeted Adaptive Codebook Quantization with Sparse Outlier Separation for LLM Inference
  3. 2026Taming the Entropy Cliff: Variable Codebook Size Quantization for Autoregressive Visual Generation
  4. 2025SBVR: Summation of BitVector Representation for Efficient LLM Quantization
  5. 2025Scalable Training for Vector-Quantized Networks with 100% Codebook Utilization
  6. 2026BCJR-QAT: A Differentiable Relaxation of Trellis-Coded Weight Quantization
  7. 2026CubicQuant: Parametric Non-Uniform Codebooks for High-Throughput LLM Inference with 1-8-Bit Weights
  8. 2025CodeGEMM: A Codebook-Centric Approach to Efficient GEMM in Quantized LLMs