mlsanityData to 14 Oct 2026

Finding the Needle in a Haystack: Test-Time Analog Circuit Representation Adaptation for Bayesian Optimization

arXiv 2608.12687 ↗First posted 13 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Bayesian optimization (BO) is a sample-efficient framework for analog circuit topology search, where evaluating each candidate topology can require costly simulation. However, representation-based BO methods typically treat circuit embeddings as fixed after encoder training. This creates a mismatch between representation learning and optimization: embeddings learned to encode or reconstruct circuit structure are not necessarily organized according to the figure of merit (FoM) being optimized. This paper introduces Test-Time Analog Representation Adaptation for Bayesian Optimization (TTARO), an online deep-kernel BO framework that adapts circuit representations throughout the search process. Starting from pretrained circuit embeddings, TTARO jointly learns a nonlinear feature transformation and a Gaussian-process surrogate using the FoM labels of the circuits evaluated so far. Following each new evaluation, TTARO updates the representation and surrogate before selecting the next candidate. We compare TTARO with conventional Gaussian Process-based BO over fixed embeddings and with Deep Kernel Learning (DKL), which learns the representation only from the initial evaluated designs and keeps it fixed throughout the remainder of the search. By continually incorporating newly observed FoM labels into representation learning, TTARO aligns the search space with the optimization objective as BO progresses. In our experiments, TTARO reduces regret AUC by 15.2% on average relative to BO and by 20.7% relative to DKL across 40 encoder/kernel/acquisition settings, outperforming prior art in most settings with reductions as large as 46.7%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

20 of 34 references.

References · 20

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  3. 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 609
  4. 2015Deep Kernel Learningcited by 445
  5. 2015Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP)cited by 177
  6. 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 102
  7. 2019D-VAE: A Variational Autoencoder for Directed Acyclic Graphscited by 98
  8. 2016Stochastic Variational Deep Kernel Learningcited by 93
  9. 2021Directed Acyclic Graph Neural Networkscited by 70
  10. 2014Input Warping for Bayesian Optimization of Non-stationary Functionscited by 67
  11. 2023CktGNN: Circuit Graph Neural Network for Electronic Design Automationcited by 58
  12. 2018Constant-Time Predictive Distributions for Gaussian Processescited by 48
8 more
  1. 2025AnalogGenie: A Generative Engine for Automatic Discovery of Analog Circuit Topologiescited by 37
  2. 2021Kernel Interpolation for Scalable Online Gaussian Processescited by 18
  3. 2023Advancing Bayesian Optimization via Learning Correlated Latent Spacecited by 18
  4. 2020Semi-supervised Embedding Learning for High-dimensional Bayesian Optimizationcited by 11
  5. 2019Bayesian Optimization Approach for Analog Circuit Synthesis Using Neural Networkcited by 8
  6. 2022Learning Representation for Bayesian Optimization with Collision-free Regularizationcited by 3
  7. 2024KATO: Knowledge Alignment and Transfer for Transistor Sizing of Different Design and Technologycited by 2
  8. 2026Can an Actor-Critic Optimization Framework Improve Analog Design?cited by 1

Built on by

Not cited yet.