Sequential online subsampling for thinning experimental designs

We consider a design problem where experimental conditions (design points Xi) are presented in the form of a sequence of i.i.d. random variables, generated with an unknown probability measure μ, and only a given proportion α∈(0,1) can be selected. The objective is to select good candidates Xi on the fly and maximize a concave function Phi of the corresponding information matrix. The optimal solution corresponds to the construction of an optimal bounded design measure xiα^*≤ μ/α, with the difficulty that μ is unknown and xiα^* must be constructed online. The construction proposed relies on the definition of a threshold τ on the directional derivative of Phi at the current information matrix, the value of τ being fixed by a certain quantile of the distribution of this directional derivative. Combination with recursive quantile estimation yields a nonlinear two-time-scale stochastic approximation method. It can be applied to very long design sequences since only the current information matrix and estimated quantile need to be stored. Convergence to an optimum design is proved. Various illustrative examples are presented.