Sketching-based preconditioners have been shown to accelerate the solution of dense least-squares problems with coefficient matrices having substantially more rows than columns. The cost of generating these preconditioners can be reduced by employing low precision floating-point formats for all or part of the computations. We perform finite precision analysis of a mixed precision algorithm that computes the R-factor of a QR factorization of the sketched coefficient matrix. Two precisions can be chosen and the analysis allows understanding how to set these precisions to exploit the potential benefits of low precision formats and still guarantee an effective preconditioner. If the nature of the least-squares problem requires a solution with a small forward error, then mixed precision iterative refinement (IR) may be needed. For ill-conditioned problems the GMRES-based IR approach can be used, but good preconditioner is crucial to ensure convergence. We theoretically show when the sketching-based preconditioner can guarantee that the GMRES-based IR reduces the relative forward error of the least-squares solution and the residual to the level of the working precision unit roundoff. Small numerical examples illustrate the analysis.
Consider a subspace \mathbb{F} \subseteq \mathbb{R}^m, a linear operator \Omega : \mathbb{R}^{m} \to \mathbb{R}^{s}, and a distortion parameter \epsilon \in (0,1). \Omega is called an l_2 \epsilon-subspace embedding if for every x \in \mathbb{F} we have
A linear operator \Omega : \mathbb{R}^{m} \to \mathbb{R}^{s} is called an oblivious (\epsilon,\delta,n)-subspace embedding if it is a subspace embedding for any n-dimensional \mathbb{F} \subseteq \mathbb{R}^m with probability at least 1-\delta.
r@th:finite_recision_error_R Label ‘th:finite_recision_error_R’ multiply defined
SIAM Label Error: There were multiply-defined labels Correct multiply-defined labels. r@th:finite_recision_error_Rsection.equation Consider \widehat{Y} = \Omega A + \Delta_s computed in step ? of Algorithm ?, where \Delta_s accounts for the errors in casting A to u_s and computing the sketch. If \Omega, u_s, and u_{QR} are set so that
and we denote
then \widehat{R} satisfies the following:
Let A \in \mathbb{R}^{m \times n} be full rank and A_s denote A cast to a precision u_s, such that
is the economic QR decomposition. We assume that A_s is full-rank and assume that the assumptions of Theorem 3 hold with A replaced by A_s, and denote the resulting \beta as \beta_s. Then (3) - (3) can be written as
Assume that the least-squares problem (?) is solved via Algorithm ?, the assumptions of Theorem 3 are satisfied, and the precisions in FGMRES are set so that (?) holds and \psi(\beta,\Omega A) is as in (?). Then the relative forward error of the augmented system reaches the limiting value of 4pu_r\textrm{cond}(\widetilde{A},d)+ u if
If the optimal scaling \alpha = 2^{-1/2} \sigma_{min}(A \widehat{R}^{-1}) is applied in step ? of Algorithm ?, then the forward error convergence condition can be replaced by
The normwise relative backward error of the augmented system reaches the limiting value pu if
The text on this page is from arXiv:2410.06319v2 by Erin Carson and Ieva Daužickaitė, under the licence CC BY 4.0. The corpus made these changes: it read the items out of the LaTeX source, it expanded the macros of the paper, it put each proof after its statement, and it converted the text to HTML. The formulas are the TeX of the paper, and KaTeX renders them. A formula or a reference can look different from the PDF. The page is published under CC BY 4.0.
The record of each item is in analysis/objects/2410/2410.06319.jsonl.