NAG Library Chapter Introduction
F12 – Large Scale Eigenproblems
1 Scope of the Chapter
This chapter provides routines for computing some
eigenvalues and eigenvectors of large-scale (sparse) standard and generalized eigenvalue problems. It provides routines for:
- – solution of symmetric eigenvalue problems;
- – solution of nonsymmetric eigenvalue problems;
- – solution of generalized symmetric-definite eigenvalue problems;
- – solution of generalized nonsymmetric eigenvalue problems;
- – partial singular value decomposition.
Routines are provided for both real
The routines in this chapter have all been derived from the
ARPACK software suite (see Lehoucq et al. (1998)
a collection of Fortran 77 subroutines designed to solve large scale eigenvalue problems. The interfaces provided in this chapter have been chosen to combine ease of use with the flexibility of the original
software. The underlying iterative methods and algorithms remain essentially the same as those in ARPACK and are described fully in Lehoucq et al. (1998)
The algorithms used are based upon an algorithmic variant of the Arnoldi process called the Implicitly Restarted Arnoldi Method. For symmetric matrices, this reduces to a variant of the Lanczos process called the Implicitly Restarted Lanczos Method. These variants may be viewed as a synthesis of the Arnoldi/Lanczos process with the Implicitly Shifted technique that is suitable for large scale problems. For many standard problems, a matrix factorization is not required. Only the action of the matrix on a vector is needed.
2 Background to the Problems
This section is only a brief introduction to the solution of large-scale eigenvalue problems. For a more detailed discussion see, for example, Saad (1992)
or Lehoucq (1995)
in addition to Lehoucq et al. (1998)
. The basic factorization techniques and definitions of terms used for the different problem types are given in Section 2
in the F08 Chapter Introduction.
2.1 Sparse Matrices and their Storage
A matrix may be described as sparse if the number of zero elements is so large that it is worthwhile using algorithms which avoid computations involving zero elements.
is sparse, and the chosen algorithm requires the matrix coefficients to be stored, a significant saving in storage can often be made by storing only the nonzero elements. A number of different formats may be used to represent sparse matrices economically. These differ according to the amount of storage required, the amount of indirect addressing required for fundamental operations such as matrix-vector products, and their suitability for vector and/or parallel architectures. For a survey of some of these storage formats see Barrett et al. (1994)
of the routines in this chapter have been designed to be independent of the matrix storage format. This allows you to choose your own preferred format, or to avoid storing the matrix altogether.
Other routines are general purpose
, which are easier to use, but are based on fixed storage formats. One such format is currently provided. This is the banded coordinate storage format as used in Chapters F07
(LAPACK) for storing general banded matrices.
2.2 Symmetric Eigenvalue Problems
The symmetric eigenvalue problem
is to find the eigenvalues
, and corresponding eigenvectors
, such that
For the Hermitian eigenvalue problem
For both problems the eigenvalues
The basic task of the symmetric eigenproblem routines is to compute some of the values of and, optionally, corresponding vectors for a given matrix . For example, we may wish to obtain the first ten eigenvalues of largest magnitude, of a large sparse matrix .
2.3 Generalized Symmetric-definite Eigenvalue Problems
This section is concerned with the solution of the generalized eigenvalue problems , , and , where and are real symmetric or complex Hermitian and is positive definite. Each of these problems can be reduced to a standard symmetric eigenvalue problem, using a Cholesky factorization of as either or ( or in the Hermitian case).
, we have
Hence the eigenvalues of
are those of
is the symmetric matrix
. In the complex, case
is Hermitian with
The basic task of the generalized symmetric eigenproblem routines is to compute some of the values of and, optionally, corresponding vectors for a given matrix . For example, we may wish to obtain the first ten eigenvalues of largest magnitude, of a large sparse matrix pair and .
2.4 Nonsymmetric Eigenvalue Problems
The nonsymmetric eigenvalue problem
is to find the eigenvalues
, and corresponding eigenvectors
, such that
More precisely, a vector
as just defined is called a right eigenvector
, and a vector
is called a left eigenvector
A real matrix may have complex eigenvalues, occurring as complex conjugate pairs.
This problem can be solved via the Schur factorization
, defined in the real case as
is an orthogonal matrix and
is an upper quasi-triangular matrix with
diagonal blocks, the
blocks corresponding to complex conjugate pairs of eigenvalues of
. In the complex case, the Schur factorization is
is unitary and
is a complex upper triangular matrix.
The columns of are called the Schur vectors. For each (), the first columns of form an orthonormal basis for the invariant subspace corresponding to the first eigenvalues on the diagonal of . Because this basis is orthonormal, it is preferable in many applications to compute Schur vectors rather than eigenvectors. It is possible to order the Schur factorization so that any desired set of eigenvalues occupy the leading positions on the diagonal of .
The two basic tasks of the nonsymmetric eigenvalue routines are to compute, for a given matrix , some values of and, if desired, their associated right eigenvectors , and the Schur factorization.
2.5 Generalized Nonsymmetric Eigenvalue Problem
The generalized nonsymmetric eigenvalue problem
is to find the eigenvalues,
, and corresponding eigenvectors
, such that
More precisely, a vector
as just defined is called a right eigenvector
of the matrix pair
, and a vector
is called a left eigenvector
of the matrix pair
2.6 The Singular Value Decomposition
The singular value decomposition
(SVD) of an
is given by
are orthogonal (unitary) and
diagonal matrix with real diagonal elements,
, such that
are the singular values
and the first
are the left
and right singular vectors
. The singular values and singular vectors satisfy
th columns of
Thus selected singular values and the corresponding right singular vectors may be computed by finding eigenvalues and eigenvectors for the symmetric matrix (or the Hermitian matrix if is complex).
An alternative approach is to use the relationship
and thus compute selected singular values and vectors via the symmetric matrix
In many applications, one is interested in computing a few (say
) of the largest singular values and corresponding vectors. If
denote the leading
respectively, and if
denotes the leading principal submatrix of
is the best rank-
in both the
-norm and the Frobenius norm. Often a very small
will suffice to approximate important features of the original
or to approximately solve least squares problems involving
2.7 Iterative Methods
methods for the solution of the standard eigenproblem
approach the solution through a sequence of approximations until some user-specified termination criterion is met or until some predefined maximum number of iterations has been reached. The number of iterations required for convergence is not generally known in advance, as it depends on the accuracy required, and on the matrix
, its sparsity pattern, conditioning and eigenvalue spectrum.
3 Recommendations on Choice and Use of Available Routines
3.1 Types of Routine Available
The routines available in this chapter divide essentially into three suites of basic reverse communication routines and some general purpose routines for banded systems.
are grouped in suites of five, and
implement the underlying iterative method. Each suite comprises a setup routine, an options setting routine, a solver routine, a routine to return additional monitoring information and a post-processing routine. The solver routine is independent of the matrix storage format (indeed the matrix need not be stored at all) and the type of preconditioner. It uses reverse communication
, i.e., it returns repeatedly to the calling program with the parameter IREVCM set to specified values which require the calling program to carry out a specific task (either to compute a matrix-vector product or to solve the preconditioning equation), to signal the completion of the computation or to allow the calling program to monitor the solution. Reverse communication has the following advantages:
||Maximum flexibility in the representation and storage of sparse matrices. All matrix operations are performed outside the solver routine, thereby avoiding the need for a complicated interface with enough flexibility to cope with all types of storage schemes and sparsity patterns. This also applies to preconditioners.
||Enhanced user interaction: you can closely monitor the solution and tidy or immediate termination can be requested. This is useful, for example, when alternative termination criteria are to be employed or in case of failure of the external routines used to perform matrix operations.
At present there are suites of basic routines for real symmetric and nonsymmetric systems, and for complex systems.
General purpose routines call basic routines in order to provide easy-to-use routines for particular sparse matrix storage formats. They are much less flexible than the basic routines, but do not use reverse communication, and may be suitable in many cases.
The structure of this chapter has been designed to cater for as many types of application as possible. If a general purpose routine exists which is suitable for a given application you are recommended to use it. If you then decide you need some additional flexibility it is easy to achieve this by using basic and utility routines which reproduce the algorithm used in the general purpose routine, but allow more access to algorithmic control parameters and monitoring.
3.2 Iterative Methods for Real Nonsymmetric and Complex Eigenvalue Problems
The suite of basic routines F12AAF
implements the iterative solution of real nonsymmetric eigenvalue problems, finding estimates for a specified spectrum of eigenvalues. These eigenvalue estimates are often referred to as Ritz values and the error bounds obtained are referred to as the Ritz estimates. These routines allow a choice of termination criteria and many other options for specifying the problem type, allow monitoring of the solution process, and can return Ritz estimates of the calculated Ritz values of the problem
For complex matrices there is an equivalent suite of routines. F12ANF
are the basic routines which implement corresponding methods used for real nonsymmetric systems. Note that these routines are to be used for both Hermitian and non-Hermitian problems. Occasionally, when using these routines on a complex Hermitian problem, eigenvalues will be returned with small but nonzero imaginary part due to unavoidable round-off errors. These should be ignored unless they are significant with respect to the eigenvalues of largest magnitude that have been computed.
There are general purpose routines for the case where the matrices are known to be banded. In these cases an initialization routine is called first to set up default options, and the problem is solved by a single call to a solver routine. The matrices are supplied, in LAPACK banded-storage format, as arguments to the solver routine. For real general matrices these routines are F12AFF
; and for complex matrices the pair is F12ATF
. With each pair non-default options can be set, following a call to the initialization routine, using F12ADF
for real matrices and F12ARF
for complex matrices. For real matrices that can be supplied in the sparse matrix compressed column storage (CCS) format, the driver routine F02EKF
is available. This routine uses routines from Chapter F12
in conjunction with direct solver routines from Chapter F11
There is little computational penalty in using the non-Hermitian complex routines for a Hermitian problem. The only additional cost is to compute eigenvalues of a Hessenberg rather than a tridiagonal matrix. The difference in computational cost should be negligible compared to the overall cost.
3.3 Iterative Methods for Real Symmetric Eigenvalue Problems
The suite of basic routines F12FAF
implement a Lanczos method for the iterative solution of the real symmetric eigenproblem.
There is a general purpose routine pair for the case where the matrices are known to be banded. In this case an initialization routine, F12FFF
, is called first to set up default options, and the problem is solved by a single call to a solver routine, F12FGF
. The matrices are supplied, in LAPACK banded-storage format, as arguments to F12FGF
. Non-default options can be set, following a call to F12FFF
, using F12FDF
3.4 Iterative Methods for Singular Value Decomposition
The partial singular value decomposition,
(as defined in Section 2.6
), of an
can be computed efficiently using routines from this chapter. For real matrices, the suite of routines listed in Section 3.3
(for symmetric problems) can be used; for complex matrices, the corresponding suite of routines for complex problems can be used; however, there are no general purpose routines for complex problems.
The driver routine F02WGF
is available for computing the partial SVD of real matrices. The matrix is not supplied to F02WGF
; rather, a user-defined routine argument provides the results of performing Matrix-vector products.
For both real and complex matrices, you should use the default options (see, for example, the options listed in Section 10
in F12FDF) for problem type (Standard
), computational mode (Regular
) and spectrum (Largest Magnitude
). The operation to be performed on request by the reverse communication routine (e.g., F12FBF
) is, for real matrices, to multiply the returned vector by the symmetric matrix
, or by
. For complex matrices, the corresponding Hermitian matrices are
The right (
) or left (
) singular vectors are returned by the post-processing routine (e.g., F12FCF
). The left (or right) singular vectors can be recovered from the returned singular vectors. Providing the largest singular vectors are not multiple or tightly clustered, there should be no problem in obtaining numerically orthogonal left singular vectors from the computed right singular vectors (or vice versa).
The second example in Section 9
in F12FBF illustrates how the partial singular value decomposition of a real matrix can be performed using the suite of routines for finding some eigenvalues of a real symmetric matrix. In this case
, however, the program is easily amended to perform the same task in the case
Similarly, routines in this chapter may be used to estimate the
-norm condition number,
This can be achieved by setting the option Both Ends
to get the largest and smallest few singular values, then taking the ratio of largest to smallest computed singular values as your estimate.
3.5 Alternative Methods
Other routines for the solution of sparse linear eigenproblems can currently be found in Chapters F02
. In particular, the following routines allow the direct solution of real symmetric systems:
4 General Use of Routines
This section will describe the complete structure of the reverse communication interfaces contained in this chapter. Numerous computational modes are available, including several shift-invert strategies designed to accelerate convergence. Two of the more sophisticated modes will be described in detail. The remaining ones are quite similar in principle, but require slightly different tasks to be performed with the reverse communication interface.
This chapter is structured as follows. The naming conventions used in this chapter, and the data types available are described in Section 4.1
, spectral transformations are discussed in Section 4.2
. Spectral transformations are usually extremely effective but there are a number of problem dependent issues that determine which one to use. In Section 4.3
we describe the reverse communication interface needed to exercise the various shift-invert options. Each shift-invert option is specified as a computational mode and all of these are summarised in the remaining sections. There is a subsection for each problem type and hence these sections are quite similar and repetitive. Once the basic idea is understood, it is probably best to turn directly to the subsection that describes the problem setting that is most interesting to you.
Perhaps the easiest way to rapidly become acquainted with the modes in this chapter is to run each of the example programs which use the various modes. These may be used as templates and adapted to solve specific problems.
4.1 Naming Conventions
Routines for solving nonsymmetric (real and complex) eigenvalue problems have as first letter after the chapter name, the letter ‘A’, e.g., F12ABF
; equivalent routines for symmetric eigenvalue problems will have this letter replaced by the letter ‘F’, e.g., F12FBF
. For the letter following this, routines for real eigenvalue problems will have letters in the range ‘A to M’ while those for complex eigenvalue problems will have letters correspondingly shifted into the range ‘N to Z’; so, for example, the complex equivalent of F12ADF
, while the real symmetric equivalent is F12FDF
A suite of five routines are named consecutively, e.g., F12AAF
Each general purpose routine has its own initialization routine, but uses the option setting routine from the suite relevant to the problem type. Thus each general purpose routine can be viewed as belonging to a suite of three routines, even though only two routines will be named consecutively. For example, F12ADF
represent the suite of routines for solving a banded real symmetric eigenvalue problem.
4.2 Shift and Invert Spectral Transformations
The most general problem that may be solved here is to compute a few selected eigenvalues and corresponding eigenvectors for
The shift and invert spectral transformation is used to enhance convergence to a desired portion of the spectrum. If
is an eigen-pair for
This transformation is effective for finding eigenvalues near
that are largest in magnitude correspond to the
of the original problem that are nearest to the shift
in absolute value. These transformed eigenvalues of largest magnitude are precisely the eigenvalues that are easy to compute with a Krylov method. (See Barrett et al. (1994)
). Once they are found, they may be transformed back to eigenvalues of the original problem. The direct relation is
and the eigenvector
in the transformed problem is also an eigenvector of the original problem corresponding to
. Usually the Arnoldi process will rapidly obtain good approximations to the eigenvalues of
of largest magnitude. However, to implement this transformation, you must provide the means to solve linear systems involving
either with a matrix factorization or with an iterative method.
will be non-Hermitian even if
are both Hermitian. However, this is easily remedied. The assumption that
is Hermitian positive definite implies that the bilinear form
is an inner product. If
is positive semidefinite and singular, then a semi-inner product results. This is a weighted
-inner product and vectors
. It is easy to show that if
is Hermitian (self-adjoint) then
is Hermitian self-adjoint with respect to this
-inner product (meaning
for all vectors
). Therefore, symmetry will be preserved if we force the computed basis vectors to be orthogonal in this
-inner product. Implementing this
-orthogonality requires you to provide a matrix-vector product
on request along with each application of
. In the following sections we shall discuss some of the more familiar transformations to the standard eigenproblem. However, when
is positive (semi)definite, we recommend using the shift-invert spectral transformation with
-inner products if at all possible. This is a far more robust transformation when
is ill-conditioned or singular. With a little extra manipulation (provided automatically in the post-processing routines) the semi-inner product induced by
prevents corruption of the computed basis vectors by roundoff-error associated with the presence of infinite eigenvalues. These very ill-conditioned eigenvalues are generally associated with a singular or highly ill-conditioned
. A detailed discussion of this theory may be found in Chapter 4 of Lehoucq et al. (1998)
Shift-invert spectral transformations are very effective and should even be used on standard problems,
, whenever possible. This is particularly true when interior eigenvalues are sought or when the desired eigenvalues are clustered. Roughly speaking, a set of eigenvalues is clustered if the maximum distance between any two eigenvalues in that set is much smaller than the minimum distance between these eigenvalues and any other eigenvalues of .
If you have a generalized problem , then you must provide a way to solve linear systems with either , or a linear combination of the two matrices in order to use the reverse communication suites in this chapter. In this case, a sparse direct method should be used to factor the appropriate matrix whenever possible. The resulting factorization may be used repeatedly to solve the required linear systems once it has been obtained. If instead you decide to use an iterative method, the accuracy of the solutions must be commensurate with the convergence tolerance used for the Arnoldi iteration. A slightly more stringent tolerance is needed relative to the desired accuracy of the eigenvalue calculation.
The main drawback with using the shift-invert spectral transformation is that the coefficient matrix is typically indefinite in the Hermitian case and has zero-valued eigenvalues in the non-Hermitian case. These are often the most difficult situations for iterative methods and also for sparse direct methods.
The decision to use a spectral transformation on a standard eigenvalue problem or to use one of the simple modes is problem dependent. The simple modes have the advantage that you only need to supply a matrix vector product . However, this approach is usually only successful for problems where extremal non-clustered eigenvalues are sought. In non-Hermitian problems, extremal means eigenvalues near the boundary of the spectrum of . For Hermitian problems, extremal means eigenvalues at the left- or right-hand end points of the spectrum of . The notion of non-clustered (or well separated) is difficult to define without going into considerable detail. A simplistic notion of a well-separated eigenvalue for a Hermitian problem would be for all with , where and are the smallest and largest algebraically. Unless a matrix vector product is quite difficult to code or extremely expensive computationally, it is probably worth trying to use the simple mode first if you are seeking extremal eigenvalues.
The remainder of this section discusses additional transformations that may be applied to convert a generalized eigenproblem to a standard eigenproblem. These are appropriate when is well-conditioned (Hermitian or non-Hermitian).
4.2.1 is Hermitian positive definite
is Hermitian positive definite and well-conditioned
is of modest size), then computing the Cholesky factorization
and converting equation (2)
provides a transformation to a standard eigenvalue problem. In this case, a request for a matrix vector product would be satisfied with the following three steps:
||Matrix-vector multiply .
||Solve for .
Upon convergence, a computed eigenvector for
is converted to an eigenvector of the original problem by solving the triangular system . This transformation is most appropriate when is Hermitian, is Hermitian positive definite and extremal eigenvalues are sought. This is because when is Hermitian, so is .
If is Hermitian positive definite and the smallest eigenvalues are sought, then it would be best to reverse the roles of and in the above description and ask for the largest algebraic eigenvalues or those of largest magnitude. Upon convergence, a computed eigenvalue
would then be converted to an eigenvalue of the original problem by the relation
4.2.2 is not Hermitian positive semidefinite
is Hermitian positive semidefinite, then a direct transformation to standard form is required. One simple way to obtain a direct transformation of equation (2)
to a standard eigenvalue problem
is to multiply on the left by
which results in
. Of course, you should not perform this transformation explicitly since it will most likely convert a sparse problem into a dense one. If possible, you should obtain a direct factorization of
and when a matrix-vector product involving
is called for, it may be accomplished with the following two steps:
||Matrix-vector multiply .
||Solve for .
Several problem-dependent issues may modify this strategy. If is singular or if you are interested in eigenvalues near a point then you may choose to work with but without using the -inner products discussed previously. In this case you will have to transform the converged eigenvalues of to eigenvalues of the original problem.
4.3 Reverse Communication and Shift-invert Modes
The reverse communication interface routine for real nonsymmetric problems is F12ABF
; for complex problems is F12APF
; and for real symmetric problems is F12FBF
. First the reverse communication loop structure will be described and then the details and nuances of the problem setup will be discussed. We use the symbol
for the operator that is applied to vectors in the Arnoldi/Lanczos process and
will stand for the matrix to use in the weighted inner product described previously. For the shift-invert spectral transformation mode
The basic idea is to set up a loop that repeatedly call one of F12ABF
. On each return, you must either apply
to a specified vector or exit the loop depending upon the value returned in the reverse communication parameter IREVCM.
4.3.1 Shift and invert on a generalized eigenproblem
The example program in
illustrates the reverse communication loop for F12ABF
in shift-invert mode for a generalized nonsymmetric eigenvalue problem. This loop structure will be identical for the symmetric problem calling F12FBF
. The loop structure is also identical for the complex arithmetic subroutine F12APF
In the example, the matrix is assumed to be symmetric and positive semidefinite. In the loop structure, you will have to supply a routine to obtain a matrix factorization of that may repeatedly be used to solve linear systems. Moreover, a routine needs to be provided to perform the matrix-vector product and a routine is required to solve linear systems of the form as needed using the previously computed factorization.
When convergence has taken place (indicated by
), the reverse communication loop will be exited. Then, post-processing using the relevant routine from F12ACF
must be done to recover the eigenvalues and corresponding eigenvectors of the original problem. When operating in shift-invert mode, the eigenvalue selection option is normally set to Largest Magnitude
. The post-processing routine is then used to convert the converged eigenvalues of
to eigenvalues of the original problem (2)
. Also, when
is singular or ill-conditioned, the post-processing routine takes steps to purify the eigenvectors and rid them of numerical corruption from eigenvectors corresponding to near-infinite eigenvalues. These procedures are performed automatically when operating in any one of the computational modes described above and later in this section.
You may wish to construct alternative computational modes using spectral transformations that are not addressed by any of the modes specified in this chapter. The reverse communication interface will easily accommodate these modifications. However, it will most likely be necessary to construct explicit transformations of the eigenvalues of to eigenvalues of the original problem in these situations.
4.3.2 Using the computational modes
The problem set up is similar for all of the available computational modes. In the previous section, a detailed description of the reverse communication loop for a specific mode (Shift-invert for a Generalized Problem) was given. To use this or any of the other modes listed below, you are strongly urged to modify one of the example programs.
The first thing to decide is whether the problem will require a spectral transformation. If the problem is generalized,
, then a spectral transformation will be required (see Section 4.2
). Such a transformation will most likely be needed for a standard problem if the desired eigenvalues are in the interior of the spectrum or if they are clustered at the desired part of the spectrum. Once this decision has been made and
has been specified, an efficient means to implement the action of the operator
on a vector must be devised. The expense of applying
to a vector will of course have direct impact on performance.
Shift-invert spectral transformations may be implemented with or without the use of a weighted
-inner product. The relation between the eigenvalues of
and the eigenvalues of the original problem must also be understood in order to make the appropriate eigenvalue selection option (e.g., Largest Magnitude
) in order to recover eigenvalues of interest for the original problem. You must specify the number of eigenvalues to compute, which eigenvalues are of interest, the number of basis vectors to use, and whether or not the problem is standard or generalized. These items are controlled by setting options via the option setting routine.
Setting the number of eigenvalues NEV and the number of basis vectors NCV (in the setup routine) for optimal performance is very much problem dependent. If possible, it is best to avoid setting NEV in a way that will split clusters of eigenvalues. As a rule of thumb
is reasonable. There are trade-offs due to the cost of the user-supplied matrix-vector products and the cost of the implicit restart mechanism. If the user-supplied matrix-vector product is relatively cheap, then a smaller value of NCV may lead to more user matrix-vector products and implicit Arnoldi iterations but an overall decrease in computation time. Convergence behaviour can be quite different depending on which of the spectrum options (e.g., Largest Magnitude
) is chosen. The Arnoldi process tends to converge most rapidly to extreme points of the spectrum. Implicit restarting can be effective in focusing on and isolating a selected set of eigenvalues near these extremes. In principle, implicit restarting could isolate eigenvalues in the interior, but in practice this is difficult and usually unsuccessful. If you are interested in eigenvalues near a point that is in the interior of the spectrum, a shift-invert strategy is usually required for reasonable convergence.
The integer argument IREVCM is the reverse communication flag that will specify a requested action on return from one of the solver routines F12ABF
. The options Standard
specify if this is a standard or generalized eigenvalue problem. The dimension of the problem is specified on the call to the initialization routine only; this value, together with the number of eigenvalues and the dimension of the basis vectors is passed through the communication array. There are a number of spectrum options which specify the eigenvalues to be computed; these options differ depending on whether a Hermitian or non-Hermitian eigenvalue problem is to be solved. For example, the Both Ends
is specific to Hermitian (symmetric) problems while the Largest Imaginary
is specific to non-Hermitian eigenvalue problems (see Section 10.1
in F12ADF). The specification of problem type will be described separately but the reverse communication interface and loop structure is the same for each type of the basic modes Regular
, Regular Inverse
, Shifted Inverse
(also Shifted Inverse Real
and Shifted Inverse Imaginary
for real nonsymmetric problems), and for the problem type: Standard
. There are some additional specialised modes for symmetric problems, Buckling
, and for real nonsymmetric problems with complex shifts applied in real arithmetic. You are encouraged to examine the documented example programs for these modes.
specifies the accuracy requested. If you wish to supply shifts for implicit restarting then the Supplied Shifts
must be selected, otherwise the default Exact Shifts
strategy will be used. The Supplied Shifts
should only be used when you have a great deal of knowledge about the spectrum and about the implicit restarted Arnoldi method and its underlying theory. The Iteration Limit
should be set to the maximum number of implicit restarts allowed. The cost of an implicit restart step (major iteration) is in the order of
floating point operations for the dense matrix operations and
with the matrix
The choice of computational mode through the option setting routine is very important. The legitimate computational mode options available differ with each problem type and are listed below for each of them.
4.3.3 Computational modes for real symmetric problems
The reverse communication interface subroutine for symmetric eigenvalue problems is F12FBF
. The option for selecting the region of the spectrum of interest can be one of those listed in Table 1
Eigenvalue spectrum options for symmetric eigenproblems
lists the spectral transformation options for symmetric eigenvalue problems together with the specification of
for each mode and the problem type option setting.
Problem types, computational modes and spectral transformations for symmetric eigenproblems
4.3.4 Computational modes for non-Hermitian problems
is a general non-Hermitian matrix and
is Hermitian and positive semidefinite, then the selection of the eigenvalues is controlled by the choice of one of the options in Table 3
Eigenvalue spectrum options for real nonsymmetric and complex eigenproblems
lists the spectral transformation options for real nonsymmetric eigenvalue problems together with the specification of
for each mode and the problem type option setting. The equivalent listing for complex non-Hermitian eigenvalue problems is given in Table 5
Problem types, computational modes and spectral transformations for real nonsymmetric eigenproblems
Note that there are two shifted inverse modes with complex shifts in Table 4
is complex, these both require the factorization of the matrix
in complex arithmetic even though, in the case of real nonsymmetric problems, both
are real. The only advantage of using this option for real nonsymmetric problems instead of using the equivalent suite for complex problems is that all of the internal operations in the Arnoldi process are executed in real arithmetic. This results in a factor of two saving in storage and a factor of four saving in computational cost. There is additional post-processing that is somewhat more complicated than the other modes in order to get the eigenvalues and eigenvectors of the original problem. These modes are only recommended if storage is extremely critical.
Problem types, computational modes and spectral transformations for complex non-Hermitian eigenproblems
4.3.5 Post processing
On the final successful return from a reverse communication routine, the corresponding post-processing routine must be called to get eigenvalues of the original problem and the corresponding eigenvectors if desired. In the case of Shifted Inverse
modes for Generalized
problems, there are some subtleties to recovering eigenvectors when
is ill-conditioned. This process is called eigenvector purification. It prevents eigenvectors from being corrupted with noise due to the presence of eigenvectors corresponding to near infinite eigenvalues. These operations are completely transparent to you. There is negligible additional cost to obtain eigenvectors. An orthonormal (Arnoldi/Lanczos) basis is always computed. The approximate eigenvalues of the original problem are returned in ascending algebraic order. The option relevant to this routine is Vectors
which may be set to values that determine whether only eigenvalues are desired or whether corresponding eigenvectors and/or Schur vectors are required. The value of the shift
used in spectral transformations must be passed to the post-processing routine through the appropriately named argument(s). The eigenvectors returned are normalized to have unit length with respect to the semi-inner product that was used. Thus, if
then they will have unit length in the standard-norm. In general, a computed eigenvector
4.3.6 Solution monitoring and printing
The option setting routine for each suite allows the setting of three options that control solution printing and the monitoring of the iterative and post-processing stages. These three options are: Advisory
and Print Level
. By default, no solution monitoring or printing is performed. The Advisory
option controls where solution details are printed; the Monitoring
option controls where monitoring details are to be printed and is mainly used for debugging purposes; the Print Level
option controls the amount of detail to be printed, see individual option setting routine documents for specifications of each print level. The value passed to Advisory
can be the same, but it is recommended that the two sets of information be kept separate. Note that the monitoring information can become very voluminous for the highest settings of Print Level
5 Functionality Index
|Standard or generalized eigenvalue problems for complex matrices,|| |
| initialize problem and method|| ||F12ATF|
| selected eigenvalues, eigenvectors and/or Schur vectors|| ||F12AUF|
| initialize problem and method|| ||F12ANF|
| reverse communication implicitly restarted Arnoldi method|| ||F12APF|
| reverse communication monitoring|| ||F12ASF|
| selected eigenvalues, eigenvectors and/or Schur vectors of original problem|| ||F12AQF|
|Standard or generalized eigenvalue problems for real nonsymmetric matrices,|| |
| initialize problem and method|| ||F12AFF|
| selected eigenvalues, eigenvectors and/or Schur vectors|| ||F12AGF|
| initialize problem and method|| ||F12AAF|
| reverse communication implicitly restarted Arnoldi method|| ||F12ABF|
| reverse communication monitoring|| ||F12AEF|
| selected eigenvalues, eigenvectors and/or Schur vectors of original problem|| ||F12ACF|
|Standard or generalized eigenvalue problems for real symmetric matrices,|| |
| initialize problem and method|| ||F12FFF|
| selected eigenvalues, eigenvectors and/or Schur vectors|| ||F12FGF|
| initialize problem and method|| ||F12FAF|
| reverse communication implicitly restarted Arnoldi(Lanczos) method|| ||F12FBF|
| reverse communication monitoring|| ||F12FEF|
| selected eigenvalues and eigenvectors and/or Schur vectors of original problem|| ||F12FCF|
6 Auxiliary Routines Associated with Library Routine Parameters
7 Routines Withdrawn or Scheduled for Withdrawal
Barrett R, Berry M, Chan T F, Demmel J, Donato J, Dongarra J, Eijkhout V, Pozo R, Romine C and Van der Vorst H (1994) Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods SIAM, Philadelphia
Lehoucq R B (1995) Analysis and implementation of an implicitly restarted iteration PhD Thesis Rice University, Houston, Texas
Lehoucq R B (2001) Implicitly restarted Arnoldi methods and subspace iteration SIAM Journal on Matrix Analysis and Applications 23 551–562
Lehoucq R B and Scott J A (1996) An evaluation of software for computing eigenvalues of sparse nonsymmetric matrices Preprint MCS-P547-1195 Argonne National Laboratory
Lehoucq R B and Sorensen D C (1996) Deflation techniques for an implicitly restarted Arnoldi iteration SIAM Journal on Matrix Analysis and Applications 17 789–821
Lehoucq R B, Sorensen D C and Yang C (1998) ARPACK Users' Guide: Solution of Large-scale Eigenvalue Problems with Implicitly Restarted Arnoldi Methods SIAM, Philidelphia
Saad Y (1992) Numerical Methods for Large Eigenvalue Problems Manchester University Press, Manchester, UK