hide long namesshow long names
hide short namesshow short names
Integer type:  int32  int64  nag_int  show int32  show int32  show int64  show int64  show nag_int  show nag_int

PDF version (NAG web site, 64-bit version, 64-bit version)
Chapter Contents
Chapter Introduction
NAG Toolbox

NAG Toolbox: nag_contab_binary (g11sa)

 Contents

    1  Purpose
    2  Syntax
    7  Accuracy
    9  Example

Purpose

nag_contab_binary (g11sa) fits a latent variable model (with a single factor) to data consisting of a set of measurements on individuals in the form of binary-valued sequences (generally referred to as score patterns). Various measures of goodness-of-fit are calculated along with the factor (theta) scores.

Syntax

[x, irl, a, c, niter, alpha, pigam, cm, g, expp, obs, exf, y, iob, rlogl, chi, idf, siglev, ifail] = g11sa(n, gprob, x, irl, a, c, cgetol, chisqr, 'ip', ip, 'ns', ns, 'iprint', iprint, 'maxit', maxit)
[x, irl, a, c, niter, alpha, pigam, cm, g, expp, obs, exf, y, iob, rlogl, chi, idf, siglev, ifail] = nag_contab_binary(n, gprob, x, irl, a, c, cgetol, chisqr, 'ip', ip, 'ns', ns, 'iprint', iprint, 'maxit', maxit)

Description

Given a set of p dichotomous variables x~=x1,x2,,xp, where  denotes vector or matrix transpose, the objective is to investigate whether the association between them can be adequately explained by a latent variable model of the form (see Bartholomew (1980) and Bartholomew (1987))
Gπiθ=αi0+αi1θ. (1)
The xi are called item responses and take the value 0 or 1. θ denotes the latent variable assumed to have a standard Normal distribution over a population of individuals to be tested on p items. Call πiθ=Pxi=1θ the item response function: it represents the probability that an individual with latent ability θ will produce a positive response (1) to item i. αi0 and αi1 are item parameters which can assume any real values. The set of parameters, αi1, for i=1,2,,p, being coefficients of the unobserved variable θ, can be interpreted as ‘factor loadings’.
G is a function selected by you as either Φ-1 or logit, mapping the interval 0,1 onto the whole real line. Data from a random sample of n individuals takes the form of the matrices X and R defined below:
Xs×p= x11 x12 x1p x21 x22 x2p xs1 xs2 xsp = x~1 x~2 x~s ,  Rs×1= r1 r2 rs  
where x~l = xl1,xl2,,xlp  denotes the lth score pattern in the sample, rl the frequency with which x~l occurs and s the number of different score patterns observed. (Thus l=1srl=n). It can be shown that the log-likelihood function is proportional to
l=1 s rl logPl ,  
where
Pl = P x~ = x~l = - P x~ = x~l θ ϕθ dθ (2)
(ϕθ being the probability density function of a standard Normal random variable).
Pl denotes the unconditional probability of observing score pattern x~l. The integral in (2) is approximated using Gauss–Hermite quadrature. If we take Gz=logitz=logz1-z in (1) and reparameterise as follows,
αi = αi1, πi = logit-1αi0,  
then (1) reduces to the logit model (see Bartholomew (1980))
πiθ = πi πi + 1-πi exp - αi θ .  
If we take Gz=Φ-1z (where Φ is the cumulative distribution function of a standard Normal random variable) and reparameterise as follows,
αi = αi11+αi12 γi = -αi01+αi12 ,  
then (1) reduces to the probit model (see Bock and Aitkin (1981))
πiθ=ϕ αiθ-γi 1-αi2 .  
An E-M algorithm (see Bock and Aitkin (1981)) is used to maximize the log-likelihood function. The number of quadrature points used is set initially to 10 and once convergence is attained increased to 20.
The theta score of an individual responding in score pattern x~l is computed as the posterior mean, i.e., Eθx~l. For the logit model the component score Xl=j=1pαjxlj is also calculated. (Note that in calculating the theta scores and measures of goodness-of-fit nag_contab_binary (g11sa) automatically reverses the coding on item j if αj<0; it is assumed in the model that a response at the one level is showing a higher measure of latent ability than a response at the zero level.)
The frequency distribution of score patterns is required as input data. If your data is in the form of individual score patterns (uncounted), then nag_contab_binary_service (g11sb) may be used to calculate the frequency distribution.

References

Bartholomew D J (1980) Factor analysis for categorical data (with Discussion) J. Roy. Statist. Soc. Ser. B 42 293–321
Bartholomew D J (1987) Latent Variable Models and Factor Analysis Griffin
Bock R D and Aitkin M (1981) Marginal maximum likelihood estimation of item parameters: Application of an E-M algorithm Psychometrika 46 443–459

Parameters

Compulsory Input Parameters

1:     n int64int32nag_int scalar
n, the number of individuals in the sample.
Constraint: n7.
2:     gprob – logical scalar
Must be set equal to true if Gz=Φ-1z and false if Gz=logitz.
3:     xldxip – logical array
ldx, the first dimension of the array, must satisfy the constraint ldxns.
The first s rows of x must contain the s different score patterns. The lth row of x must contain the lth score pattern with xlj set equal to true if xlj=1 and false if xlj=0. All rows of x must be distinct.
4:     irlns int64int32nag_int array
The ith component of irl must be set equal to the frequency with which the ith row of x occurs.
Constraints:
  • irli0, for i=1,2,,s;
  • i=1 sirli=n.
5:     aip – double array
aj must be set equal to an initial estimate of αj1. In order to avoid divergence problems with the E-M algorithm you are strongly advised to set all the aj to 0.5.
6:     cip – double array
cj must be set equal to an initial estimate of αj0. In order to avoid divergence problems with the E-M algorithm you are strongly advised to set all the cj to 0.0.
7:     cgetol – double scalar
The accuracy to which the solution is required.
If cgetol is set to 10-l and on exit ifail=0 or 7, then all elements of the gradient vector will be smaller than 10-l in absolute value. For most practical purposes the value 10-4 should suffice. You should be wary of setting cgetol too small since the convergence criterion may then have become too strict for the machine to handle.
If cgetol has been set to a value which is less than the square root of the machine precision, ε, then nag_contab_binary (g11sa) will use the value ε instead.
8:     chisqr – logical scalar
If chisqr is set equal to true, then a likelihood ratio statistic will be calculated (see chi).
If chisqr is set equal to false, no such statistic will be calculated.

Optional Input Parameters

1:     ip int64int32nag_int scalar
Default: the dimension of the arrays a, c and the second dimension of the array x. (An error is raised if these dimensions are not equal.)
p, the number of dichotomous variables.
Constraint: ip3.
2:     ns int64int32nag_int scalar
Default: the dimension of the array irl and the first dimension of the array x. (An error is raised if these dimensions are not equal.)
ns must be set equal to the number of different score patterns in the sample, s.
Constraint: 2×ip<nsmin2ip,n.
3:     iprint int64int32nag_int scalar
Default: 1
The frequency with which the maximum likelihood search function is to be monitored.
iprint>0
The search is monitored once every iprint iterations, and when the number of quadrature points is increased, and again at the final solution point.
iprint=0
The search is monitored once at the final point.
iprint<0
The search is not monitored at all.
iprint should normally be set to a small positive number.
4:     maxit int64int32nag_int scalar
Default: 1000
The maximum number of iterations to be made in the maximum likelihood search. There will be an error exit (see Error Indicators and Warnings) if the search function has not converged in maxit iterations.
Constraint: maxit1.

Output Parameters

1:     xldxip – logical array
Given a valid parameter set then the first s rows of x still contain the s different score patterns. However, the following points should be noted:
(i) If the estimated factor loading for the jth item is negative then that item is re-coded, i.e., 0s and 1s (or true and false) in the jth column of x are interchanged.
(ii) The rows of x will be reordered so that the theta scores corresponding to rows of x are in increasing order of magnitude.
2:     irlns int64int32nag_int array
Given a valid parameter set then the first s components of irl are reordered as are the rows of x.
3:     aip – double array
aj contains the latest estimate of αj1, for j=1,2,,p. (Because of possible recoding all elements of a will be positive.)
4:     cip – double array
cj contains the latest estimate of αj0, for j=1,2,,p.
5:     niter int64int32nag_int scalar
Given a valid parameter set then niter contains the number of iterations performed by the maximum likelihood search function.
6:     alphaip – double array
Given a valid parameter set then alphaj contains the latest estimate of αj. (Because of possible recoding all elements of alpha will be positive.)
7:     pigamip – double array
Given a valid parameter set then pigamj contains the latest estimate of either πj if gprob=false (logit model) or γj if gprob=true (probit model).
8:     cmldcm2×ip – double array
Given a valid parameter set then the strict lower triangle of cm contains the correlation matrix of the parameter estimates held in alpha and pigam on exit. The diagonal elements of cm contain the standard errors. Thus:
cm2×i-12×i-1 = standard error alphai
cm2×i2×i = standard error pigami
cm2×i2×i-1 = correlation pigami,alphai,
for i=1,2,,p;
cm2×i-12×j-1 = correlation alphai,alphaj
cm2×i2×j = correlation pigami,pigamj
cm2×i-12×j = correlation alphai,pigamj
cm2×i2×j-1 = correlation alphaj,pigami,
for j=1,2,,i-1.
If the second derivative matrix cannot be computed then all the elements of cm are returned as zero.
9:     g2×ip – double array
Given a valid parameter set then g contains the estimated gradient vector corresponding to the final point held in the arrays alpha and pigam. g2×j-1 contains the derivative of the log-likelihood with respect to alphaj, for j=1,2,,p. g2×j contains the derivative of the log-likelihood with respect to pigamj, for j=1,2,,p.
10:   exppldexppip – double array
Given a valid parameter set then exppij contains the expected percentage of individuals in the sample who respond positively to items i and j (ji), corresponding to the final point held in the arrays alpha and pigam.
11:   obsldexppip – double array
Given a valid parameter set then obsij contains the observed percentage of individuals in the sample who responded positively to items i and j (ji).
12:   exfns – double array
Given a valid parameter set then exfl contains the expected frequency of the lth score pattern (lth row of x), corresponding to the final point held in the arrays alpha and pigam.
13:   yns – double array
Given a valid parameter set then yl contains the estimated theta score corresponding to the lth row of x, for the final point held in the arrays alpha and pigam.
14:   iobns int64int32nag_int array
Given a valid parameter set then iobl contains the number of items in the lth row of x for which the response was positive (true).
15:   rlogl – double scalar
Given a valid parameter set then rlogl contains the value of the log-likelihood kernel corresponding to the final point held in the arrays alpha and pigam, namely
l=1 sirll×logexfl/n.  
16:   chi – double scalar
If chisqr was set equal to true on entry, then given a valid parameter set, chi will contain the value of the likelihood ratio statistic corresponding to the final parameter estimates held in the arrays alpha and pigam, namely
2×l=1 sirll×logexfl/irll.  
The summation is over those elements of irl which are positive. If exfl is less than 5.0, then adjacent score patterns are pooled (the score patterns in x being first put in order of increasing theta score).
If chisqr has been set equal to false, then chi is not used.
17:   idf int64int32nag_int scalar
If chisqr was set equal to true on entry, then given a valid parameter set, idf will contain the degrees of freedom associated with the likelihood ratio statistic, chi.
idf=s0-2×p if s0<2p;
idf=s0-2×p-1 if s0=2p,
where s0 denotes the number of terms summed to calculate chi (s0=s only if there is no pooling).
If chisqr has been set equal to false, then idf is not used.
18:   siglev – double scalar
If chisqr was set equal to true on entry, then given a valid parameter set, siglev will contain the significance level of chi based on idf degrees of freedom. If idf is zero or negative then siglev is set to zero.
If chisqr was set equal to false, then siglev is not used.
19:   ifail int64int32nag_int scalar
ifail=0 unless the function detects an error (see Error Indicators and Warnings).

Error Indicators and Warnings

Note: nag_contab_binary (g11sa) may return useful information for one or more of the following detected errors or warnings.
Errors or warnings detected by the function:

Cases prefixed with W are classified as warnings and do not generate an error of type NAG:error_n. See nag_issue_warnings.

   ifail=1
On entry,ip<3,
orn<7,
orns2×ip,
orns>n,
orns>2ip,
ortwo or more rows of x are identical,
orldx<ns,
orl=1 nsirlln,
orat least one of irll<0, for l=1,2,,ns,
ormaxit<1,
orishow<0,
orishow>7,
orldcm<ip+ip,
orldexpp<ip,
orlw<4×ip×ip+16.
   ifail=2
For at least one of the ip items the responses are all at the same level. To proceed, you must delete this item from the dataset.
   ifail=3
There have been maxit iterations of the maximum likelihood search function. If steady increases in the log-likelihood kernel were monitored up to the point where this exit occurred, then the exit probably occurred simply because maxit was set too small, so the calculations should be restarted from the final point held in a and c. This type of exit may also indicate that there is no maximum to the likelihood surface.
   ifail=4
One of the elements of a has exceeded 10.0 in absolute value (see Heywood Cases). If steady increases in the log-likelihood kernel were monitored up to the point where this exit occurred then this exit may indicate that there is no maximum to the likelihood surface. You are advised to restart the calculations from a different point to see whether the E-M algorithm moves off in the same direction.
   ifail=5
This indicates a failure in nag_matop_real_symm_posdef_inv (f01ab) which is used to invert the second derivative matrix for calculating the variance-covariance matrix of parameter estimates. It was also found that maxit iterations had been performed (see ifail=3). The elements of cm will then have been set to zero on exit. You are advised to restart the calculations with a larger value for maxit.
   ifail=6
This indicates a failure in nag_matop_real_symm_posdef_inv (f01ab) which is used to invert the second derivative matrix for calculating the variance-covariance matrix of parameter estimates. It was also found that one of the elements of a had exceeded 10.0 in absolute value (see ifail=4). The elements of cm will have then been set to zero on exit. You are advised to restart the calculations from a different point to see whether the E-M algorithm moves off in the same direction.
W  ifail=7
If chisqr was set equal to true on entry, so that a likelihood ratio statistic was calculated, then ifail=7 merely indicates that the value of idf on exit is 0, i.e., the χ2 statistic is meaningless. In this case siglev is returned as zero. All other output information should be correct, i.e., can be treated as if ifail=0 on exit.
   ifail=-99
An unexpected error has been triggered by this routine. Please contact NAG.
   ifail=-399
Your licence key may have expired or may not have been installed correctly.
   ifail=-999
Dynamic memory allocation failed.

Accuracy

On exit from nag_contab_binary (g11sa) if ifail=0 or 7 then the following condition will be satisfied:
max 1i2×p gi < cgetol .  
If ifail=3 or 5 on exit (i.e., maxit iterations have been performed but the above condition does not hold), then the elements in a, c, alpha and pigam may still be good approximations to the maximum likelihood estimates. You are advised to inspect the elements of g to see whether this is confirmed.

Further Comments

Timing

The number of iterations required in the maximum likelihood search depends upon the number of observed variables, p, and the distance of the starting point you supplied from the solution. The number of multiplications and divisions performed in an iteration is proportional to p.

Initial Estimates

You are strongly advised to use the recommended starting values for the elements of a and c. Divergence may result from values you supplied even if they are very close to the solution. Divergence may also occur when an item has nearly all its responses at one level.

Heywood Cases

As in normal factor analysis, Heywood cases can often occur, particularly when p is small and n not very big. To overcome this difficulty the maximum likelihood search function is terminated when the absolute value of one of the αj1 exceeds 10.0. You have the option of deciding whether to exit from nag_contab_binary (g11sa) (by setting ifail=0 on entry) or to permit nag_contab_binary (g11sa) to proceed onwards as if it had exited normally from the maximum likelihood search function (setting ifail=-1 on entry). The elements in a, c, alpha and pigam may still be good approximations to the maximum likelihood estimates. You are advised to inspect the elements g to see whether this is confirmed.

Goodness of Fit Statistic

When n is not very large compared to s a goodness-of-fit statistic should not be calculated as many of the expected frequencies will then be less than 5.

First and Second Order Margins

The observed and expected percentages of sample members responding to individual and pairs of items held in the arrays obs and expp on exit can be converted to observed and expected numbers by multiplying all elements of these two arrays by n/100.0.

Example

A program to fit the logit latent variable model to the following data:
Index Score Pattern Observed Frequency
01 0000 0154
02 1000 0011
03 0001 0042
04 0100 0049
05 1001 0002
06 1100 0010
07 0101 0027
08 0010 0084
09 1101 0010
10 1010 0025
11 0011 0075
12 0110 0129
13 1011 0030
14 1110 0050
15 0111 0181
16 1111 0121
    ––––
Total   1000
function g11sa_example


fprintf('g11sa example results\n\n');

n = int64(1000);
x = [false, false, false, false;
     true,  false, false, false;
     false, false, false, true;
     false, true,  false, false;
     true,  false, false, true;
     true,  true,  false, false;
     false, true,  false, true;
     false, false, true,  false;
     true,  true,  false, true;
     true,  false, true,  false;
     false, false, true,  true;
     false, true,  true,  false;
     true,  false, true,  true;
     true,  true,  true,  false;
     false, true,  true,  true;
     true,  true,  true,  true];
irl = [int64(154);  11;  42;  49;
                  2;  10;  27;  84;
                 10;  25;  75; 129;
                 30;  50; 181; 121];

% Initial values
a = [0.5;     0.5;     0.5;     0.5];
c = [0;       0;       0;       0];

% Parameters
gprob  = false;
cgetol = 0.0001;
chisqr = true;
iprint = int64(-1);

% Fit a latent variable model
[x, irl, a, c, niter, alpha, pigam, cm, g, expp, obs, exf, y, ...
  iob, rlogl, chi, idf, siglev, ifail] = ...
  g11sa( ...
         n, gprob, x, irl, a, c, cgetol, chisqr, 'iprint', iprint);

% Display results
fprintf('Log likelihood kernel on exit = %14.4e\n\n', rlogl);

fprintf('Maximum likelihood estimates of item parameters are as follows\n');
fprintf('--------------------------------------------------------------\n\n');
fprintf('%8s%12s%11s%16s%10s%13s\n\n', 'item j', 'alpha(j)', 's.e.', ...
        'alpha(j,0)', 'pi(j)', 's.e.');
ivar = [1:numel(a)]';
se   = diag(cm);
results = [ivar alpha se(1:2:end) c pigam se(2:2:end)];
fprintf('%5d%13.3f%13.3f%13.3f%13.3f%13.3f\n',results');
fprintf('\n\n');

mtitle = 'Expected percentage of cases producing positive responses';
[ifail] = x04ca( ...
                 'Lower', 'Non-unit', expp, mtitle);
fprintf('\n');

mtitle = 'Observed percentage of cases producing positive responses';
[ifail] = x04ca( ...
                 'Lower', 'Non-unit', obs, mtitle);
fprintf('\n\n');

fprintf(' Observed   Expected   Theta   Component   Raw    Score\n');
fprintf(' frequency  frequency  score   score       score  pattern\n\n');
cs = double(x)*alpha;
results = [ double(irl)  exf  y  cs double(iob) double(x)];
fprintf('%7d%13.3f%8.3f%10.3f%8d    %1d%1d%1d%1d\n',results');
fprintf('---------  ---------\n');
fprintf('%7d%13.3f\n\n',n,n);

fprintf('Likelihood ratio goodness of fit statistic = %10.3f\n', chi);
fprintf('                        Significance level = %10.3f\n', siglev);
fprintf('(Based on %4d degrees of freedom)\n',idf)


g11sa example results

Log likelihood kernel on exit =    -2.4039e+03

Maximum likelihood estimates of item parameters are as follows
--------------------------------------------------------------

  item j    alpha(j)       s.e.      alpha(j,0)     pi(j)         s.e.

    1        1.045        0.148       -1.276        0.218        0.017
    2        1.409        0.179        0.424        0.604        0.022
    3        2.659        0.525        1.615        0.834        0.036
    4        1.122        0.140       -0.062        0.485        0.020


 Expected percentage of cases producing positive responses
             1          2          3          4
 1     25.8963
 2     19.0888    57.6547
 3     22.4987    47.9571    69.4214
 4     16.4381    33.8672    40.5658    48.7712

 Observed percentage of cases producing positive responses
             1          2          3          4
 1     25.9000
 2     19.1000    57.7000
 3     22.6000    48.1000    69.5000
 4     16.3000    33.9000    40.7000    48.8000


 Observed   Expected   Theta   Component   Raw    Score
 frequency  frequency  score   score       score  pattern

    154      147.061  -1.273     0.000       0    0000
     11       13.444  -0.873     1.045       1    1000
     42       42.420  -0.846     1.122       1    0001
     49       54.818  -0.747     1.409       1    0100
      2        5.886  -0.494     2.167       2    1001
     10        8.410  -0.399     2.455       2    1100
     27       27.511  -0.374     2.531       2    0101
     84       92.062  -0.332     2.659       1    0010
     10        6.237  -0.019     3.577       3    1101
     25       21.847   0.027     3.705       2    1010
     75       73.835   0.055     3.781       2    0011
    129      123.766   0.162     4.069       2    0110
     30       26.899   0.466     4.826       3    1011
     50       50.881   0.591     5.114       3    1110
    181      179.564   0.626     5.190       3    0111
    121      125.360   1.144     6.236       4    1111
---------  ---------
   1000     1000.000

Likelihood ratio goodness of fit statistic =      9.027
                        Significance level =      0.251
(Based on    7 degrees of freedom)

PDF version (NAG web site, 64-bit version, 64-bit version)
Chapter Contents
Chapter Introduction
NAG Toolbox

© The Numerical Algorithms Group Ltd, Oxford, UK. 2009–2015