How QRPEM Calculates Population Parameters

The current QRPEM code, as of 2023, does not include a mixture model, so the number of mixture K is set to 1. However, the mixture label K can be removed. For example,

Eqtn_2_2_26_mu_UniqueSolution

(discussed in “Solutions”) can be written as

Eqtn_2_3_1_mu_UniqueSolutionRewrite

where

is gikthetaiphisuperrbark1

pithetaiphisuperr is the joint likelihood:

Eqtn_2_3_2_JointLikelihood

mui_superrplus1 can be defined as the (r +1)th iteration’s Bayes estimates of the mean for subject i,

Eqtn_2_3_3_mu_i_integral

and the initial equation becomes

Eqtn_2_3_4_mu_rewrite

In fact, this equation is Eq.(8) in reference [17], and mui_superr replaces xi.

Similarly, omegai_superrplus1 can be defined as the (r+1)th iteration’s Bayes estimates of the covariance for subject i,

Eqtn_2_3_5_omega_rewrite

and the equation:

Eqtn_2_2_27_omega_UniqueSolution

(discussed earlier) for K = 1 become

Eqtn_2_3_6_omega_rewrite

All the calculations which involve the integral over pithetaiphisuperr are performed using the Monte Carlo method with an importance sampling function I(Thetai). In the current NLME engine, by default I(Thetai) is a multivariate normal distribution, whose mean and covariance are mui_superr and omegai_superr, respectively. (Note that the NLME engine also provides direct sampling, double exponential, multivariate t, mixture-2, and mixture-3. In addition, for the multivariate normal distribution case, the mean and covariance used depends on whether MAP assistance is enabled or not.)

Take the calculation of mui_superrplus1 as the importance sampling function, for example.

Eqtn_2_3_7_mui_rplus1_equation

In principle, the role of I(Thetai) is to mimic the shape of thetaipithetaiphsir, so that the variance of the Monte Carlo estimator of Thetai_anglebrackets is kept as low as possible [18] [2]. To calculate mui_superrplus1, its biased estimator [18] [2] mui_superrplus1_Anglebrackets is used. The weight wthetaiphi_superr is defined as

Eqtn_2_3_8_weight_equation

Then

Eqtn_2_3_9_mui_rplus1_rewrite

where

pij is a normalized weight
Eqtn_2_3_10_NormalizedWeight
(the same as the pij in Eq.(3) in reference [17], normalized by Eqtn_2_3_10a_Normalization and pij).

M is the total number of samples (in QRPEM, usually M = 300).

(j) in thetai_superj means the jth sample of Thetai.

All the thetai_superj are sampled from the importance sampling function I(Thetai).

Notes:

When using the biased estimator equation, the normalization factor of I(Thetai) does not matter, since it will be canceled in the numerator and the denominator in this equation.

QRPEM does not just ‘randomly’ sample from the importance sampling function I(Thetai). Instead, the samples of thetai_superj are ‘quasi-randomly’ sampled by using the so called low discrepancy quasi-random sequence. In particular, QRPEM uses a Sobol sequence. The advantage of using quasi-random samples is that, for purposes of numerical integration, sampling from the parameter space of I(Thetai) is done much more evenly than purely random sampling. As a result, QRPEM usually provides far more accurate integral values for a given sample size. In other words, QRPEM typically gives accurate results using a much smaller Monte Carlo sample size than other MCPEM methods. Therefore, QRPEM is usually much faster than other MCPEM methods, without compromising accuracy.

For the total log likelihood, since there is no Gaussian mixture, lnLog_phi is

Eqtn_2_3_11_TotalLogLikelihood

where Eqtn_2_3_11a_ni_integral. The same M quasi-random samples of thetai_superj sampled from the importance sampling function I(Thetai) using the low-discrepancy Sobol sequences, can be used to evaluate ni as follows,

Eqtn_2_3_12_ni_evaluation


Legal Notice | Contact Certara
© Certara USA, Inc. All rights reserved.