Search

T tests in censored normal distribution

T-tests assume normal distributed random variates. We experience designs in which data take on a particular value and are otherwise normal distributed on a half axis. It might be the case in experiments in which a regimen is only applied due to symptoms or the participant’s request. In such case a censored normal distribution assumption will increase the strength of the experiment, i.e. statistical power will be increased and assumptions of an underlying normal distribution will be easier to justify.


The suggested test is based on the chi-square likelihood ratio test. The example is two independent groups of identical independently distributed samples and the null hypothesis is identical distributions. The density function splits into single probability, given as the integral of a normal density from negative infinity to the lower bound and the density of the normal distribution for values larger than the lower bound.


The expression involves the distribution function for a Gaussian variate due to normalization. Likelihood ratio value can be calculated in SAS using PROC LIFEREG. P-value is then calculated with a lookup of a chisq quantile value.

%macro tobittest(var_name,group_name,datafile); /*https://support.sas.com/documentation/cdl/en/statug/63033/HTML/default/viewer.htm#statug_lifereg_sect035.htm;*/ data analysedata; set &datafile; lower=&var_name.; if missing(&var_name.) then delete; run; proc lifereg data=analysedata outest=OUTEST(keep=_scale_);   class &group_name.;       model (lower, &var_name.) = &group_name. / d=normal;   probplot ppout npintervals=simul;       inset;       output out=OUT xbeta=Xbeta;   ods output ParameterEstimates=PE;   ods select ParameterEstimates FitStatistics; run; data predict;       drop lambda _scale_ _prob_;       set out;       if _n_ eq 1 then set outest;       lambda = pdf(‘NORMAL’,Xbeta/_scale_)                / cdf(‘NORMAL’,Xbeta/_scale_);       Predict = cdf(‘NORMAL’, Xbeta/_scale_)                 * (Xbeta + _scale_*lambda);   res=(&var_name.-predict)/_scale_;       label Xbeta=’MEAN OF UNCENSORED VARIABLE’             Predict = ‘MEAN OF CENSORED VARIABLE’; run; title1 “&var_name.”; title2 “Tobit regression”; proc univariate data=predict(where=(NOT(missing(&var_name.)))); var res; qqplot /normal(mu=est sigma=est); ods select qqplot; run; title2 “Test for differences between groups”; proc print data=PE(where=(Parameter EQ ‘&group_name.’)); run; title2 “Summary statistics across groups”; proc tabulate data=analysedata; class &group_name.; var &var_name.; table &group_name. all,&var_name.*(min p25 median p75 max); run; data zero; set analysedata; zero=0; if &var_name. EQ 0 then zero=1; run; title2 “Zero values (censored values)”; proc tabulate data=zero; class &group_name. zero; table &group_name. all,zero all; run; title1; %mend; ods pdf; %tobittest(varnameOnFile,groupvarOnFile,datanameFile);

In R the package censReg by Arne Henningsen should perform a similar calculation, however I have found lack of convergence and thus recommend using SAS.

0 views

Recent Posts

See All

©2020 by Danish Institute for Data Science. Proudly created with Wix.com