The serp R package fits cumulative link models (CLMs)
with the smooth-effect-on-response penalty (SERP). The
cumulative model developed by McCullagh (1980) is probably
the most frequently used ordinal model in empirical studies. However,
the stochastic ordering property of the general form of the model poses
a very serious challenge in most empirical applications of the model.
For instance, unstable likelihoods with ill-conditioned parameter space
are frequently encountered during the iterative process.
serp implements a unique regularization method for CLMs
that provides the means of smoothing the adjacent categories in the
model. At extreme shrinkage, SERP causes all subject-specific effects
associated with each variable in the model to shrink towards unique
global effects. Fitting is done using a modified Newton’s method.
Several standard model performance and descriptive methods are also
available. See Ugba,
2021, Ugba et al.,
2021 and Tutz and
Gertheiss, 2016 for further details on the implemented penalty.
Consider the cumulative logit model of the wine dataset, where the rating of wine bitterness is predicted with the two treatment factors, temperature and contact.
## The unpenalized non-proportional odds model returns unbounded estimates, hence,
## not fully identifiable.
f1 <- serp(rating ~ temp + contact, slope = "unparallel",
reverse = TRUE, link = "logit", data = wine)
coef(f1)## The penalized non-proportional odds model with a user-supplied lambda gives
## a fully identified model having bounded estimates. A suitable tuning criterion
## could as well be used to select lambda (e.g., aic or cv)
f2 <- serp(rating ~ temp + contact, slope = "penalize",
link = "logit", reverse = TRUE, tuneMethod = "user",
lambda = 1e1 ,data = wine)
coef(f2)## A penalized partial proportional odds model with one variable set to
## global effect is also possible.
f3 <- serp(rating ~ temp + contact, slope = "penalize",
reverse = TRUE, link = "logit", tuneMethod = "user",
lambda = 2e1, globalEff = ~ temp, data = wine)
coef(f3)## The unpenalized proportional odds model with constrained estimates.
## Under estreme shrinkage, estimates in f2 equal those in this model.
f4 <- serp(rating ~ temp + contact, slope = "parallel",
reverse = FALSE, link = "logit", data = wine)
summary(f4)Before installing serp, it is encouraged to have a
recent version of R installed. The
released version of serp can be installed from CRAN with:
install.packages("serp")or the development version from GitHub with:
if (!require("devtools")) install.packages("devtools")
devtools::install_github("ejikeugba/serp")Load serp into R environment with:
library(serp)Pull requests are welcomed! Please submit your contributions to
serp through the list of Pull Requests,
following the contributing
guidelines. To report issues and/or seek support, please file a new
ticket in the issue tracker, and
expect a feedback ASAP!
Please note that serp is released with a Contributor
Code of Conduct. By contributing to this project, you agree to abide
by its terms.
McCullagh, P. (1980). Regression Models for Ordinal Data. Journal of the Royal Statistical Society. Series B (Methodological), 42, 109-142. https://doi.org/10.1111/j.2517-6161.1980.tb01109.x
Randall, J (1989). The analysis of sensory data by generalized linear model. Biometrical Journal, 31, 781–793. https://doi.org/10.1002/bimj.4710310703
Tutz, G. and Gertheiss, J. (2016). Regularized Regression for Categorical Data (With Discussion and Rejoinder). Statistical Modelling, 16, 161-260. https://doi.org/10.1177/1471082X16642560
Ugba, E. R., Mörlein, D. and Gertheiss, J. (2021). Smoothing in Ordinal Regression: An Application to Sensory Data. Stats, 4, 616–633. https://doi.org/10.3390/stats4030037
Ugba, E. R. (2021). serp: An R package for smoothing in ordinal regression Journal of Open Source Software, 6(66), 3705. https://doi.org/10.21105/joss.03705