Questions tagged [reduced-rank-regression]
Multivariate multiple linear regression with a constraint that the coefficient matrix should be of low rank.
17 questions
0 votes
1 answer
120 views
Mediating effects in reduced rank regression
So with reduced rank regression we identify response variables associated with our outcome of interest (Y) and model proc pls relationships between the independent variables say dietary data vs. the ...
3 votes
0 answers
394 views
Low Rank Gaussian Process vs Bayesian Linear Regression
A main benefit of Gaussian Process Regression is, that we not only get a prediction, but also a variance that we might use as indication of the prediction confidence. While bayesian linear regression ...
0 votes
0 answers
147 views
I'd like to do regression using canonical correlation analysis
I got two multidimensional datasets, X and Y. I thought I build the model, which explains the relationship between two datasets, using canonical correlation analysis (CCA). The first correlation ...
2 votes
1 answer
84 views
Is low rank finite-iteration manifold identification possible?
In sparse optimization, I am trying to solve the problem $$ \min_{x\in \mathbb R^{n}} \quad f(x) + \|x\|_1 $$ and at optimality, $x^*$ may be sparse. If I define the sparse manifold as $\mathcal M = ...
2 votes
0 answers
122 views
how to optimize reduced rank regression with constant diagnoal constraint?
I am trying to optimize a panel regression $G=\beta G+e$. $G \in R^{N\times T}$. $\beta\in R^{N\times N}$ is unknown coefficient, constrained to $diag(\beta)=0$, and reduced rank $rank(\beta)\leq r$. ...
0 votes
1 answer
1k views
categorical predictors in partial least squares
I am interested in running a partial least squares analysis using PROC PLS in SAS 9.4. I understand that, by default, the predictors and response variables in PLS are centered to a mean 0 and scaled ...
1 vote
0 answers
78 views
Noisy Observation of Matrix of Certain Rank
Consider a rank k matrix, call it M, of size nxm. All the elements are non-negative. Now do a noisy observation of it and assume independent Poissonian errors (the error on element $M_{ij}$ is ...
6 votes
1 answer
425 views
Is there a way to specify reduced-rank regression using $\mathbf{y} = \mathbf{X}\boldsymbol\beta + \boldsymbol\epsilon$?
In grad school, I was always taught the general linear model $$\mathbf{y} = \mathbf{X}\boldsymbol\beta + \boldsymbol\epsilon\tag{1}$$ where $\mathbf{y}$ is a vector, $\mathbf{X}$ is some matrix, $\...
3 votes
1 answer
577 views
Reduced rank regression with binary outcome variable
I am trying to find dietary patterns related to a disease outcome. Unfortunately, I only have the binary outcome "disease yes/no" as outcome. I tried to perform PCA on the data, but the dietary ...
3 votes
0 answers
2k views
Definition of "meta-parameter" [duplicate]
What is meant by the term "meta-parameter"? Can a definition, informal and/or formal, be provided? For example, in reduced-rank regression, the rank ($r$) can be referred to as a meta-parameter of ...
10 votes
1 answer
861 views
Probabilistic models for partial least squares, reduced rank regression, and canonical correlation analysis?
This question results from the discussion following a previous question: What is the connection between partial least squares, reduced rank regression, and principal component regression? For ...
23 votes
1 answer
6k views
What is the connection between partial least squares, reduced rank regression, and principal component regression?
Are reduced rank regression and principal component regression just special cases of partial least squares? This tutorial (Page 6, "Comparison of Objectives") states that when we do partial least ...
5 votes
1 answer
3k views
Objective function of canonical correlation analysis (CCA)
Given two vectors of random variables $X$ and $Y$, Canonical Correlation Analysis (CCA) finds the transformation matrices $A$ and $B$ so that $\operatorname{corr}(A_{1*} X, B_{1*} Y)$ is first maximal,...
45 votes
2 answers
25k views
What is "reduced-rank regression" all about?
I have been reading The Elements of Statistical Learning and I could not understand what Section 3.7 "Multiple outcome shrinkage and selection" is all about. It talks about RRR (reduced-rank ...
13 votes
1 answer
5k views
Friendly tutorial or introduction to reduced-rank regression
I am trying to learn Reduced-Rank Regression (RRR) from The Elements of Statistical Learning. I find the writing and them mathematics a little too prohibitive. Does any of you have a resource/text/...