Chain rule for matrix-valued functions.The inverse of a perturbed identity matrix.How to compute determinant (or eigenvalues) of this matrix?Showing a set of matrices is a subspaceHow do I compute the determinant of this matrix?Determinant of $N times N$ matrixExponential of a symmetric tridiagonal Toeplitz matrixDeterminant inequality about Toeplitz matrixProper function notation for matrix functions?About Matrix function on Jordan normal formVector valued function derivative with matrix
How to format long polynomial?
Collect Fourier series terms
Why don't electron-positron collisions release infinite energy?
To string or not to string
How to find program name(s) of an installed package?
Are the number of citations and number of published articles the most important criteria for a tenure promotion?
Watching something be written to a file live with tail
What typically incentivizes a professor to change jobs to a lower ranking university?
US citizen flying to France today and my passport expires in less than 2 months
Why not use SQL instead of GraphQL?
What are the differences between the usage of 'it' and 'they'?
What is the word for reserving something for yourself before others do?
What does it mean to describe someone as a butt steak?
How much RAM could one put in a typical 80386 setup?
"to be prejudice towards/against someone" vs "to be prejudiced against/towards someone"
can i play a electric guitar through a bass amp?
Mathematical cryptic clues
What's the point of deactivating Num Lock on login screens?
Is it important to consider tone, melody, and musical form while writing a song?
Replacing matching entries in one column of a file by another column from a different file
Font hinting is lost in Chrome-like browsers (for some languages )
How is it possible to have an ability score that is less than 3?
Which models of the Boeing 737 are still in production?
Adding span tags within wp_list_pages list items
Chain rule for matrix-valued functions.
The inverse of a perturbed identity matrix.How to compute determinant (or eigenvalues) of this matrix?Showing a set of matrices is a subspaceHow do I compute the determinant of this matrix?Determinant of $N times N$ matrixExponential of a symmetric tridiagonal Toeplitz matrixDeterminant inequality about Toeplitz matrixProper function notation for matrix functions?About Matrix function on Jordan normal formVector valued function derivative with matrix
$begingroup$
Suppose we have a function $xmapsto A(x)$ where $A(x)$ is an $ntimes n$ matrix with differentiable matrix elements $[A(x)]_ij=a_ij(x)$. Then it is natural to take
beginalign*
fracdAdx := beginbmatrix
fracd a_11dx & cdots & fracd a_1ndx
\
vdots & ddots & vdots
\
fracda_n1dx & cdots & fracda_nndx
endbmatrix
endalign*
My question is as follows; suppose we have some function $f$ that is sufficiently "nice" (differentiable, etc.). Then, is there a "chain-rule like" expression for
beginalign*
fracddx f(A(x)).
endalign*
For example, is there a general criterion for when we can write
beginalign*
fracddx f(A(x)) = fracd f(A)dAfracdAdx ?
endalign*
This question came to me in a more concrete example. Suppose $A(x)$ is differential, positive definite matrix for all $xinmathbbR$. Is there a known formula for
$dS/dx$ where $S(x) := A^1/2(x)$ is the unique positive definite square root of $A(x)$? One result that follows by differentiating the expression $S^2(x) =A(x)$ is
beginalign*
S(x)fracdSdx + fracdSdxS(x) = fracdAdx
endalign*
which can be viewed as a Sylvester equation for the matrix $dS/dx$. If $S$ and $dS/dx$ commute, then this can be solved as
$$fracdSdx = frac12A^-1/2fracdAdx$$
which is exactly what we would get if we naively applied the chain rule. Does this Sylvester equation have a closed form solution for the general case?
Thanks!
calculus linear-algebra matrix-calculus
$endgroup$
add a comment |
$begingroup$
Suppose we have a function $xmapsto A(x)$ where $A(x)$ is an $ntimes n$ matrix with differentiable matrix elements $[A(x)]_ij=a_ij(x)$. Then it is natural to take
beginalign*
fracdAdx := beginbmatrix
fracd a_11dx & cdots & fracd a_1ndx
\
vdots & ddots & vdots
\
fracda_n1dx & cdots & fracda_nndx
endbmatrix
endalign*
My question is as follows; suppose we have some function $f$ that is sufficiently "nice" (differentiable, etc.). Then, is there a "chain-rule like" expression for
beginalign*
fracddx f(A(x)).
endalign*
For example, is there a general criterion for when we can write
beginalign*
fracddx f(A(x)) = fracd f(A)dAfracdAdx ?
endalign*
This question came to me in a more concrete example. Suppose $A(x)$ is differential, positive definite matrix for all $xinmathbbR$. Is there a known formula for
$dS/dx$ where $S(x) := A^1/2(x)$ is the unique positive definite square root of $A(x)$? One result that follows by differentiating the expression $S^2(x) =A(x)$ is
beginalign*
S(x)fracdSdx + fracdSdxS(x) = fracdAdx
endalign*
which can be viewed as a Sylvester equation for the matrix $dS/dx$. If $S$ and $dS/dx$ commute, then this can be solved as
$$fracdSdx = frac12A^-1/2fracdAdx$$
which is exactly what we would get if we naively applied the chain rule. Does this Sylvester equation have a closed form solution for the general case?
Thanks!
calculus linear-algebra matrix-calculus
$endgroup$
$begingroup$
DId you mean to say if $S$ and $fracdSdx$ commute? becasue they usually do not.
$endgroup$
– Mark Fischler
Mar 29 at 16:24
$begingroup$
Yes, that's what I meant. Fixed the typo, thanks!
$endgroup$
– UglyMousanova19
Mar 29 at 16:36
$begingroup$
The chain rule is quite general, and in its finest form just says $d(fcirc g) = df circ dg$. Of course, there is a fair bit of intepretation that must be done to come up with what that means in your case, which I don't have time to trace down. But rest assured that what you've written can be given a precise meaning where it (or a formula very similar) will be true.
$endgroup$
– Paul Sinclair
Mar 30 at 1:13
add a comment |
$begingroup$
Suppose we have a function $xmapsto A(x)$ where $A(x)$ is an $ntimes n$ matrix with differentiable matrix elements $[A(x)]_ij=a_ij(x)$. Then it is natural to take
beginalign*
fracdAdx := beginbmatrix
fracd a_11dx & cdots & fracd a_1ndx
\
vdots & ddots & vdots
\
fracda_n1dx & cdots & fracda_nndx
endbmatrix
endalign*
My question is as follows; suppose we have some function $f$ that is sufficiently "nice" (differentiable, etc.). Then, is there a "chain-rule like" expression for
beginalign*
fracddx f(A(x)).
endalign*
For example, is there a general criterion for when we can write
beginalign*
fracddx f(A(x)) = fracd f(A)dAfracdAdx ?
endalign*
This question came to me in a more concrete example. Suppose $A(x)$ is differential, positive definite matrix for all $xinmathbbR$. Is there a known formula for
$dS/dx$ where $S(x) := A^1/2(x)$ is the unique positive definite square root of $A(x)$? One result that follows by differentiating the expression $S^2(x) =A(x)$ is
beginalign*
S(x)fracdSdx + fracdSdxS(x) = fracdAdx
endalign*
which can be viewed as a Sylvester equation for the matrix $dS/dx$. If $S$ and $dS/dx$ commute, then this can be solved as
$$fracdSdx = frac12A^-1/2fracdAdx$$
which is exactly what we would get if we naively applied the chain rule. Does this Sylvester equation have a closed form solution for the general case?
Thanks!
calculus linear-algebra matrix-calculus
$endgroup$
Suppose we have a function $xmapsto A(x)$ where $A(x)$ is an $ntimes n$ matrix with differentiable matrix elements $[A(x)]_ij=a_ij(x)$. Then it is natural to take
beginalign*
fracdAdx := beginbmatrix
fracd a_11dx & cdots & fracd a_1ndx
\
vdots & ddots & vdots
\
fracda_n1dx & cdots & fracda_nndx
endbmatrix
endalign*
My question is as follows; suppose we have some function $f$ that is sufficiently "nice" (differentiable, etc.). Then, is there a "chain-rule like" expression for
beginalign*
fracddx f(A(x)).
endalign*
For example, is there a general criterion for when we can write
beginalign*
fracddx f(A(x)) = fracd f(A)dAfracdAdx ?
endalign*
This question came to me in a more concrete example. Suppose $A(x)$ is differential, positive definite matrix for all $xinmathbbR$. Is there a known formula for
$dS/dx$ where $S(x) := A^1/2(x)$ is the unique positive definite square root of $A(x)$? One result that follows by differentiating the expression $S^2(x) =A(x)$ is
beginalign*
S(x)fracdSdx + fracdSdxS(x) = fracdAdx
endalign*
which can be viewed as a Sylvester equation for the matrix $dS/dx$. If $S$ and $dS/dx$ commute, then this can be solved as
$$fracdSdx = frac12A^-1/2fracdAdx$$
which is exactly what we would get if we naively applied the chain rule. Does this Sylvester equation have a closed form solution for the general case?
Thanks!
calculus linear-algebra matrix-calculus
calculus linear-algebra matrix-calculus
edited Mar 29 at 16:37
UglyMousanova19
asked Mar 29 at 15:30
UglyMousanova19UglyMousanova19
464
464
$begingroup$
DId you mean to say if $S$ and $fracdSdx$ commute? becasue they usually do not.
$endgroup$
– Mark Fischler
Mar 29 at 16:24
$begingroup$
Yes, that's what I meant. Fixed the typo, thanks!
$endgroup$
– UglyMousanova19
Mar 29 at 16:36
$begingroup$
The chain rule is quite general, and in its finest form just says $d(fcirc g) = df circ dg$. Of course, there is a fair bit of intepretation that must be done to come up with what that means in your case, which I don't have time to trace down. But rest assured that what you've written can be given a precise meaning where it (or a formula very similar) will be true.
$endgroup$
– Paul Sinclair
Mar 30 at 1:13
add a comment |
$begingroup$
DId you mean to say if $S$ and $fracdSdx$ commute? becasue they usually do not.
$endgroup$
– Mark Fischler
Mar 29 at 16:24
$begingroup$
Yes, that's what I meant. Fixed the typo, thanks!
$endgroup$
– UglyMousanova19
Mar 29 at 16:36
$begingroup$
The chain rule is quite general, and in its finest form just says $d(fcirc g) = df circ dg$. Of course, there is a fair bit of intepretation that must be done to come up with what that means in your case, which I don't have time to trace down. But rest assured that what you've written can be given a precise meaning where it (or a formula very similar) will be true.
$endgroup$
– Paul Sinclair
Mar 30 at 1:13
$begingroup$
DId you mean to say if $S$ and $fracdSdx$ commute? becasue they usually do not.
$endgroup$
– Mark Fischler
Mar 29 at 16:24
$begingroup$
DId you mean to say if $S$ and $fracdSdx$ commute? becasue they usually do not.
$endgroup$
– Mark Fischler
Mar 29 at 16:24
$begingroup$
Yes, that's what I meant. Fixed the typo, thanks!
$endgroup$
– UglyMousanova19
Mar 29 at 16:36
$begingroup$
Yes, that's what I meant. Fixed the typo, thanks!
$endgroup$
– UglyMousanova19
Mar 29 at 16:36
$begingroup$
The chain rule is quite general, and in its finest form just says $d(fcirc g) = df circ dg$. Of course, there is a fair bit of intepretation that must be done to come up with what that means in your case, which I don't have time to trace down. But rest assured that what you've written can be given a precise meaning where it (or a formula very similar) will be true.
$endgroup$
– Paul Sinclair
Mar 30 at 1:13
$begingroup$
The chain rule is quite general, and in its finest form just says $d(fcirc g) = df circ dg$. Of course, there is a fair bit of intepretation that must be done to come up with what that means in your case, which I don't have time to trace down. But rest assured that what you've written can be given a precise meaning where it (or a formula very similar) will be true.
$endgroup$
– Paul Sinclair
Mar 30 at 1:13
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3167258%2fchain-rule-for-matrix-valued-functions%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3167258%2fchain-rule-for-matrix-valued-functions%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
DId you mean to say if $S$ and $fracdSdx$ commute? becasue they usually do not.
$endgroup$
– Mark Fischler
Mar 29 at 16:24
$begingroup$
Yes, that's what I meant. Fixed the typo, thanks!
$endgroup$
– UglyMousanova19
Mar 29 at 16:36
$begingroup$
The chain rule is quite general, and in its finest form just says $d(fcirc g) = df circ dg$. Of course, there is a fair bit of intepretation that must be done to come up with what that means in your case, which I don't have time to trace down. But rest assured that what you've written can be given a precise meaning where it (or a formula very similar) will be true.
$endgroup$
– Paul Sinclair
Mar 30 at 1:13