Frechet Derivative of a Function Containing an Integral Operator Applied to the Differentiated TermConfused about the linearity of Frechet derivative?Gateaux and Frechet derivatives on $mathbbR^2$.What is the derivative of the following functional?Gateaux derivative of a functional $f:mathbbR^2 to mathbbR$ and why the Frechet derivative of it does not existFrechet derivative of an operatorHow to find out Frechet derivative of the following operator?Is norm of $mathcalC^2(X,mathbbR)$?Finding a functional satisfying a given Frechet derivativeExplaination of the Frechet DerivativeGoing from the differential to the derivative (Frechet and matrix calculus)
Accidentally leaked the solution to an assignment, what to do now? (I'm the prof)
declaring a variable twice in IIFE
What are these boxed doors outside store fronts in New York?
The use of multiple foreign keys on same column in SQL Server
Is the month field really deprecated?
Japan - Plan around max visa duration
Email Account under attack (really) - anything I can do?
How to add power-LED to my small amplifier?
How is it possible to have an ability score that is less than 3?
How do I create uniquely male characters?
How to make payment on the internet without leaving a money trail?
Draw simple lines in Inkscape
Can a German sentence have two subjects?
Is it possible to do 50 km distance without any previous training?
"You are your self first supporter", a more proper way to say it
Why is this code 6.5x slower with optimizations enabled?
Is there a familial term for apples and pears?
whey we use polarized capacitor?
How can bays and straits be determined in a procedurally generated map?
GPS Rollover on Android Smartphones
Can I make popcorn with any corn?
How to report a triplet of septets in NMR tabulation?
How to re-create Edward Weson's Pepper No. 30?
Why don't electromagnetic waves interact with each other?
Frechet Derivative of a Function Containing an Integral Operator Applied to the Differentiated Term
Confused about the linearity of Frechet derivative?Gateaux and Frechet derivatives on $mathbbR^2$.What is the derivative of the following functional?Gateaux derivative of a functional $f:mathbbR^2 to mathbbR$ and why the Frechet derivative of it does not existFrechet derivative of an operatorHow to find out Frechet derivative of the following operator?Is norm of $mathcalC^2(X,mathbbR)$?Finding a functional satisfying a given Frechet derivativeExplaination of the Frechet DerivativeGoing from the differential to the derivative (Frechet and matrix calculus)
$begingroup$
I'm new to Frechet and Gateaux differentiation, this likely has some mistakes. I was hoping someone could check this and offer some guidance.
Suppose we have the following functional:
beginequation
F(theta): thetainTheta rightarrow exp[frac1aint_tin Tint_sin T(x(t)-theta(t))K(t,s)(x(s)-theta(s))]
endequation
Where $Thetasubseteq L_2$, with $L_2$ the Hilbert space of Lebesgue measure $mu$ square integrable functions on $T$, endowed with inner product $<f,g> = int_tin Tf(t)g(t)dt$ and corresponding norm $||circ|| = sqrt<circ,circ>$. $x(t)$ is an arbitrary element of $L_2$, and $T subseteq mathbbR^n$ We assume $K$ is the integral kernel representation of a continuous, linear, symmetric, and positive definite operator, A, such that:
beginequation
int_tin Tint_sin Tphi(t)K(t,s)phi(s) = <phi,Aphi>
endequation
It can be shown that $A$ is differentiable. We have that $A$ is continuous and linear, thus:
beginequation
beginsplit
lim_rightarrow 0frach& = lim_rightarrow 0frach\
& =lim_rightarrow 0frach\
endsplit
endequation
Thus for $D[A](h) = Ah$ we get that the limit is $0$ for all sequences of functions $||h_n|| rightarrow 0$.
Similarly, the inner product $<phi,Aphi>$ is Frechet differentiable for $phi in Theta$. We have that:
beginequation
beginsplit
& lim_rightarrow 0frac<phi,Aphi> + <h,Aphi> + <phi,Ah> + <h,Ah> - <phi,Aphi> - D[<phi,Aphi>](h)h\
& = lim_rightarrow 0frach
endsplit
endequation
So the derivative exists and is:
beginequation
D[<phi,Aphi>](h) = <h,Aphi> + <phi,Ah> + <h,Ah>
endequation
We know the derivative of the exponential function is well defined. So by the chain rule of Frechet differentiability, Theorem 6 here we have that the Frechet derivative exists. From Lemma 2.1 here we have that the Gateaux derivative exists and is equal to the Frechet derivative. We proceed to find the Gateaux derivative.
I noted that our situation fits the example outlined here, for:
beginequation
beginsplit
H(theta(t)) = frac1aint_t in Tint_sin T(x(t)-theta(t))K(t,s)(x(s)-theta(s))
endsplit
endequation
Using the fact that $D[e^x](h) = he^x$, and that the chain rule gives us that $D[fcirc g] = D[f](D[g](h))$ I feel like the solution should be:
beginequation
D[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))](h)exp[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))]
endequation
From the previously cited Wikipedia example:
beginequation
beginsplit
& D[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))](h) \
&= frac1aint_t in Tint_sin T D_theta[(x(t)-theta(t))K(t,s)(x(s)-theta(s))]hdtds(h)
endsplit
endequation
This is where I'm stuck. I wasn't sure how to take the derivative of the integrand of the left factor with respect to $theta$. The primary thing that is confusing me is the $theta(t)theta(s)$ term that comes out when you foil $(x(t)-theta(t))(x(s)-theta(s))$. It contains $theta$, but for different arguments being integrated over, thus I'm not sure how to proceed. I did some manipulations to try and figure out if I could use Leibniz integral rule to get the integration, but wasn't able to find anything, so I decided not to put the calculations in here.
EDIT:
I also should note that I have this Theorem that I was considering using if I could satisfy the assumptions, but similarly was having issues understanding how to use it, and reconcile why it wasn't working out to be equal to the other method of using the Gateaux derivative given in the Wikipedia page.
functional-analysis frechet-derivative gateaux-derivative
asked Mar 29 at 20:32
Ryan WarnickRyan Warnick
1,30668
$endgroup$
add a comment |
$begingroup$
I'm new to Frechet and Gateaux differentiation, this likely has some mistakes. I was hoping someone could check this and offer some guidance.
Suppose we have the following functional:
beginequation
F(theta): thetainTheta rightarrow exp[frac1aint_tin Tint_sin T(x(t)-theta(t))K(t,s)(x(s)-theta(s))]
endequation
Where $Thetasubseteq L_2$, with $L_2$ the Hilbert space of Lebesgue measure $mu$ square integrable functions on $T$, endowed with inner product $<f,g> = int_tin Tf(t)g(t)dt$ and corresponding norm $||circ|| = sqrt<circ,circ>$. $x(t)$ is an arbitrary element of $L_2$, and $T subseteq mathbbR^n$ We assume $K$ is the integral kernel representation of a continuous, linear, symmetric, and positive definite operator, A, such that:
beginequation
int_tin Tint_sin Tphi(t)K(t,s)phi(s) = <phi,Aphi>
endequation
It can be shown that $A$ is differentiable. We have that $A$ is continuous and linear, thus:
beginequation
beginsplit
lim_rightarrow 0frach& = lim_rightarrow 0frach\
& =lim_rightarrow 0frach\
endsplit
endequation
Thus for $D[A](h) = Ah$ we get that the limit is $0$ for all sequences of functions $||h_n|| rightarrow 0$.
Similarly, the inner product $<phi,Aphi>$ is Frechet differentiable for $phi in Theta$. We have that:
beginequation
beginsplit
& lim_rightarrow 0frac<phi,Aphi> + <h,Aphi> + <phi,Ah> + <h,Ah> - <phi,Aphi> - D[<phi,Aphi>](h)h\
& = lim_rightarrow 0frach
endsplit
endequation
So the derivative exists and is:
beginequation
D[<phi,Aphi>](h) = <h,Aphi> + <phi,Ah> + <h,Ah>
endequation
We know the derivative of the exponential function is well defined. So by the chain rule of Frechet differentiability, Theorem 6 here we have that the Frechet derivative exists. From Lemma 2.1 here we have that the Gateaux derivative exists and is equal to the Frechet derivative. We proceed to find the Gateaux derivative.
I noted that our situation fits the example outlined here, for:
beginequation
beginsplit
H(theta(t)) = frac1aint_t in Tint_sin T(x(t)-theta(t))K(t,s)(x(s)-theta(s))
endsplit
endequation
Using the fact that $D[e^x](h) = he^x$, and that the chain rule gives us that $D[fcirc g] = D[f](D[g](h))$ I feel like the solution should be:
beginequation
D[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))](h)exp[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))]
endequation
From the previously cited Wikipedia example:
beginequation
beginsplit
& D[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))](h) \
&= frac1aint_t in Tint_sin T D_theta[(x(t)-theta(t))K(t,s)(x(s)-theta(s))]hdtds(h)
endsplit
endequation
This is where I'm stuck. I wasn't sure how to take the derivative of the integrand of the left factor with respect to $theta$. The primary thing that is confusing me is the $theta(t)theta(s)$ term that comes out when you foil $(x(t)-theta(t))(x(s)-theta(s))$. It contains $theta$, but for different arguments being integrated over, thus I'm not sure how to proceed. I did some manipulations to try and figure out if I could use Leibniz integral rule to get the integration, but wasn't able to find anything, so I decided not to put the calculations in here.
EDIT:
I also should note that I have this Theorem that I was considering using if I could satisfy the assumptions, but similarly was having issues understanding how to use it, and reconcile why it wasn't working out to be equal to the other method of using the Gateaux derivative given in the Wikipedia page.
functional-analysis frechet-derivative gateaux-derivative
asked Mar 29 at 20:32
Ryan WarnickRyan Warnick
1,30668
$endgroup$
add a comment |
$begingroup$
I'm new to Frechet and Gateaux differentiation, this likely has some mistakes. I was hoping someone could check this and offer some guidance.
Suppose we have the following functional:
beginequation
F(theta): thetainTheta rightarrow exp[frac1aint_tin Tint_sin T(x(t)-theta(t))K(t,s)(x(s)-theta(s))]
endequation
Where $Thetasubseteq L_2$, with $L_2$ the Hilbert space of Lebesgue measure $mu$ square integrable functions on $T$, endowed with inner product $<f,g> = int_tin Tf(t)g(t)dt$ and corresponding norm $||circ|| = sqrt<circ,circ>$. $x(t)$ is an arbitrary element of $L_2$, and $T subseteq mathbbR^n$ We assume $K$ is the integral kernel representation of a continuous, linear, symmetric, and positive definite operator, A, such that:
beginequation
int_tin Tint_sin Tphi(t)K(t,s)phi(s) = <phi,Aphi>
endequation
It can be shown that $A$ is differentiable. We have that $A$ is continuous and linear, thus:
beginequation
beginsplit
lim_rightarrow 0frach& = lim_rightarrow 0frach\
& =lim_rightarrow 0frach\
endsplit
endequation
Thus for $D[A](h) = Ah$ we get that the limit is $0$ for all sequences of functions $||h_n|| rightarrow 0$.
Similarly, the inner product $<phi,Aphi>$ is Frechet differentiable for $phi in Theta$. We have that:
beginequation
beginsplit
& lim_rightarrow 0frac<phi,Aphi> + <h,Aphi> + <phi,Ah> + <h,Ah> - <phi,Aphi> - D[<phi,Aphi>](h)h\
& = lim_rightarrow 0frach
endsplit
endequation
So the derivative exists and is:
beginequation
D[<phi,Aphi>](h) = <h,Aphi> + <phi,Ah> + <h,Ah>
endequation
We know the derivative of the exponential function is well defined. So by the chain rule of Frechet differentiability, Theorem 6 here we have that the Frechet derivative exists. From Lemma 2.1 here we have that the Gateaux derivative exists and is equal to the Frechet derivative. We proceed to find the Gateaux derivative.
I noted that our situation fits the example outlined here, for:
beginequation
beginsplit
H(theta(t)) = frac1aint_t in Tint_sin T(x(t)-theta(t))K(t,s)(x(s)-theta(s))
endsplit
endequation
Using the fact that $D[e^x](h) = he^x$, and that the chain rule gives us that $D[fcirc g] = D[f](D[g](h))$ I feel like the solution should be:
beginequation
D[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))](h)exp[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))]
endequation
From the previously cited Wikipedia example:
beginequation
beginsplit
& D[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))](h) \
&= frac1aint_t in Tint_sin T D_theta[(x(t)-theta(t))K(t,s)(x(s)-theta(s))]hdtds(h)
endsplit
endequation
This is where I'm stuck. I wasn't sure how to take the derivative of the integrand of the left factor with respect to $theta$. The primary thing that is confusing me is the $theta(t)theta(s)$ term that comes out when you foil $(x(t)-theta(t))(x(s)-theta(s))$. It contains $theta$, but for different arguments being integrated over, thus I'm not sure how to proceed. I did some manipulations to try and figure out if I could use Leibniz integral rule to get the integration, but wasn't able to find anything, so I decided not to put the calculations in here.
EDIT:
I also should note that I have this Theorem that I was considering using if I could satisfy the assumptions, but similarly was having issues understanding how to use it, and reconcile why it wasn't working out to be equal to the other method of using the Gateaux derivative given in the Wikipedia page.
functional-analysis frechet-derivative gateaux-derivative
asked Mar 29 at 20:32
Ryan WarnickRyan Warnick
1,30668
$endgroup$
I'm new to Frechet and Gateaux differentiation, this likely has some mistakes. I was hoping someone could check this and offer some guidance.
Suppose we have the following functional:
beginequation
F(theta): thetainTheta rightarrow exp[frac1aint_tin Tint_sin T(x(t)-theta(t))K(t,s)(x(s)-theta(s))]
endequation
Where $Thetasubseteq L_2$, with $L_2$ the Hilbert space of Lebesgue measure $mu$ square integrable functions on $T$, endowed with inner product $<f,g> = int_tin Tf(t)g(t)dt$ and corresponding norm $||circ|| = sqrt<circ,circ>$. $x(t)$ is an arbitrary element of $L_2$, and $T subseteq mathbbR^n$ We assume $K$ is the integral kernel representation of a continuous, linear, symmetric, and positive definite operator, A, such that:
beginequation
int_tin Tint_sin Tphi(t)K(t,s)phi(s) = <phi,Aphi>
endequation
It can be shown that $A$ is differentiable. We have that $A$ is continuous and linear, thus:
beginequation
beginsplit
lim_rightarrow 0frach& = lim_rightarrow 0frach\
& =lim_rightarrow 0frach\
endsplit
endequation
Thus for $D[A](h) = Ah$ we get that the limit is $0$ for all sequences of functions $||h_n|| rightarrow 0$.
Similarly, the inner product $<phi,Aphi>$ is Frechet differentiable for $phi in Theta$. We have that:
beginequation
beginsplit
& lim_rightarrow 0frac<phi,Aphi> + <h,Aphi> + <phi,Ah> + <h,Ah> - <phi,Aphi> - D[<phi,Aphi>](h)h\
& = lim_rightarrow 0frach
endsplit
endequation
So the derivative exists and is:
beginequation
D[<phi,Aphi>](h) = <h,Aphi> + <phi,Ah> + <h,Ah>
endequation
We know the derivative of the exponential function is well defined. So by the chain rule of Frechet differentiability, Theorem 6 here we have that the Frechet derivative exists. From Lemma 2.1 here we have that the Gateaux derivative exists and is equal to the Frechet derivative. We proceed to find the Gateaux derivative.
I noted that our situation fits the example outlined here, for:
beginequation
beginsplit
H(theta(t)) = frac1aint_t in Tint_sin T(x(t)-theta(t))K(t,s)(x(s)-theta(s))
endsplit
endequation
Using the fact that $D[e^x](h) = he^x$, and that the chain rule gives us that $D[fcirc g] = D[f](D[g](h))$ I feel like the solution should be:
beginequation
D[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))](h)exp[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))]
endequation
From the previously cited Wikipedia example:
beginequation
beginsplit
& D[frac1aint_t in Tint_sin T (x(t)-theta(t))K(t,s)(x(s)-theta(s))](h) \
&= frac1aint_t in Tint_sin T D_theta[(x(t)-theta(t))K(t,s)(x(s)-theta(s))]hdtds(h)
endsplit
endequation
This is where I'm stuck. I wasn't sure how to take the derivative of the integrand of the left factor with respect to $theta$. The primary thing that is confusing me is the $theta(t)theta(s)$ term that comes out when you foil $(x(t)-theta(t))(x(s)-theta(s))$. It contains $theta$, but for different arguments being integrated over, thus I'm not sure how to proceed. I did some manipulations to try and figure out if I could use Leibniz integral rule to get the integration, but wasn't able to find anything, so I decided not to put the calculations in here.
EDIT:
I also should note that I have this Theorem that I was considering using if I could satisfy the assumptions, but similarly was having issues understanding how to use it, and reconcile why it wasn't working out to be equal to the other method of using the Gateaux derivative given in the Wikipedia page.
functional-analysis frechet-derivative gateaux-derivative
functional-analysis frechet-derivative gateaux-derivative
asked Mar 29 at 20:32
Ryan WarnickRyan Warnick
1,30668
asked Mar 29 at 20:32
Ryan WarnickRyan Warnick
1,30668
edited Mar 29 at 21:59
Ryan Warnick
asked Mar 29 at 20:32
Ryan WarnickRyan Warnick
1,30668
asked Mar 29 at 20:32
Ryan WarnickRyan Warnick
1,30668
asked Mar 29 at 20:32
Ryan WarnickRyan Warnick
1,30668
1,30668
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3167576%2ffrechet-derivative-of-a-function-containing-an-integral-operator-applied-to-the%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3167576%2ffrechet-derivative-of-a-function-containing-an-integral-operator-applied-to-the%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
