Filtration in Markov Chains and stopping times The Next CEO of Stack OverflowStopping times of Markov chainsMarkov chains and natural filtrationTime homogeneous Markov chain with random timesA question about the “stopping time with respect to a set” of a Markov chainContinuous time Markov Chain's Natural FiltrationGiven a list L of N elements uniformly sampled from a set A, what is the probability that L contains every element of A?Interchanging limit and expectation for irreducible Markov chainsIrreducible Markov Chain has finite stopping-time to a finite setDetermining whether the following are Markov ChainsStrong Markov property and time-homogeneity
Do I need to enable Dev Hub in my PROD Org?
Several mode to write the symbol of a vector
How did the Bene Gesserit know how to make a Kwisatz Haderach?
Written every which way
How powerful is the invisibility granted by the Gloom Stalker ranger's Umbral Sight feature?
Sending manuscript to multiple publishers
How do we know the LHC results are robust?
Preparing Indesign booklet with .psd graphics for print
Should I tutor a student who I know has cheated on their homework?
Are there any limitations on attacking while grappling?
Would a galaxy be visible from outside, but nearby?
How do I avoid eval and parse?
Why don't programming languages automatically manage the synchronous/asynchronous problem?
Why does standard notation not preserve intervals (visually)
Is there an analogue of projective spaces for proper schemes?
sp_blitzCache results Memory grants
Can I run my washing machine drain line into a condensate pump so it drains better?
Multiple labels for a single equation
Why am I allowed to create multiple unique pointers from a single object?
Won the lottery - how do I keep the money?
Would this house-rule that treats advantage as a +1 to the roll instead (and disadvantage as -1) and allows them to stack be balanced?
Indicator light circuit
How do I make a variable always equal to the result of some calculations?
Received an invoice from my ex-employer billing me for training; how to handle?
Filtration in Markov Chains and stopping times
The Next CEO of Stack OverflowStopping times of Markov chainsMarkov chains and natural filtrationTime homogeneous Markov chain with random timesA question about the “stopping time with respect to a set” of a Markov chainContinuous time Markov Chain's Natural FiltrationGiven a list L of N elements uniformly sampled from a set A, what is the probability that L contains every element of A?Interchanging limit and expectation for irreducible Markov chainsIrreducible Markov Chain has finite stopping-time to a finite setDetermining whether the following are Markov ChainsStrong Markov property and time-homogeneity
$begingroup$
I am trying to get a better understand of filtrations, and I can't seem to find any simple, concrete examples, so I will try to make one here.
Consider a discrete-time Markov chain with states $A,B$ that we run for 3 time steps. Is the following a correct representation of the corresponding filtration?
$$mathcalF_0 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_1 = emptyset, AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_2 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_3 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,
AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
If this is correct, what are some "stopping times" in this example? Suppose $tau_A$ is the first time at which the chain is in state $A$. Then for $tau_A$ to be a stopping time we must have $tau_A=t in mathcalF_t$ for $t=0,1,2,3$? What is the event $tau_A=t$ in the above filtration?
probability markov-chains filtrations
$endgroup$
add a comment |
$begingroup$
I am trying to get a better understand of filtrations, and I can't seem to find any simple, concrete examples, so I will try to make one here.
Consider a discrete-time Markov chain with states $A,B$ that we run for 3 time steps. Is the following a correct representation of the corresponding filtration?
$$mathcalF_0 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_1 = emptyset, AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_2 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_3 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,
AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
If this is correct, what are some "stopping times" in this example? Suppose $tau_A$ is the first time at which the chain is in state $A$. Then for $tau_A$ to be a stopping time we must have $tau_A=t in mathcalF_t$ for $t=0,1,2,3$? What is the event $tau_A=t$ in the above filtration?
probability markov-chains filtrations
$endgroup$
add a comment |
$begingroup$
I am trying to get a better understand of filtrations, and I can't seem to find any simple, concrete examples, so I will try to make one here.
Consider a discrete-time Markov chain with states $A,B$ that we run for 3 time steps. Is the following a correct representation of the corresponding filtration?
$$mathcalF_0 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_1 = emptyset, AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_2 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_3 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,
AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
If this is correct, what are some "stopping times" in this example? Suppose $tau_A$ is the first time at which the chain is in state $A$. Then for $tau_A$ to be a stopping time we must have $tau_A=t in mathcalF_t$ for $t=0,1,2,3$? What is the event $tau_A=t$ in the above filtration?
probability markov-chains filtrations
$endgroup$
I am trying to get a better understand of filtrations, and I can't seem to find any simple, concrete examples, so I will try to make one here.
Consider a discrete-time Markov chain with states $A,B$ that we run for 3 time steps. Is the following a correct representation of the corresponding filtration?
$$mathcalF_0 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_1 = emptyset, AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_2 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_3 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,
AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
If this is correct, what are some "stopping times" in this example? Suppose $tau_A$ is the first time at which the chain is in state $A$. Then for $tau_A$ to be a stopping time we must have $tau_A=t in mathcalF_t$ for $t=0,1,2,3$? What is the event $tau_A=t$ in the above filtration?
probability markov-chains filtrations
probability markov-chains filtrations
asked 2 days ago
theQmantheQman
45038
45038
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3164679%2ffiltration-in-markov-chains-and-stopping-times%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
$endgroup$
add a comment |
$begingroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
$endgroup$
add a comment |
$begingroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
$endgroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
answered 2 days ago
NChNCh
6,9453825
6,9453825
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3164679%2ffiltration-in-markov-chains-and-stopping-times%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown