Hitting time on linear Markov chain The Next CEO of Stack OverflowProjected Markov chain evaluated at hitting times again Markov chain?Random Walk, Markov ProcessRandom walk on vertices of a cubeEscape probabilities in a random walk.Relating the stationary distribution of an ergodic Markov chain to its mean return timeReversible Markov Chain on graphBiased random walk in 1D - expected hitting time for either edge of boxHitting times in random walksHitting time of 2D markov chainReference for hitting time of lazy random walk on $mathbbZ$.
How do I fit a non linear curve?
Small nick on power cord from an electric alarm clock, and copper wiring exposed but intact
Film where the government was corrupt with aliens, people sent to kill aliens are given rigged visors not showing the right aliens
Strange use of "whether ... than ..." in official text
Defamation due to breach of confidentiality
Aggressive Under-Indexing and no data for missing index
Is there a way to save my career from absolute disaster?
What difference does it make using sed with/without whitespaces?
Why don't programming languages automatically manage the synchronous/asynchronous problem?
Does Germany produce more waste than the US?
Help understanding this unsettling image of Titan, Epimetheus, and Saturn's rings?
How to get the last not-null value in an ordered column of a huge table?
Is there such a thing as a proper verb, like a proper noun?
Yu-Gi-Oh cards in Python 3
Does the Idaho Potato Commission associate potato skins with healthy eating?
Can you teleport closer to a creature you are Frightened of?
Calculate the Mean mean of two numbers
Is there an equivalent of cd - for cp or mv
Reshaping json / reparing json inside shell script (remove trailing comma)
What flight has the highest ratio of timezone difference to flight time?
Does destroying a Lich's phylactery destroy the soul within it?
What happened in Rome, when the western empire "fell"?
What is the difference between "hamstring tendon" and "common hamstring tendon"?
Man transported from Alternate World into ours by a Neutrino Detector
Hitting time on linear Markov chain
The Next CEO of Stack OverflowProjected Markov chain evaluated at hitting times again Markov chain?Random Walk, Markov ProcessRandom walk on vertices of a cubeEscape probabilities in a random walk.Relating the stationary distribution of an ergodic Markov chain to its mean return timeReversible Markov Chain on graphBiased random walk in 1D - expected hitting time for either edge of boxHitting times in random walksHitting time of 2D markov chainReference for hitting time of lazy random walk on $mathbbZ$.
$begingroup$
I came across this problem in a math course of mine a while back, and I haven't been able to solve it since. Anyone have any ideas?
Suppose we have a chain of $n$ vertices, such that the first vertex has an edge to the second, the $i$th vertex has an edge to the $(i-1)$th and $(i+1)$th vertices, and the $n$th vertex has an edge to only the $(n-1)$th vertex. If we perform a random walk on the graph, starting at the second vertex, what is $E(h)$, if $h$ is the number of steps it takes to reach the first vertex?
I wrote a program that performs ~100,000 random walks to find a reasonable answer, and from that, I was able to determine that it takes $O(n)$ time, but I have not been able to find any insight into the combinatorial nature of the problem that gives us this result.
How do I prove this result rigorously?
Furthermore, what is the expected hitting time $E(h_i)$ when performing a random walk starting at vertex $i$?
Note: Another result that I know from the textbook is that $E(h_n) = n^2$, but again, I have not yet been able to come up with a proof of this.
markov-chains random-walk
$endgroup$
add a comment |
$begingroup$
I came across this problem in a math course of mine a while back, and I haven't been able to solve it since. Anyone have any ideas?
Suppose we have a chain of $n$ vertices, such that the first vertex has an edge to the second, the $i$th vertex has an edge to the $(i-1)$th and $(i+1)$th vertices, and the $n$th vertex has an edge to only the $(n-1)$th vertex. If we perform a random walk on the graph, starting at the second vertex, what is $E(h)$, if $h$ is the number of steps it takes to reach the first vertex?
I wrote a program that performs ~100,000 random walks to find a reasonable answer, and from that, I was able to determine that it takes $O(n)$ time, but I have not been able to find any insight into the combinatorial nature of the problem that gives us this result.
How do I prove this result rigorously?
Furthermore, what is the expected hitting time $E(h_i)$ when performing a random walk starting at vertex $i$?
Note: Another result that I know from the textbook is that $E(h_n) = n^2$, but again, I have not yet been able to come up with a proof of this.
markov-chains random-walk
$endgroup$
add a comment |
$begingroup$
I came across this problem in a math course of mine a while back, and I haven't been able to solve it since. Anyone have any ideas?
Suppose we have a chain of $n$ vertices, such that the first vertex has an edge to the second, the $i$th vertex has an edge to the $(i-1)$th and $(i+1)$th vertices, and the $n$th vertex has an edge to only the $(n-1)$th vertex. If we perform a random walk on the graph, starting at the second vertex, what is $E(h)$, if $h$ is the number of steps it takes to reach the first vertex?
I wrote a program that performs ~100,000 random walks to find a reasonable answer, and from that, I was able to determine that it takes $O(n)$ time, but I have not been able to find any insight into the combinatorial nature of the problem that gives us this result.
How do I prove this result rigorously?
Furthermore, what is the expected hitting time $E(h_i)$ when performing a random walk starting at vertex $i$?
Note: Another result that I know from the textbook is that $E(h_n) = n^2$, but again, I have not yet been able to come up with a proof of this.
markov-chains random-walk
$endgroup$
I came across this problem in a math course of mine a while back, and I haven't been able to solve it since. Anyone have any ideas?
Suppose we have a chain of $n$ vertices, such that the first vertex has an edge to the second, the $i$th vertex has an edge to the $(i-1)$th and $(i+1)$th vertices, and the $n$th vertex has an edge to only the $(n-1)$th vertex. If we perform a random walk on the graph, starting at the second vertex, what is $E(h)$, if $h$ is the number of steps it takes to reach the first vertex?
I wrote a program that performs ~100,000 random walks to find a reasonable answer, and from that, I was able to determine that it takes $O(n)$ time, but I have not been able to find any insight into the combinatorial nature of the problem that gives us this result.
How do I prove this result rigorously?
Furthermore, what is the expected hitting time $E(h_i)$ when performing a random walk starting at vertex $i$?
Note: Another result that I know from the textbook is that $E(h_n) = n^2$, but again, I have not yet been able to come up with a proof of this.
markov-chains random-walk
markov-chains random-walk
asked Mar 28 at 1:57
inavdainavda
1198
1198
add a comment |
add a comment |
0
active
oldest
votes
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3165380%2fhitting-time-on-linear-markov-chain%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3165380%2fhitting-time-on-linear-markov-chain%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown