Hitting time on linear Markov chain The Next CEO of Stack OverflowProjected Markov chain evaluated at hitting times again Markov chain?Random Walk, Markov ProcessRandom walk on vertices of a cubeEscape probabilities in a random walk.Relating the stationary distribution of an ergodic Markov chain to its mean return timeReversible Markov Chain on graphBiased random walk in 1D - expected hitting time for either edge of boxHitting times in random walksHitting time of 2D markov chainReference for hitting time of lazy random walk on $mathbbZ$.

How do I fit a non linear curve?

Small nick on power cord from an electric alarm clock, and copper wiring exposed but intact

Film where the government was corrupt with aliens, people sent to kill aliens are given rigged visors not showing the right aliens

Strange use of "whether ... than ..." in official text

Defamation due to breach of confidentiality

Aggressive Under-Indexing and no data for missing index

Is there a way to save my career from absolute disaster?

What difference does it make using sed with/without whitespaces?

Why don't programming languages automatically manage the synchronous/asynchronous problem?

Does Germany produce more waste than the US?

Help understanding this unsettling image of Titan, Epimetheus, and Saturn's rings?

How to get the last not-null value in an ordered column of a huge table?

Is there such a thing as a proper verb, like a proper noun?

Yu-Gi-Oh cards in Python 3

Does the Idaho Potato Commission associate potato skins with healthy eating?

Can you teleport closer to a creature you are Frightened of?

Calculate the Mean mean of two numbers

Is there an equivalent of cd - for cp or mv

Reshaping json / reparing json inside shell script (remove trailing comma)

What flight has the highest ratio of timezone difference to flight time?

Does destroying a Lich's phylactery destroy the soul within it?

What happened in Rome, when the western empire "fell"?

What is the difference between "hamstring tendon" and "common hamstring tendon"?

Man transported from Alternate World into ours by a Neutrino Detector



Hitting time on linear Markov chain



The Next CEO of Stack OverflowProjected Markov chain evaluated at hitting times again Markov chain?Random Walk, Markov ProcessRandom walk on vertices of a cubeEscape probabilities in a random walk.Relating the stationary distribution of an ergodic Markov chain to its mean return timeReversible Markov Chain on graphBiased random walk in 1D - expected hitting time for either edge of boxHitting times in random walksHitting time of 2D markov chainReference for hitting time of lazy random walk on $mathbbZ$.










0












$begingroup$


I came across this problem in a math course of mine a while back, and I haven't been able to solve it since. Anyone have any ideas?




Suppose we have a chain of $n$ vertices, such that the first vertex has an edge to the second, the $i$th vertex has an edge to the $(i-1)$th and $(i+1)$th vertices, and the $n$th vertex has an edge to only the $(n-1)$th vertex. If we perform a random walk on the graph, starting at the second vertex, what is $E(h)$, if $h$ is the number of steps it takes to reach the first vertex?




I wrote a program that performs ~100,000 random walks to find a reasonable answer, and from that, I was able to determine that it takes $O(n)$ time, but I have not been able to find any insight into the combinatorial nature of the problem that gives us this result.



How do I prove this result rigorously?



Furthermore, what is the expected hitting time $E(h_i)$ when performing a random walk starting at vertex $i$?



Note: Another result that I know from the textbook is that $E(h_n) = n^2$, but again, I have not yet been able to come up with a proof of this.










share|cite|improve this question









$endgroup$
















    0












    $begingroup$


    I came across this problem in a math course of mine a while back, and I haven't been able to solve it since. Anyone have any ideas?




    Suppose we have a chain of $n$ vertices, such that the first vertex has an edge to the second, the $i$th vertex has an edge to the $(i-1)$th and $(i+1)$th vertices, and the $n$th vertex has an edge to only the $(n-1)$th vertex. If we perform a random walk on the graph, starting at the second vertex, what is $E(h)$, if $h$ is the number of steps it takes to reach the first vertex?




    I wrote a program that performs ~100,000 random walks to find a reasonable answer, and from that, I was able to determine that it takes $O(n)$ time, but I have not been able to find any insight into the combinatorial nature of the problem that gives us this result.



    How do I prove this result rigorously?



    Furthermore, what is the expected hitting time $E(h_i)$ when performing a random walk starting at vertex $i$?



    Note: Another result that I know from the textbook is that $E(h_n) = n^2$, but again, I have not yet been able to come up with a proof of this.










    share|cite|improve this question









    $endgroup$














      0












      0








      0





      $begingroup$


      I came across this problem in a math course of mine a while back, and I haven't been able to solve it since. Anyone have any ideas?




      Suppose we have a chain of $n$ vertices, such that the first vertex has an edge to the second, the $i$th vertex has an edge to the $(i-1)$th and $(i+1)$th vertices, and the $n$th vertex has an edge to only the $(n-1)$th vertex. If we perform a random walk on the graph, starting at the second vertex, what is $E(h)$, if $h$ is the number of steps it takes to reach the first vertex?




      I wrote a program that performs ~100,000 random walks to find a reasonable answer, and from that, I was able to determine that it takes $O(n)$ time, but I have not been able to find any insight into the combinatorial nature of the problem that gives us this result.



      How do I prove this result rigorously?



      Furthermore, what is the expected hitting time $E(h_i)$ when performing a random walk starting at vertex $i$?



      Note: Another result that I know from the textbook is that $E(h_n) = n^2$, but again, I have not yet been able to come up with a proof of this.










      share|cite|improve this question









      $endgroup$




      I came across this problem in a math course of mine a while back, and I haven't been able to solve it since. Anyone have any ideas?




      Suppose we have a chain of $n$ vertices, such that the first vertex has an edge to the second, the $i$th vertex has an edge to the $(i-1)$th and $(i+1)$th vertices, and the $n$th vertex has an edge to only the $(n-1)$th vertex. If we perform a random walk on the graph, starting at the second vertex, what is $E(h)$, if $h$ is the number of steps it takes to reach the first vertex?




      I wrote a program that performs ~100,000 random walks to find a reasonable answer, and from that, I was able to determine that it takes $O(n)$ time, but I have not been able to find any insight into the combinatorial nature of the problem that gives us this result.



      How do I prove this result rigorously?



      Furthermore, what is the expected hitting time $E(h_i)$ when performing a random walk starting at vertex $i$?



      Note: Another result that I know from the textbook is that $E(h_n) = n^2$, but again, I have not yet been able to come up with a proof of this.







      markov-chains random-walk






      share|cite|improve this question













      share|cite|improve this question











      share|cite|improve this question




      share|cite|improve this question










      asked Mar 28 at 1:57









      inavdainavda

      1198




      1198




















          0






          active

          oldest

          votes












          Your Answer





          StackExchange.ifUsing("editor", function ()
          return StackExchange.using("mathjaxEditing", function ()
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          );
          );
          , "mathjax-editing");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "69"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          noCode: true, onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3165380%2fhitting-time-on-linear-markov-chain%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Mathematics Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3165380%2fhitting-time-on-linear-markov-chain%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Triangular numbers and gcdProving sum of a set is $0 pmod n$ if $n$ is odd, or $fracn2 pmod n$ if $n$ is even?Is greatest common divisor of two numbers really their smallest linear combination?GCD, LCM RelationshipProve a set of nonnegative integers with greatest common divisor 1 and closed under addition has all but finite many nonnegative integers.all pairs of a and b in an equation containing gcdTriangular Numbers Modulo $k$ - Hit All Values?Understanding the Existence and Uniqueness of the GCDGCD and LCM with logical symbolsThe greatest common divisor of two positive integers less than 100 is equal to 3. Their least common multiple is twelve times one of the integers.Suppose that for all integers $x$, $x|a$ and $x|b$ if and only if $x|c$. Then $c = gcd(a,b)$Which is the gcd of 2 numbers which are multiplied and the result is 600000?

          Ingelân Ynhâld Etymology | Geografy | Skiednis | Polityk en bestjoer | Ekonomy | Demografy | Kultuer | Klimaat | Sjoch ek | Keppelings om utens | Boarnen, noaten en referinsjes Navigaasjemenuwww.gov.ukOffisjele webside fan it regear fan it Feriene KeninkrykOffisjele webside fan it Britske FerkearsburoNederlânsktalige ynformaasje fan it Britske FerkearsburoOffisjele webside fan English Heritage, de organisaasje dy't him ynset foar it behâld fan it Ingelske kultuergoedYnwennertallen fan alle Britske stêden út 'e folkstelling fan 2011Notes en References, op dizze sideEngland

          Հադիս Բովանդակություն Անվանում և նշանակություն | Դասակարգում | Աղբյուրներ | Նավարկման ցանկ