Samples from high dimensional distribution by exploiting the symmetryCDF of $max(x_1,x_2)+max(x_3,x_4)$ where all $x_i$s are iid from $U[a,b]$Bayesian Network/ Number of parametersExponential random variable with Minimum and Maximum ProbabilitySampling with no duplicatesPDF/CDF of max-min type random variableFinding the joint distribution of the given sample.Computing with initial distribution and transition matrix of a finite Markov chainMinimum standard deviation of the sum over partitions of a set when the partitions can be changedWriting the distribution of this random vector (Markov random field).Distribution of $min(X_1+X_2+X_3,X_2+X_3+X_4,X_3+X_4+X_5,X_4+X_5+X_6)$
Why did the Germans forbid the possession of pet pigeons in Rostov-on-Don in 1941?
Why doesn't Newton's third law mean a person bounces back to where they started when they hit the ground?
Risk of getting Chronic Wasting Disease (CWD) in the United States?
Is it tax fraud for an individual to declare non-taxable revenue as taxable income? (US tax laws)
Writing rule stating superpower from different root cause is bad writing
Is it possible to do 50 km distance without any previous training?
Minkowski space
Today is the Center
Why can't I see bouncing of a switch on an oscilloscope?
Why are electrically insulating heatsinks so rare? Is it just cost?
How do we improve the relationship with a client software team that performs poorly and is becoming less collaborative?
Approximately how much travel time was saved by the opening of the Suez Canal in 1869?
How do I create uniquely male characters?
How is the claim "I am in New York only if I am in America" the same as "If I am in New York, then I am in America?
Why do I get two different answers for this counting problem?
Why not use SQL instead of GraphQL?
"You are your self first supporter", a more proper way to say it
What are the differences between the usage of 'it' and 'they'?
How can I make my BBEG immortal short of making them a Lich or Vampire?
Why doesn't H₄O²⁺ exist?
Can divisibility rules for digits be generalized to sum of digits
Can I ask the recruiters in my resume to put the reason why I am rejected?
What is the offset in a seaplane's hull?
Maximum likelihood parameters deviate from posterior distributions
Samples from high dimensional distribution by exploiting the symmetry
CDF of $max(x_1,x_2)+max(x_3,x_4)$ where all $x_i$s are iid from $U[a,b]$Bayesian Network/ Number of parametersExponential random variable with Minimum and Maximum ProbabilitySampling with no duplicatesPDF/CDF of max-min type random variableFinding the joint distribution of the given sample.Computing with initial distribution and transition matrix of a finite Markov chainMinimum standard deviation of the sum over partitions of a set when the partitions can be changedWriting the distribution of this random vector (Markov random field).Distribution of $min(X_1+X_2+X_3,X_2+X_3+X_4,X_3+X_4+X_5,X_4+X_5+X_6)$
$begingroup$
I have a discrete 7-element random vector $vecX$ with probability mass function $P_vecX(colorbluex_1,x_2,x_3,x_4,x_5,x_6,colorredx_7)$ that has a symmetry in its certain components.
The symmetry is such that: the first three components (the blue one) exhibits symmetry among themselves (black ones); the next three have symmetry in themselves too, and last one (red) is alone. (For further information about $P_vecX$: $vecX$ is a finite mixture of 8 components in seven dimensions. The seven variables in each of the eight components; are conditionally independent.)
Mathematically the symmetries are:
$$beginalign
P_vecX(colorbluex_1,x_2,x_3,x_4,x_5,x_6,colorredx_7)&=P_vecX(colorbluex_2,x_1,x_3,x_4,x_5,x_6,colorredx_7) \ &= P_vecX(colorbluex_3,x_2,x_1,x_5,x_6,x_4,colorredx_7) \ & vdots \ & vdots \ & vdots \ &= P_vecX(colorbluex_3,x_2,x_1,x_6,x_5,x_4,colorredx_7).
endalign$$
Now lets come to the problem:
By exploiting the symmetry in my pmf, I need to take samples from $P_vecX(x_1, cdots x_7)$. Does there exist a way that is computationally efficient (linear w.r.t no. of symmetries instead of exponential w.r.t no. of variables) over applying a naive sampling method that do not exploit inherent symmetry ? My actual problem is very high dimensional for instance $2^100$, so I desperately need to exploit the symmetry.
My attempt:
1) I took independent samples from each component and respect the mixing proportions by taking the proportional no. of samples from that component. However, still, the no. of variables (which are seven) are not decreasing.
2) Using MetroPolis Hastings algo is taking too much time? Perhaps,I am not aware of what should be the better proposal distribution.
Any leads would be highly appreciated.
statistics probability-distributions markov-chains sampling monte-carlo
$endgroup$
add a comment |
$begingroup$
I have a discrete 7-element random vector $vecX$ with probability mass function $P_vecX(colorbluex_1,x_2,x_3,x_4,x_5,x_6,colorredx_7)$ that has a symmetry in its certain components.
The symmetry is such that: the first three components (the blue one) exhibits symmetry among themselves (black ones); the next three have symmetry in themselves too, and last one (red) is alone. (For further information about $P_vecX$: $vecX$ is a finite mixture of 8 components in seven dimensions. The seven variables in each of the eight components; are conditionally independent.)
Mathematically the symmetries are:
$$beginalign
P_vecX(colorbluex_1,x_2,x_3,x_4,x_5,x_6,colorredx_7)&=P_vecX(colorbluex_2,x_1,x_3,x_4,x_5,x_6,colorredx_7) \ &= P_vecX(colorbluex_3,x_2,x_1,x_5,x_6,x_4,colorredx_7) \ & vdots \ & vdots \ & vdots \ &= P_vecX(colorbluex_3,x_2,x_1,x_6,x_5,x_4,colorredx_7).
endalign$$
Now lets come to the problem:
By exploiting the symmetry in my pmf, I need to take samples from $P_vecX(x_1, cdots x_7)$. Does there exist a way that is computationally efficient (linear w.r.t no. of symmetries instead of exponential w.r.t no. of variables) over applying a naive sampling method that do not exploit inherent symmetry ? My actual problem is very high dimensional for instance $2^100$, so I desperately need to exploit the symmetry.
My attempt:
1) I took independent samples from each component and respect the mixing proportions by taking the proportional no. of samples from that component. However, still, the no. of variables (which are seven) are not decreasing.
2) Using MetroPolis Hastings algo is taking too much time? Perhaps,I am not aware of what should be the better proposal distribution.
Any leads would be highly appreciated.
statistics probability-distributions markov-chains sampling monte-carlo
$endgroup$
add a comment |
$begingroup$
I have a discrete 7-element random vector $vecX$ with probability mass function $P_vecX(colorbluex_1,x_2,x_3,x_4,x_5,x_6,colorredx_7)$ that has a symmetry in its certain components.
The symmetry is such that: the first three components (the blue one) exhibits symmetry among themselves (black ones); the next three have symmetry in themselves too, and last one (red) is alone. (For further information about $P_vecX$: $vecX$ is a finite mixture of 8 components in seven dimensions. The seven variables in each of the eight components; are conditionally independent.)
Mathematically the symmetries are:
$$beginalign
P_vecX(colorbluex_1,x_2,x_3,x_4,x_5,x_6,colorredx_7)&=P_vecX(colorbluex_2,x_1,x_3,x_4,x_5,x_6,colorredx_7) \ &= P_vecX(colorbluex_3,x_2,x_1,x_5,x_6,x_4,colorredx_7) \ & vdots \ & vdots \ & vdots \ &= P_vecX(colorbluex_3,x_2,x_1,x_6,x_5,x_4,colorredx_7).
endalign$$
Now lets come to the problem:
By exploiting the symmetry in my pmf, I need to take samples from $P_vecX(x_1, cdots x_7)$. Does there exist a way that is computationally efficient (linear w.r.t no. of symmetries instead of exponential w.r.t no. of variables) over applying a naive sampling method that do not exploit inherent symmetry ? My actual problem is very high dimensional for instance $2^100$, so I desperately need to exploit the symmetry.
My attempt:
1) I took independent samples from each component and respect the mixing proportions by taking the proportional no. of samples from that component. However, still, the no. of variables (which are seven) are not decreasing.
2) Using MetroPolis Hastings algo is taking too much time? Perhaps,I am not aware of what should be the better proposal distribution.
Any leads would be highly appreciated.
statistics probability-distributions markov-chains sampling monte-carlo
$endgroup$
I have a discrete 7-element random vector $vecX$ with probability mass function $P_vecX(colorbluex_1,x_2,x_3,x_4,x_5,x_6,colorredx_7)$ that has a symmetry in its certain components.
The symmetry is such that: the first three components (the blue one) exhibits symmetry among themselves (black ones); the next three have symmetry in themselves too, and last one (red) is alone. (For further information about $P_vecX$: $vecX$ is a finite mixture of 8 components in seven dimensions. The seven variables in each of the eight components; are conditionally independent.)
Mathematically the symmetries are:
$$beginalign
P_vecX(colorbluex_1,x_2,x_3,x_4,x_5,x_6,colorredx_7)&=P_vecX(colorbluex_2,x_1,x_3,x_4,x_5,x_6,colorredx_7) \ &= P_vecX(colorbluex_3,x_2,x_1,x_5,x_6,x_4,colorredx_7) \ & vdots \ & vdots \ & vdots \ &= P_vecX(colorbluex_3,x_2,x_1,x_6,x_5,x_4,colorredx_7).
endalign$$
Now lets come to the problem:
By exploiting the symmetry in my pmf, I need to take samples from $P_vecX(x_1, cdots x_7)$. Does there exist a way that is computationally efficient (linear w.r.t no. of symmetries instead of exponential w.r.t no. of variables) over applying a naive sampling method that do not exploit inherent symmetry ? My actual problem is very high dimensional for instance $2^100$, so I desperately need to exploit the symmetry.
My attempt:
1) I took independent samples from each component and respect the mixing proportions by taking the proportional no. of samples from that component. However, still, the no. of variables (which are seven) are not decreasing.
2) Using MetroPolis Hastings algo is taking too much time? Perhaps,I am not aware of what should be the better proposal distribution.
Any leads would be highly appreciated.
statistics probability-distributions markov-chains sampling monte-carlo
statistics probability-distributions markov-chains sampling monte-carlo
edited Mar 29 at 17:37
tabletennis878
asked Mar 29 at 17:09
tabletennis878tabletennis878
64
64
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3167365%2fsamples-from-high-dimensional-distribution-by-exploiting-the-symmetry%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3167365%2fsamples-from-high-dimensional-distribution-by-exploiting-the-symmetry%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown