Talk:Precision (statistics)

Bayes inference

PRECISION is used in BUGS (Bayesian inference Using Gibbs Sampler) software

PRECISION as used in Bayesian Statistical Packages The widely used BUGS family of languages (WinBUGS, OpenBUGS and JAGS) apparently uses "precision" (defined as the inverse of the variance) in specifying distributions. I am writing an article on the new Bayes Statistical package Stan (developed 2012, with version 1.2, 6, March 2013). Stan use the more typical Standard Deviation.

Here is a reference (page 247) in "Stan User's Manual and Reference Guide, Version 1.2, 6 March 2012 (Creative Commons)"

"In Stan, the second argument to the "normal" function is the standard deviation (i.e., the scale), not the variance (as in Bayesian Data Analysis) and not the inverse-variance (i.e., precision) (as in BUGS). Thus a normal with mean 1 and standard deviation 2 is normal(1,2), not normal(1,4) or normal(1,0.25). Similarly, the second argument to the "multivariate normal" function is the covariance matrix and not the inverse covariance matrix (i.e., the precision matrix) (as in BUGS). The same is true for the "multivariate student" distribution." [1]

If you type "BUGS reciprocal variance precision" into a search engine (I used Google) you will get several hits with BUGS using the word "Precision" to represent inverse variance.

Here is a lecture I found which also references the statistical language R:

"BUGS code

   BUGS code looks just like R code but with important differences.
   ...
   BUGS uses R probability functions but with a twist. For instance the dnorm function is parameterized in terms of precision (reciprocal variance) rather than the standard deviation."

[2]

Opinion: PRECISION article needed because term in in common use in BUGS (Bayesian inference Using Gibbs Sampler) software

So, IMHO, it would be helpful to have a separate article on "Precision" used in the sense of "inverse variance" that explains this specific use of the term and what relation (if any?) it has to other uses of the term "Precision" (as in rounding of calculations or precision of estimate). Jim.Callahan,Orlando (talk) 14:18, 11 March 2013 (UTC)[reply]

This is specifically the topic of this article. THe other meaning is covered by the second sentence "This is in addition to its more general meaning in the contexts of accuracy and precision and of precision and recall. " ... which presumably points reraders to those artcles. 81.98.35.149 (talk) 22:28, 11 March 2013 (UTC)[reply]

AGREE -- I was responding to a notice that this article might be deleted. I wanted to explain rationale why I thought it was needed. Jim.Callahan,Orlando (talk) 06:32, 12 March 2013 (UTC)[reply]

Weighting

Speculation/Question: Does the definition of PRECISION have something to do with Inverse-variance weighting?

SPECULATION -- Defining Precision as the reciprocal of the variance, might have something to do with Inverse-variance weighting? Jim.Callahan,Orlando (talk) 06:32, 12 March 2013 (UTC)[reply]

Speculation/Question: Does the definition of PRECISION have something to do with Weighted least squares?

"The Gauss–Markov theorem shows that, when this is so, beta-hat is a best linear unbiased estimator (BLUE). If, however, the measurements are uncorrelated but have different uncertainties, a modified approach might be adopted. Aitken showed that when a weighted sum of squared residuals is minimized, beta-hat is BLUE if each weight is equal to the reciprocal of the variance of the measurement."

* *

"If the errors are correlated, the resulting estimator is BLUE if the weight matrix is equal to the inverse of the variance-covariance matrix of the observations." Jim.Callahan,Orlando (talk) 12:24, 12 March 2013 (UTC)[reply]

The above two points may be true algebraically, but to be included in this article you would need to find a source (or [referably sources) in which the weighting is done with things that are actually identified as the "precision", or as being equivalent to weighting using precisions. Recall that Wikipedia is based on reporting reputable sources, not on including original research ... WP:OR. 81.98.35.149 (talk) 15:36, 12 March 2013 (UTC)[reply]

zero entry in the precision matrix involves conditional independence

The sentence in the section "Usage" suggest that conditional independence involves zeros in the precision matrix. I believe it's also sufficient, having a zero in ij involves conditional independence. This should be clarified in the text. Therefore, it could be a "iff" after all.

For a simple explanation of this fact, you can consult https://stats.stackexchange.com/questions/578024/why-does-a-zero-entry-in-the-inverse-covariance-matrix-of-a-joint-gaussian-distr as well as these references :

Steffen L Lauritzen. Graphical models, volume 17. Clarendon Press, 1996.
Arthur P Dempster. Covariance selection. Biometrics, pages 157–175, 1972.

Durdenclub (talk) 09:15, 12 May 2024 (UTC)[reply]