Jump to content

Talk:F-divergence

Page contents not supported in other languages.
From Wikipedia, the free encyclopedia

Instances of f-divergences

[edit]

In the table, what is t? I guess t=P(x)-Q(x) but I couldn't tell for sure. Metaxal (talk) 12:14, 4 July 2013 (UTC)[reply]

Incosistent with KL-divergence article

[edit]

Article on KL-divergence defines it as:

while based on this article one would derive the KL to be:

I guess both of them cannot be right because the divergence is not symmetric. Can somebody with the necessary knowledge decide which is the right formulation? Tomash (talk) 10:34, 16 August 2014 (UTC)[reply]

Instead of taking f(t) = -ln (t), take f(t) = t ln t:

--David Pal (talk) —Preceding undated comment added 12:23, 16 May 2016 (UTC)[reply]

Add visual examples

[edit]

This would be much easier to understand if there were a few examples of distributions, with the distances given between pairs of distributions via various measures. ★NealMcB★ (talk) 16:33, 1 March 2021 (UTC)[reply]

Jensen-Shannon imposter

[edit]

Whatever this is, it does NOT generate the Jensen-Shannon divergence! I don't know what it generates. It certainly generates a symmetric f-divergence, but it is NOT the Jensen-Shannon divergence!

I explicitly calculated the between the two coin-toss distributions with heads probability 1/3 and 2/3. I got

which is not equal to

And there is no way to fix this. There is no way to find some such that .

Whoever knows what it actually generates please add it back with the proper name attached.

pony in a strange land (talk) 01:18, 24 May 2022 (UTC)[reply]

This is in fact Jensen-Shannon divergence. Elestrophe (talk) 18:40, 6 October 2024 (UTC)[reply]