Joint Entropy Calculator
Free online joint entropy calculator. Enter your values and get instant results with the formula, step-by-step working, a worked example and FAQs — everything runs locally in your browser on Calcton, no signup required.
中文版:联合熵计算器
原理:联合熵 H(X,Y) = −ΣΣ p_ij·log2 p_ij,是对一对随机变量整体不确定性的度量。独立时 H(X,Y) = H(X) + H(Y);相关时联合熵变小,缺口正是互信息。
步骤:① 输入联合分布矩阵(支持 2×2 到 3×3);② 点击计算;③ 读出联合熵、两个边缘熵与互信息。
示例:均匀 2×2 分布每格 0.25 时 H(X,Y) = 2 比特(两个独立各 1 比特);(0.1, 0.2; 0.3, 0.4) 时 H(X,Y) = 1.846439344671 比特、互信息 0.005802149014 比特。
注意事项:所有元素和为 1,负值或零行会导致边缘熵异常;联合熵介于 max(H(X), H(Y)) 与 H(X) + H(Y) 之间;格点越多熵上限越高——3×3 独立均匀时为 log2 9 ≈ 3.17 比特。
相关:条件熵计算器从联合分布直接拆出 H(Y|X);互信息计算器深入讲解相关性的信息度量;信息熵计算器处理单个变量的情形。
How to use the Joint Entropy Calculator
- Fill in the inputs with your own numbers — every field shows what it expects.
- The result updates instantly as you type; no "Calculate" click needed.
- Read the result card for the main figure, the step-by-step formula, and practical notes.
Frequently asked questions
Is the Joint Entropy Calculator free?
Yes — all math calculators on Calcton are free, with no sign-up required. Your inputs are processed in your browser and never sent to a server.
Is there a Chinese version of this tool?
Yes. Use the Chinese version link above — it is the same calculator with the interface in Simplified Chinese.
References
Formulas and benchmarks used by this calculator follow these published sources.
KevinContent LeadCalcton Editorial Team · Last updated 2026-10-06
Kevin maintains Calcton's formula verification and content: every calculator cites the standard it implements, worked examples are recomputed programmatically, and health benchmarks follow WHO and international guidelines.
Related calculators
More in this category: Math calculators
About math calculators
Free online math calculators for algebra, statistics, number theory and everyday arithmetic — from quadratic equations and matrices to percentages, fractions and prime factorization, each with step-by-step formulas.