<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>52nlp&#039;s Learning Notes &#187; Bayesian Networks</title>
	<atom:link href="http://www.52nlp.com/tag/bayesian-networks/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.52nlp.com</link>
	<description>Natural Language Processing, Machine Learning, Programming Skill, Mathematics</description>
	<lastBuildDate>Sat, 23 Apr 2011 05:17:18 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.1.1</generator>
		<item>
		<title>Graphical Models and Bayesian Networks Tutorial Reading</title>
		<link>http://www.52nlp.com/graphical-models-and-bayesian-networks-tutorial-reading/</link>
		<comments>http://www.52nlp.com/graphical-models-and-bayesian-networks-tutorial-reading/#comments</comments>
		<pubDate>Wed, 18 Nov 2009 16:14:50 +0000</pubDate>
		<dc:creator>52nlp</dc:creator>
				<category><![CDATA[NLP]]></category>
		<category><![CDATA[Bayesian Networks]]></category>
		<category><![CDATA[Graphical Models]]></category>

		<guid isPermaLink="false">http://www.52nlp.com/?p=48</guid>
		<description><![CDATA[The following excerpt from &#8220;A Brief Introduction to Graphical Models and Bayesian Networks&#8221; by Kevin Murphy. Books In reverse chronological order. Daphne Koller and Nir Friedman, &#8220;Probabilistic graphical models: principles and techniques&#8221;, MIT Press 2009 Adnan Darwiche, &#8220;Modeling and reasoning &#8230; <a href="http://www.52nlp.com/graphical-models-and-bayesian-networks-tutorial-reading/">Continue reading <span class="meta-nav">&#8594;</span></a>


Related posts:<ol><li><a href='http://www.52nlp.com/bayesian-modeling-for-language-tutorial-reading/' rel='bookmark' title='Permanent Link: Bayesian Modeling for Language Tutorial Reading'>Bayesian Modeling for Language Tutorial Reading</a></li>
<li><a href='http://www.52nlp.com/maximum-entropy-model-tutorial-reading/' rel='bookmark' title='Permanent Link: Maximum Entropy Model Tutorial Reading'>Maximum Entropy Model Tutorial Reading</a></li>
<li><a href='http://www.52nlp.com/statistical-machine-translation-tutorial-reading/' rel='bookmark' title='Permanent Link: Statistical Machine Translation Tutorial Reading'>Statistical Machine Translation Tutorial Reading</a></li>
<li><a href='http://www.52nlp.com/from-nlpers-getting-started-in-nlp/' rel='bookmark' title='Permanent Link: From nlpers:Getting Started in NLP'>From nlpers:Getting Started in NLP</a></li>
<li><a href='http://www.52nlp.com/moses-support-digest-tuning-tree-based-models/' rel='bookmark' title='Permanent Link: Moses Support Digest:tuning tree-based models'>Moses Support Digest:tuning tree-based models</a></li>
<li><a href='http://www.52nlp.com/a-cool-dictionary-for-natural-language-processing/' rel='bookmark' title='Permanent Link: A Cool Dictionary for Natural Language Processing'>A Cool Dictionary for Natural Language Processing</a></li>
</ol>]]></description>
			<content:encoded><![CDATA[<p>The following excerpt from &#8220;<a href="http://people.cs.ubc.ca/~murphyk/Bayes/bnintro.html"target=_blank>A Brief Introduction to Graphical Models and Bayesian Networks</a>&#8221; by Kevin Murphy.<span id="more-48"></span></p>
<h2>Books</h2>
<p>In reverse chronological order.</p>
<ul>
<li>Daphne Koller and Nir Friedman, &#8220;Probabilistic graphical models: principles and techniques&#8221;, MIT Press 2009 </a></li>
<li>Adnan Darwiche, &#8220;Modeling and reasoning with Bayesian networks&#8221;, Cambridge 2009 </a></li>
<li>F. V. Jensen. &#8220;Bayesian Networks and Decision Graphs&#8221;. Springer. 2001.<br />
Probably the best introductory book available. </a></li>
<li>D. Edwards. &#8220;Introduction to Graphical Modelling&#8221;,  2nd ed. Springer-Verlag. 2000.<br />
Good treatment of <em>undirected</em> graphical models from a statistical perspective. </a></li>
<li>J. Pearl. &#8220;Causality&#8221;. Cambridge. 2000.<br />
The definitive book on using causal DAG modeling. </a></li>
<li>R. G. Cowell, A. P. Dawid, S. L. Lauritzen and D. J. Spiegelhalter. &#8220;Probabilistic Networks and Expert Systems&#8221;. Springer-Verlag. 1999.<br />
Probably the best book available, although the treatment is restricted to   exact inference. </a></li>
<li>M. I. Jordan (ed). &#8220;Learning in Graphical Models&#8221;. MIT Press. 1998.<br />
Loose collection of papers on machine learning, many related to graphical models. One of the few books to discuss <em>approximate</em> inference. </a></li>
<li>B. Frey. &#8220;Graphical models for machine learning and digital communication&#8221;, MIT Press. 1998.<br />
Discusses pattern recognition and turbocodes using (directed) graphical models. </a></li>
<li>E. Castillo and J. M. Gutierrez and A. S. Hadi. &#8220;Expert systems and probabilistic network models&#8221;. Springer-Verlag, 1997.<br />
A <a href="http://personales.unican.es/gutierjm/BookCGH.html">Spanish version</a> is available online for free.</li>
<li> F. Jensen. &#8220;An introduction to Bayesian Networks&#8221;. UCL Press. 1996. Out of print.<br />
Superceded by his 2001 book.</li>
<li> S. Lauritzen. &#8220;Graphical Models&#8221;, Oxford. 1996.<br />
The definitive mathematical exposition of the theory of graphical models.</li>
<li> S. Russell and P. Norvig. &#8220;Artificial Intelligence: A Modern Approach&#8221;. Prentice Hall. 1995.<br />
Popular undergraduate textbook that includes a readable chapter on directed graphical models.</li>
<li> J. Whittaker. &#8220;Graphical Models in Applied Multivariate Statistics&#8221;, Wiley. 1990.<br />
This is the first book published on graphical modelling from a statistics perspective.</li>
<li> R. Neapoliton. &#8220;Probabilistic Reasoning in Expert Systems&#8221;. John Wiley &amp; Sons. 1990.</li>
<li> J. Pearl. &#8220;Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference.&#8221; Morgan Kaufmann. 1988.<br />
The book that got it all started! <!-- This is the first book published on directed graphical models from an AI/ cognitive science perspective (rather than a statistics perspective). --> A very insightful book, still relevant today.</li>
</ul>
<h2>Review articles</h2>
<ul>
<li> P. Smyth, 1998. <a href="http://ftp.ics.uci.edu/pub/smyth/papers/prl.ps.Z"> &#8220;Belief networks, hidden Markov models, and Markov random fields: a unifying view&#8221;</a>, Pattern Recognition Letters.</li>
<li> E. Charniak, 1991. <a href="http://people.cs.ubc.ca/%7Emurphyk/Bayes/Charniak_91.pdf">&#8220;Bayesian Networks without Tears&#8221;</a>, AI magazine.</li>
<li> Sam Roweis &amp; Zoubin Ghahramani, 1999. <a href="http://www.gatsby.ucl.ac.uk/%7Eroweis/papers/NC110201.pdf"> A Unifying Review of Linear Gaussian Models</a>, Neural Computation 11(2) (1999) pp.305-345</li>
</ul>
<h2>Exact Inference</h2>
<ul>
<li> C. Huang and A. Darwiche, 1996. <a href="http://www.aub.edu.lb/people/darwiche/Papers/ijar95.pdf"> &#8220;Inference in Belief Networks: A procedural guide&#8221;</a>, Intl. J. Approximate Reasoning, 15(3):225-263.</li>
<li> R. McEliece and S. M. Aji, 2000. <!--<a href="http://www.systems.caltech.edu/EE/Faculty/rjm/papers/GDL.ps" mce_href="http://www.systems.caltech.edu/EE/Faculty/rjm/papers/GDL.ps">&#8211;> <a href="http://people.cs.ubc.ca/%7Emurphyk/Bayes/GDL.pdf"> The Generalized Distributive Law</a>, IEEE Trans. Inform. Theory, vol. 46, no. 2 (March 2000), pp. 325&#8211;343.</li>
<li> F. Kschischang, B. Frey and H. Loeliger, 2001. <a href="http://www.cs.toronto.edu/%7Efrey/papers/fgspa.abs.html">Factor graphs and the sum product algorithm</a>, IEEE Transactions on Information Theory, February, 2001.</li>
<li> M. Peot and R. Shachter, 1991. &#8220;Fusion and propogation with multiple observations in belief networks&#8221;, Artificial Intelligence, 48:299-318.</li>
</ul>
<h2>Approximate Inference</h2>
<ul>
<li> M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, and L. K. Saul, 1997. <a href="http://www.cs.berkeley.edu/%7Ejordan/papers/variational-intro.ps.Z"> &#8220;An introduction to variational methods for graphical models.&#8221;</a></li>
<li> D. MacKay, 1998. <a href="http://www.cs.toronto.edu/%7Emackay/erice.ps.gz"> &#8220;An introduction to Monte Carlo methods&#8221;</a>.</li>
<li> <a name="Jaakkola98"> T. Jaakkola and M. Jordan, 1998. </a><a href="http://www.cs.berkeley.edu/%7Ejordan/papers/varqmr.ps.Z"> &#8220;Variational probabilistic inference and the QMR-DT database&#8221; </a></li>
</ul>
<h2>Learning</h2>
<ul>
<li> W. L. Buntine, 1994. <a href="http://www.ultimode.com/%7Ewray/lwgmJAIR.ps.Z"> &#8220;Operations for Learning with Graphical Models&#8221;</a>, J. AI Research, 159&#8211;225.</li>
<li> D. Heckerman, 1996. <a href="ftp://ftp.research.microsoft.com/pub/tr/TR-95-06.PS"> &#8220;A tutorial on learning with Bayesian networks&#8221;</a>, Microsoft Research tech. report, MSR-TR-95-06.  <!--
<li> P. Krause, 1998. <A HREF="http://www.auai.org/auai-tutes.html/bayesUS_krause.ps.gz" mce_HREF="http://www.auai.org/auai-tutes.html/bayesUS_krause.ps.gz"> &#8220;Learning probabilistic networks&#8221;,</a> Philips Research Labs tech. report.
<li> N. Friedman, 1998. <a href="http://www.cs.huji.ac.il/~nir/Abstracts/Fr2.html" mce_href="http://www.cs.huji.ac.il/~nir/Abstracts/Fr2.html"> &#8220;The Bayesian Structural EM Algorithm&#8221;</a>, UAI. &#8211;></li>
</ul>
<h2>DBNs</h2>
<ul>
<li> L. R. Rabiner, 1989. <a href="http://people.cs.ubc.ca/%7Emurphyk/Bayes/rabiner.pdf">&#8220;A Tutorial in Hidden Markov Models and Selected Applications in Speech Recognition&#8221;</a>, Proc. of the IEEE, 77(2):257&#8211;286.</li>
<li> Z. Ghahramani, 1998. <a href="ftp://ftp.cs.toronto.edu/pub/zoubin/vietri.ps.gz"> Learning Dynamic Bayesian Networks </a> In  C.L. Giles and M. Gori (eds.), <em> Adaptive Processing             of Sequences and Data Structures </em>. Lecture Notes in Artificial           Intelligence, 168-197. Berlin: Springer-Verlag.</li>
</ul>
<p><!--adsense--></p>


<p>Related posts:<ol><li><a href='http://www.52nlp.com/bayesian-modeling-for-language-tutorial-reading/' rel='bookmark' title='Permanent Link: Bayesian Modeling for Language Tutorial Reading'>Bayesian Modeling for Language Tutorial Reading</a></li>
<li><a href='http://www.52nlp.com/maximum-entropy-model-tutorial-reading/' rel='bookmark' title='Permanent Link: Maximum Entropy Model Tutorial Reading'>Maximum Entropy Model Tutorial Reading</a></li>
<li><a href='http://www.52nlp.com/statistical-machine-translation-tutorial-reading/' rel='bookmark' title='Permanent Link: Statistical Machine Translation Tutorial Reading'>Statistical Machine Translation Tutorial Reading</a></li>
<li><a href='http://www.52nlp.com/from-nlpers-getting-started-in-nlp/' rel='bookmark' title='Permanent Link: From nlpers:Getting Started in NLP'>From nlpers:Getting Started in NLP</a></li>
<li><a href='http://www.52nlp.com/moses-support-digest-tuning-tree-based-models/' rel='bookmark' title='Permanent Link: Moses Support Digest:tuning tree-based models'>Moses Support Digest:tuning tree-based models</a></li>
<li><a href='http://www.52nlp.com/a-cool-dictionary-for-natural-language-processing/' rel='bookmark' title='Permanent Link: A Cool Dictionary for Natural Language Processing'>A Cool Dictionary for Natural Language Processing</a></li>
</ol></p>]]></content:encoded>
			<wfw:commentRss>http://www.52nlp.com/graphical-models-and-bayesian-networks-tutorial-reading/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

