Unifying logical and statistical AI with Markov logic

Abstract

Markov logic can be used as a general framework for joining logical and statistical AI.

References

1. Bach, S., Broecheler, M., Huang, B., Getoor, L. Hinge-loss Markov random fields and probabilistic soft logic. J. Mach. Learn. Res. 18, 109 (2017), 1--67.
2. Chavira, M., Darwiche, A. On probabilistic inference by weighted model counting. Artif. Intell. 6--7, 172 (2008), 772--799.
3. Davis, J., Domingos, P. Deep transfer via second-order Markov logic. In Proceedings of the 26^th International Conference on Machine Learning. ACM Press, Montréal, Canada.
4. De Raedt, L. Logical and Relational Learning. Springer, Berlin, Germany, 2008.
5. Van den Broeck, G., Taghipour, N., Meert, W., Davis, J., De Raedt, L. Lifted probabilistic inference by first-order knowledge compilation. In Proceedings of the 22^nd International Joint Conference on Artificial Intelligence (IJCAI) (2011). Barcelona, Spain.
6. Domingos, P., Kersting, K., Mooney, R., Shavlik, J. What about statistical relational learning? Commun. ACM 58, 12 (2015), 8.
7. Domingos, P., Lowd, D. Markov Logic: An Interface Layer for AI. Morgan & Claypool, San Rafael, CA, 2009.
8. Gogate, V., Domingos, P. Probabilistic theorem proving. In Proceedings of the 27^th Conference on Uncertainty in Artificial Intelligence (UAI-11). AUAI Press, Barcelona, Spain, 2011.
9. Goodfellow, I., Bengio, Y., Courville, A. Deep Learning. MIT Press, 2016. http://www.deeplearningbook.org.
10. Van Haaren, J., Van den Broeck, G., Meert, W., Davis, J. Lifted generative learning of Markov logic networks. Mach. Learn, 103 (2015), 27--55.
11. Huynh, T., Mooney, R. Discriminative structure and parameter learning for Markov logic networks. In Proceedings of the 25^th International Conference on Machine Learning (2008). ACM Press, Helsinki, Finland, 416--423.
12. Jiang, S., Lowd, D., Dou, D. Ontology matching with knowledge rules. In Proceedings of the 26th International Conference on Database and Expert Systems Applications (DEXA 2015) (2015). Springer, Valencia, Spain.
13. Khot, T., Natarajan, S., Kersting, K., Shavlik, J. Gradient-based boosting for statistical relational learning: the Markov logic network and missing data cases. Mach. Learn, 100 (2015), 75--100.
14. Kimmig, A., Mihalkova, L., Getoor, L. Lifted graphical models: a survey. Mach. Learn. (1), 99 (2015), 1--45.
15. Kok, S., Domingos, P. Learning the structure of Markov logic networks. In Proceedings of the 22^nd International Conference on Machine Learning (2005). ACM Press, Bonn, Germany, 441--448.
16. Kok, S., Domingos, P. Learning Markov logic networks using structural motifs. In Proceedings of the 27^th International Conference on Machine Learning (2010). ACM Press, Haifa, Israel.
17. Kok, S., Sumner, M., Richardson, M., Singla, P., Poon, H., Lowd, D., Domingos, P. The Alchemy system for statistical relational AI. Technical Report. Department of Computer Science and Engineering, University of Washington, Seattle, WA, 2000. http://alchemy.cs.washington.edu.
18. Lowd, D., Domingos, P. Efficient weight learning for Markov logic networks. In Proceedings of the 11^th European Conference on Principles and Practice of Knowledge Discovery in Databases (2007). Springer, Warsaw, Poland, 200--211.
19. Lowd, D., Domingos, P. Recursive random fields. In Proceedings of the 20^th International Joint Conference on Artificial Intelligence (2007). AAAI Press, Hyderabad, India, 950--955.
20. Mihalkova, L., Huynh, T., Mooney, R.J. Mapping and revising Markov logic networks for transfer learning. In Proceedings of the 22^nd AAAI Conference on Artificial Intelligence (2007). AAAI Press, Vancouver Canada, 608--614.
21. Mihalkova, L., Mooney, R. Bottom-up learning of Markov logic network structure. In Proceedings of the 24^th International Conference on Machine Learning (2007). ACM Press, Corvallis, OR, 625--632.
22. Nath, A., Domingos, P. A language for relational decision theory. In Proceedings of the International Workshop on Statistical Relational Learning (2009). Leuven, Belgium.
23. Niepert, M., Meilicke, C., Stuckenschmidt, H. A probabilistic-logical framework for ontology matching. In Proceedings of the 24^th AAAI Conference on Artificial Intelligence (2010). AAAI Press.
24. Niepert, M., Domingos, P. Learning and inference in tractable probabilistic knowledge bases. In Proceedings of the 31^st Conference on Uncertainty in Artificial Intelligence (2015). AUAI Press, Brussels, Belgium.
25. Niu, F., Ré, C., Doan, A., Shavlik, J. Tuffy: scaling up statistical inference in Markov logic networks using an RDBMS. PVLDB 4 (2011), 373--384.
26. Niu, F., Zhang, C., Ré, C., Shavlik, J. DeepDive: web-scale knowledge-base construction using statistical learning and inference. In VLDS, 2012.
27. Noessner, J., Niepert, M., Stuckenschmidt, H. RockIt: exploiting parallelism and symmetry for MAP inference in statistical relational models. In Proceedings of the 27^th AAAI Conference on Artificial Intelligence (2013). AAAI Press, Bellevue, WA.
28. Pfeffer, A. Practical Probabilistic Programming. Manning Publications, 2016
29. Poole, D. First-order probabilistic inference. In Proceedings of the 18^th International Joint Conference on Artificial Intelligence (2003). Morgan Kaufmann, Acapulco, Mexico, 985--991.
30. Poon, H., Domingos, P. Joint inference in information extraction. In Proceedings of the 22^nd AAAI Conference on Artificial Intelligence (2007). AAAI Press, Vancouver, Canada, 913--918.
31. Poon, H., Domingos, P. Unsupervised semantic parsing. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing (2009). ACL, Singapore.
32. Richardson, M., Domingos, P. Markov logic networks. Mach. Learn. 62 (2006), 107--136.
33. Riedel, S. Improving the accuracy and efficiency of MAP inference for Markov logic. In Proceedings of the 24^th Conference on Uncertainty in Artificial Intelligence (2008). AUAI Press, Helsinki, Finland, 468--475.
34. Russell, S. Unifying logic and probability. Commun. ACM 58, 7 (2015), 88--97.
35. Schulte, O., Gholami, S. Locally consistent Bayesian network scores for multi-relational data. In Proceedings of the 26^th International Joint Conference on Artificial Intelligence (IJCAI-17) (2017). Melbourne, Australia, 2693--2700.
36. Singla, P., Domingos, P. Markov logic in infinite domains. In Proceedings of the 23^rd Conference on Uncertainty in Artificial Intelligence (2007). AUAI Press, Vancouver, Canada, 368--375.
37. Wang, J., Domingos, P. Hybrid Markov logic networks. In Proceedings of the 23^rd AAAI Conference on Artificial Intelligence (2008). AAAI Press, Chicago, IL, 1106--1111.
38. Xiang, R., Neville, J. Relational learning with one network: An asymptotic analysis. In Proceedings of the 14^th International Conference on Artificial Intelligence and Statistics (2011). 779--788.
39. Kok, S. and Domingos, P. Extracting semantic networks from text via relational clustering. In Proceedings of ECML/PKDD-08 (Antwerp, Belgium, Sept. 2008). Springer, 624--639.

Index Terms

• Computing methodologies

  • Artificial intelligence

  • Machine learning

    • Machine learning approaches

      • Markov decision processes