Semi-automated magazine layout using content-based image features

ABSTRACT

We present a system for automating magazine layout process and data on its performance in a user evaluation test. The purpose of the study is to find the feasibility of the key system variables on the end-user. This semi-automatic system is based on content-based image feature algorithms to automate the layout process. The image related automation includes image cropping, overlaying text on top of images, image color palette creation, and image alignment. The algorithms rely on principles of photography and are used here together in the context of graphic design. For example the rule-of-space and leading line concepts can be extended to layout contexts for improved alignment of text and images. The computation is based on automatic analysis, such as face detection, color saliency, and textureness. We used the automation to create a functional prototype, an iPad magazine, using an open HTML5 eBook framework, which relies on CSS3 media queries for the layout adaptation. User experiments (40 participants) were conducted where the system was compared against two commercial iPad magazine systems in terms of overall usability with emphasis on visual aspects. Questionnaires and free commenting was used in a task-based usage scenario. The experiments were video recorded and the user comments were transcribed and coded into attributes. Usability results mixed with qualitative observation are reported. Results show that usability, read- ability and visuality are important to the users. Our system was considered more usable than the other two systems with some of the defining aspects being simplicity in terms of usability, subjective readability and visual clarity.

References

1. R. Achanta, S. Hemami, F. Estrada, and S. Süsstrunk. Frequency-Tuned Salient Region Detection. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1597--1604, 2009.
2. S. Avidan and A. Shamir. Seam Carving for Content-Aware Image Resizing. ACM Transactions on Graphics, 26(3):10, 2007.
3. S. Bae, S. Paris, and F. Durand. Two-Scale Tone Management for Photographic Look. ACM Transactions on Graphics, 25(3):637, 2006.
4. S. Banerjee and B. Evans. In-Camera Automation of Photographic Composition Rules. IEEE Transactions on Image Processing, 16(7):1807--1820, 2007.
5. K. Berkner and B. Erol. Adaptation of Document Images to Display Constraints. In Proceedings of SPIE, volume 6806, page 68061C, 2008.
6. C. Braganza, K. Marriott, P. Moulder, M. Wybrow, and T. Dwyer. Scrolling Behaviour with Single- and Multi-column Layout. In International World Wide Web Conference, pages 831--840, 2009.
7. J. Brooke. SUS: A Quick and Dirty Usability Scale. In P. W. Jordan, B. A. Weerdmeester, B. Thomas, and I. L. McClelland, editors, Usability Evaluation in Industry, chapter SUS, pages 189--194. Taylor and Francis, 1996.
8. W.-l. Chang and H.-l. Lin. The Impact of Color Traits on Corporate Branding. Journal of Business, 4(15):3344--3355, 2010.
9. B. Cheng, B. Ni, S. Yan, and Q. Tian. Learning to Photograph. In Proceedings of the ACM International Conference on Multimedia - MM '10, pages 291--300, 2010.
10. R. Datta, D. Joshi, J. Li, and J. Z. Wang. Studying Aesthetics in Photographic Images Using a Computational Approach. In European Conference on Computer Vision, pages 288--301, 2006.
11. L. Fernandes and M. Oliveira. Real-Time Line Detection Through an Improved Hough Transform Voting Scheme. Pattern Recognition, 41(1):299--314, 2008.
12. B. Geng, L. Yang, C. Xu, X.-S. Hua, and S. Li. The Role of Attractiveness in Web Image Search. In Proceedings of the ACM International Conference on Multimedia - MM '11, pages 63--72, 2011.
13. T. Grill and M. Scanlon. Photographic Composition. Fountain Press, 1984.
14. C. Havasi, R. Speer, and J. Holmgren. Automated Color Selection Using Semantic Knowledge. In AAAI Fall Symposium, pages 40--45, 2010.
15. C. Jacobs, W. Li, E. Schrier, D. Bargeron, and D. Salesin. Adaptive grid-based document layout. ACM Transactions on Graphics, 22(3):838--847, 2003.
16. Y. Ke, X. Tang, and F. Jing. The Design of High-Level Features for Photo Quality Assessment. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 419--426, 2006.
17. R. Kumar, J. Kim, and S. R. Klemmer. Automatic Retargeting of Web Page Content. In Human Factors in Computing Systems - CHI EA, pages 4237--4242, 2009.
18. C.-Y. Lai, P.-H. Chen, S.-W. Shih, Y. Liu, and J.-S. Hong. Computational Models and Experimental Investigations of Effects of Balance and Symmetry on the Aesthetics of Text-Overlaid Images. Journal of Human Computer Studies, 68(1--2):41--56, 2010.
19. T. Lavie and N. Tractinsky. Assessing Dimensions of Perceived Visual Aesthetics of Web Sites. International Journal of Human-Computer Studies, 60(3):269--298, 2004.
20. J. R. Lewis and J. Sauro. The Factor Structure of the System Usability Scale. In Proceedings of the International Conference on Human Centered Design, pages 94--103, 2009.
21. M. D. S. Lonsdale, M. C. Dyson, and L. Reynolds. Reading in Examination-Type Situations: The Effects of Text Layout on Performance. Journal of Research in Reading, 29(4):433--453, 2006.
22. Y. Luo and X. Tang. Photo and Video Quality Evaluation: Focusing on the Subject. In European Conference on Computer Vision, pages 386--399, 2008.
23. E. Marcotte. Responsive Web Design. A Book Apart, 2011.
24. M. Moshagen and M. T. Thielsch. Facets of Visual Aesthetics. International Journal of Human-Computer Studies, 68(10):689--709, 2010.
25. M. Nebeling, F. Matulic, L. Streit, and M. C. Norrie. Adaptive Layout Template for Effective Web Content Presentation in Large-Screen Contexts. In Proceedings of the 11th ACM Symposium on Document Engineering - DocEng '11, page 219, 2011.
26. P. Sandhaus, M. Rabbath, and S. Boll. Employing Aesthetic Principles for Automatic Photo Book Layout. In International Conference on Advances in Multimedia Modeling, pages 84--95, 2010.
27. E. Schrier, M. Dontcheva, C. Jacobs, G. Wade, and D. Salesin. Adaptive Layout for Dynamically Aggregated Documents. In Proceedings of the ACM International Conference on Intelligent User Interfaces, pages 99--108, 2008.
28. V. Setlur, S. Takagi, R. Raskar, M. Gleicher, and B. Gooch. Automatic Image Retargeting. In International Conference on Mobile and Ubiquitous Multimedia, pages 59--68, 2005.
29. X. Sun, H. Yao, R. Ji, and S. Liu. Photo Assessment Based on Computational Visual Attention Model. In Proceedings of the ACM International Conference on Multimedia - MM '09, pages 541--544, 2009.
30. P. Viola and M. Jones. Robust Real-time Object Detection. International Journal of Computer Vision, 57(2):137--154, 2001.

Index Terms

• Applied computing

  • Computers in other domains

    • Personal computers and PC applications

    • Publishing

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

  • Computer graphics

    • Image manipulation