skip to main content
10.1145/1873951.1874030acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Social pixels: genesis and evaluation

Published: 25 October 2010 Publication History

Abstract

Huge amounts of social multimedia is being created daily by a combination of globally distributed disparate sensors, including human-sensors (e.g. tweets) and video cameras. Taken together, this represents information about multiple aspects of the evolving world. Understanding the various events, patterns and situations emerging in such data has applications in multiple domains. We develop abstractions and tools to decipher various spatio-temporal phenomena which manifest themselves across such social media data. We describe an approach for aggregating social interest of users about any particular theme from any particular location into 'social pixels'. Aggregating such pixels spatio-temporally allows creation of social versions of images and videos, which then become amenable to various media processing techniques (like segmentation, convolution) to derive semantic situation information. We define a declarative set of operators upon such data to allow for users to formulate queries to visualize, characterize, and analyze such data. Results of applying these operations over an evolving corpus of millions of Twitter and Flickr posts, to answer situation-based queries in multiple application domains are promising.

References

[1]
R. Albert, H. Jeong, and A. Barabasi. The diameter of the world wide web. Nature, 1999.
[2]
L. Backstrom, J. Kleinberg, R. Kumar, and J. Novak. Spatial variation in search engine queries. In World Wide Web conference, 2008.
[3]
N. Bansal and N. Koudas. Blogscope: a system for online analysis of high volume text streams. In PVLDB, pages 1410--1413, 2007.
[4]
J. Biehl, M. Czerwinski, G. Smith, and G. Robertson. FASTDash: a visual dashboard for fostering awareness in software teams. In Proc. CHI, 2007.
[5]
A. Coman, M. Nascimento, and J. Sander. A framework for spatio-temporal query processing over wireless sensor networks. In VLDB: workshop on Data management for sensor networks, 2004.
[6]
Q. Hart and M. Gertz. Optimization of multiple continuous queries over streaming satellite data. In ACM GIS conference, 2006.
[7]
L. Hirschman, M. Light, E. Breck, and J. Burger. Deep Read: A reading comprehension system. In ACL Computational Linguistics, 1999.
[8]
N. Jacobs, W. Burgin, N. Fridrich, A. Abrams, K. Miskell, B. Braswell, A. Richardson, and R. Pless. The global network of outdoor webcams: properties and applications. In ACM GIS conference, 2009.
[9]
S. Kingsbury. Wisdom for the Masses. American Speech, pages 358--360, 1987.
[10]
D. Liverman. People and pixels: Linking remote sensing and social science. Natl Academy Pr, 1998.
[11]
J. Lloyd. Practical advantages of declarative programming. In Joint Conference on Declarative Programming, GULP-PRODE, volume 94, 1994.
[12]
Q. Mei, C. Liu, H. Su, and C. Zhai. A probabilistic approach to spatiotemporal theme pattern mining on weblogs. In World Wide Web Conference, 2006.
[13]
M. Nagarajan, K. Gomadam, A. Sheth, A. Ranabahu, R. Mutharaju, and A. Jadhav. Spatio-temporalthematic analysis of citizen sensor data: Challenges and experiences. Proc. WISE, 2009.
[14]
S. Orlando, R. Orsini, A. Raffaet'a, A. Roncato, and C. Silvestri. Spatio-temporal aggregations in trajectory data warehouses. Data Warehousing and Knowledge Discovery, 2007.
[15]
G. X. Ritter and J. N. Wilson. Handbook of Computer Vision Algorithms in Image Algebra. CRC Press, Inc., Boca Raton, FL, USA, 2000.
[16]
S. Rivest, Y. BAl'dard, and P. March. Towards better support for spatial decision-making: defining the characteristics. In Geomatica, pages 539--555, 2001.
[17]
R. Ronen and O. Shmueli. SoQL: A Language for Querying and Creating Data in Social Networks. In ICDE, pages 1595--1602, 2009.
[18]
T. Sakaki, M. Okazaki, and Y. Matsuo. Earthquake Shakes Twitter Users: Real-time Event Detection by Social Sensors. In World Wide Web Conference, 2010.
[19]
J. Sankaranarayanan, H. Samet, B. Teitler, M. Lieberman, and J. Sperling. TwitterStand: news in tweets. In ACM GIS conference, 2009.
[20]
D. Shamma, L. Kennedy, and E. Churchill. Tweet the debates: understanding community annotation of uncollected sources. In SIGMM-Workshop on Social Media, 2009.
[21]
A. Sheth. Citizen sensing, social signals, and enriching human experience. IEEE Internet Computing, 13(4):87--92, 2009.
[22]
A. Signorini. Swine Flu monitoring using twitter. In http://compepi.cs.uiowa.edu/ alessio/twitter monitor-swine-flu/.
[23]
V. K. Singh, M. Gao, and R. Jain. From microblogs to social images: event analytics for situation assessment. In MIR '10: Int. Conf. on Multimedia information retrieval (Demo session), 2010.
[24]
V. K. Singh, M. Gao, and R. Jain. Situation detection and control using spatio-temporal analysis of microblogs. In WWW '10: Int. Conf. on World wide web, 2010.
[25]
N. Snavely, S. M. Seitz, and R. Szeliski. Modeling the world from Internet photo collections. International Journal of Computer Vision, 80(2), November 2008.
[26]
J. D. Ullman. Principles of Database and Knowledge-Base Systems, Volume I. Computer Science Press, 1988.

Cited By

View all
  • (2021)A Matrix Factorization Based Framework for Fusion of Physical and Social SensorsIEEE Transactions on Multimedia10.1109/TMM.2020.301622223(2782-2793)Online publication date: 2021
  • (2021)Optimal Pre-Filtering for Improving Facebook Shared ImagesIEEE Transactions on Image Processing10.1109/TIP.2021.309379430(6292-6306)Online publication date: 2021
  • (2021)BusBeat: Early Event Detection with Real-Time Bus GPS TrajectoriesIEEE Transactions on Big Data10.1109/TBDATA.2018.28725327:2(371-382)Online publication date: 1-Jun-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '10: Proceedings of the 18th ACM international conference on Multimedia
October 2010
1836 pages
ISBN:9781605589336
DOI:10.1145/1873951
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. human-sensors
  2. media processing
  3. microblogs
  4. query algebra
  5. situation detection
  6. social pixel

Qualifiers

  • Research-article

Conference

MM '10
Sponsor:
MM '10: ACM Multimedia Conference
October 25 - 29, 2010
Firenze, Italy

Acceptance Rates

Overall Acceptance Rate 995 of 4,171 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)1
Reflects downloads up to 18 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2021)A Matrix Factorization Based Framework for Fusion of Physical and Social SensorsIEEE Transactions on Multimedia10.1109/TMM.2020.301622223(2782-2793)Online publication date: 2021
  • (2021)Optimal Pre-Filtering for Improving Facebook Shared ImagesIEEE Transactions on Image Processing10.1109/TIP.2021.309379430(6292-6306)Online publication date: 2021
  • (2021)BusBeat: Early Event Detection with Real-Time Bus GPS TrajectoriesIEEE Transactions on Big Data10.1109/TBDATA.2018.28725327:2(371-382)Online publication date: 1-Jun-2021
  • (2019)Models and Practices in Urban Data Science at ScaleBig Data Research10.1016/j.bdr.2018.04.00317:C(66-84)Online publication date: 1-Sep-2019
  • (2018)The Role of Urban Mobility in Retail Business SurvivalProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/32649102:3(1-22)Online publication date: 18-Sep-2018
  • (2018)Parallel Semi‐supervised enhanced fuzzy Co‐Clustering (PSEFC) and Rapid Association Rule Mining (RARM) based frequent route mining algorithm for travel sequence recommendation on big social mediaConcurrency and Computation: Practice and Experience10.1002/cpe.483731:14Online publication date: 27-Jul-2018
  • (2017)An interview with Prof. Ramesh JainACM SIGMultimedia Records10.1145/3173058.31730659:2(1)Online publication date: 8-Dec-2017
  • (2017)BibliographyFrontiers of Multimedia Research10.1145/3122865.3122878(315-377)Online publication date: 19-Dec-2017
  • (2017)Towards a platform for community-centric smart connected servicesProceedings of the 2nd International Workshop on Science of Smart City Operations and Platforms Engineering10.1145/3063386.3063769(40-45)Online publication date: 18-Apr-2017
  • (2017)Integration of Diverse Data Sources for Spatial PM2.5 Data InterpolationIEEE Transactions on Multimedia10.1109/TMM.2016.261363919:2(408-417)Online publication date: 1-Feb-2017
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media