skip to main content
10.1145/2470654.2466422acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Picode: inline photos representing posture data in source code

Published: 27 April 2013 Publication History

Abstract

Current programming environments use textual or symbolic representations. While these representations are appropriate for describing logical processes, they are not appropriate for representing raw values such as human and robot posture data, which are necessary for handling gesture input and controlling robots. To address this issue, we propose Picode, a text-based development environment integrated with visual representations: photos of human and robots. With Picode, the user first takes a photo to bind it to posture data. S/he then drag-and-drops the photo into the code editor, where it is displayed as an inline image. A preliminary in-house user study implied positive effects of taking photos on the programming experience.

Supplementary Material

suppl.mov (chi0951-file3.mp4)
Supplemental video

References

[1]
Billard, A., Calinon, S., Dillmann, R. and Schaal, S. Robot programming by demonstration. In Handbook of Robotics, Springer (2008), 1371--1394.
[2]
Davidoff, S., Villar, N., Taylor, A. S. and Izadi, S. Mechanical hijacking: how robots can accelerate UbiComp deployments. In Proc. UbiComp 2011, 267--270.
[3]
Hartmann, B., Klemmer, S. R., Bernstein, M., Abdulla, L., Burr, B., Mosher., A. R. and Gee, J. Reflective physical prototyping through integrated design, test, and analysis. In Proc. UIST 2006, 299--308.
[4]
Kato, J., McDirmid, S. and Cao, X. DejaVu: Integrated support for developing interactive camera-based programs. In Proc. UIST 2012, 189--196.
[5]
Ko, A. J. and Myers, B. A. Barista: An implementation framework for enabling new tools, interaction techniques and views in code editors. In Proc. CHI 2006, 387--396.
[6]
LEGO Mindstorms NXT. http://mindstorms.lego.com/.
[7]
Nakaoka, S., Kajita, S. and Yokoi, K. Intuitive and flexible user interface for creating whole body motions of biped humanoid robots. In Proc. IROS 2010, 1675--1682.
[8]
Omar, C., Yoon, Y., LaToza, T. D. and Myers, B. A. Active code completion. In Proc. ICSE 2012, 859--869.
[9]
Patel, K., Bancroft, N., Drucker, S. M., Fogarty, J., Ko, A. J. and Landay, J. Gestalt: integrated support for implementation and analysis in machine learning. In Proc. UIST 2010, 37--46.
[10]
Processing. http://processing.org/.
[11]
Victor, B. Learnable Programming. http://worrydream.com/LearnableProgramming/.
[12]
Yeh, T., Chang, T. H. and Miller, R. C. Sikuli: using GUI screenshots for search and automation. In Proc. UIST 2009, 183--192.
[13]
Yoshizaki, W., Sugiura, Y., Chiou, A. C., Hashimoto, S., Inami, M., Igarashi, T., Akazawa, Y., Kawachi, K., Kagami, S. and Mochimaru, M. An actuated physical puppet as an input device for controlling a digital manikin. In Proc. CHI 2011, 637--646.

Cited By

View all
  • (2021)Figaro: A Tabletop Authoring Environment for Human-Robot InteractionProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3446864(1-15)Online publication date: 6-May-2021
  • (2020)Rethinking programming “environment”: technical and social environment design toward convivial computingCompanion Proceedings of the 4th International Conference on Art, Science, and Engineering of Programming10.1145/3397537.3397544(149-157)Online publication date: 23-Mar-2020
  • (2018)DoppioProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174029(1-13)Online publication date: 21-Apr-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
April 2013
3550 pages
ISBN:9781450318990
DOI:10.1145/2470654
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. development environment
  2. inline photo
  3. posture data

Qualifiers

  • Research-article

Conference

CHI '13
Sponsor:

Acceptance Rates

CHI '13 Paper Acceptance Rate 392 of 1,963 submissions, 20%;
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)0
Reflects downloads up to 06 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Figaro: A Tabletop Authoring Environment for Human-Robot InteractionProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3446864(1-15)Online publication date: 6-May-2021
  • (2020)Rethinking programming “environment”: technical and social environment design toward convivial computingCompanion Proceedings of the 4th International Conference on Art, Science, and Engineering of Programming10.1145/3397537.3397544(149-157)Online publication date: 23-Mar-2020
  • (2018)DoppioProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174029(1-13)Online publication date: 21-Apr-2018
  • (2018)ReactileProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173773(1-13)Online publication date: 21-Apr-2018
  • (2017)User-Generated VariablesCompanion Proceedings of the 1st International Conference on the Art, Science, and Engineering of Programming10.1145/3079368.3079403(1-7)Online publication date: 3-Apr-2017
  • (2017)Grab ‘n’ Drop: User Configurable ToolglassesHuman-Computer Interaction – INTERACT 201710.1007/978-3-319-67687-6_21(315-334)Online publication date: 21-Sep-2017
  • (2016)Programming with Examples to Develop Data-Intensive User InterfacesComputer10.1109/MC.2016.21749:7(34-42)Online publication date: Jul-2016
  • (2014)VisionSketchProceedings of Graphics Interface 201410.5555/2619648.2619668(115-122)Online publication date: 7-May-2014
  • (2013)Integrated visual representations for programming with real-world input and outputAdjunct Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology10.1145/2508468.2508476(57-60)Online publication date: 8-Oct-2013

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media