Cited By
View all- Cai ZGavrilovska AAgarwala SEisenhauer GCooper BWidener PLofstead JKumar VWolf MSeshasayee BAbbasi HSchwan KMansour M(2009)AutoFlowAutonomic Computing10.1201/9781420009354.ch14(275-303)Online publication date: 18-Nov-2009
Addressing data compatibility on programmable network platforms
Pages 125 - 134
Abstract
Large-scale applications require the efficient exchange of data across their distributed components, including data from heterogeneous sources and to widely varying clients. Inherent to such data exchanges are (1) discrepancies among the data representations used by sources, clients, or intermediate application components (e.g., due to natural mismatches or due to dynamic component evolution), and (2) requirements to route, combine, or otherwise manipulate data as it is being transferred. As a result, there is an ever growing need for data conversion services, handled by stubs in application servers, by middleware or messaging services, by the operating system, or by the network. This paper's goal is to demonstrate and evaluate the ability of modern network processors to efficiently address data compatibility issues, when data is 'in transit' between application-level services. Toward this end, we present the design and implementation of a network-level execution environment that permits systems to dynamically deploy and configure application-level data conversion services 'into' the network infrastructure. Experimental results obtained with a prototype implementation on Intel's IXP2400 network processors include measurements of XML-like data format conversions implemented with efficient binary data formats.
References
[1]
S. Agarawalla, G. Eisenhauer, and K. Schwan. Lightweight Morphing Support for Evolving Middleware Data Exchanges in Distributed Applications. In Proc. of International Conference on Distributed Computing Systems, 2005.
[2]
Agere systems payloadplus network processors. http://www.agere.com.
[3]
D. S. Alexander, P. B. Menage, A. D. Keromytis, W. A. Arbaugh, K. G. Anagnostakis, and J. M. Smith. The Price of Safety in An Active Network. Journal of Communications and Networks (JCN), special issue on programmable switches and routers, 3(1):4--18, Mar. 2001.
[4]
G. Apostolopoulos, D. Aubespin, V. Peris, P. Pradhan, and D. Saha. Design, Implementation and Performance of a Content-Based Switch. In Proc. of IEEE INFOCOM 2000, volume~3, pages 1117--1126, Tel Aviv, Israel, Mar. 2000.
[5]
P. Bhargava, S. Krishnan, and R. Panigrahy. Efficient Multicast on a Terabit Router. In Hot Interconnects 2004, Stanford, CA, 2004.
[6]
F. Braun, J. Lockwood, and M. Waldvogel. Protocol wrappers for layered network packet processing in reconfigurable networks. IEEE Micro, 22(1):66--74, Jan./Feb. 2002.
[7]
F. Bustamante, G. Eisenhauer, K. Schwan, and P. Widener. Efficient Wire Formats for High Performance Computing. In Proc. of Supercomputing 2000, Dallas, TX, Nov. 2000.
[8]
Cell Processor Architecture Explained. http://www.blachford.info/computer/Cells/Cell0.html.
[9]
C. Clark, W. Lee, D. Schimmel, D. Contis, M. Kone, and A. Thomas. A Hardware Platform for Network Intrusion Detection and Prevention. In Proceedings of The 3rd Workshop on Network Processors and Applications (NP3), Madrid, Spain, 2004.
[10]
A. Gavrilovska, S. Kumar, S. Sundaragopalan, and K. Schwan. Advanced Networking Services for Distributed Multimedia Streaming Applications. Journal on Multimedia Tools and Applications. to appear.
[11]
A. Gavrilovska, S. Kumar, S. Sundaragopalan, and K. Schwan. Platform Overlays: Enabling In-Network Stream Processing in Large-scale Distributed Applications. In 15th Int'l Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'05), Skamania, WA, 2005.
[12]
A. Gavrilovska, K. Schwan, and S. Kumar. The Execution of Event-Action Rules on Programmable Network Processors. In 1st Workshop on Operating System and Architectural Support for the On-Demand IT Infrastructure (OASIS 2004), Boston, MA, 2004.
[13]
A. Gavrilovska, K. Schwan, O. Nordstrom, and H. Seifu. Network Processors as Building Blocks in Overlay Networks. In Proc. of Hot Interconnects 11, Stanford, CA, Aug. 2003.
[14]
A. Gavrilovska, K. Schwan, and V. Oleson. Practical Approach for Zero Downtime in an Operational Information System. In Proc. of 22nd International Conference on Distributed Computing Systems (ICDCS'02), Vienna, Austria, July 2002.
[15]
J. Guo, J. Yao, and L. Bhuyan. An Efficient Packet Scheduling Algorithm in Network Processors. In IEEE Infocom, 2005.
[16]
E. Kohler, R. Morris, B. Chen, J. Jannotti, and M. F. Kaashoek. The Click Modular Router, Aug. 2000.
[17]
S. Kumar, A. Gavrilovska, K. Schwan, and S. Sundaragopalan. C-Core: Using Communication Cores for High Performance Network Services. In Proc. of 4th Int'l Conf. on Network Computing and Applications (IEEE NCA05), Cambridge, MA, 2005.
[18]
V. Kumar, B. F. Cooper, Z. Cai, G. Eisenhauer, and K. Schwan. Resource-Aware Distributed Stream Management using Dynamic Overlays. In Proc. of 25th IEEE International Conference on Distributed Computing Systems (ICDCS-2005), Columbus, OH, 2005.
[19]
V. Kumar, B. F. Cooper, and K. Schwan. Distributed Stream Management using Utility-Driven Seld-Adaptive Middleware. In Proc. of 2nd IEEE International Conference on Autonomic Computing (ICAC 2005), Seattle, WA, 2005.
[20]
Network for earthquake engineering simulation. www.nees.org.
[21]
V. Oleson, K. Schwan, G. Eisenhauer, B. Plale, C. Pu, and D. Amin. Operational Information Systems - An Example from the Airline Industry. In First Workshop on Industrial Experiences with Systems Software (WIESS), Oct. 2000.
[22]
M. Otey, R. Noronha, S. Parthasarathy, and D. K. Panda. NIC-based Intrusion Detection: A Feasibility Study. In Proceedings of the Workshop on Data Mining for Cyber Threat Analysis, 2002.
[23]
V. Pai, A. Cox, V. Pai, and W. Zwaenepoel. A Flexible and Efficient APplication Programming Interface (API) for a Customizable Proxy Cache. In Proc. of 4th USENIX Symposium on Internet Technologies and Systems, Seattle, WA, 2003.
[24]
Path 1 Network Technologies. Professional Digital Video Gateways for the Broadcaster and Multi-Service Operator: Delivered by Path 1 Network Technologies* and Intel® Network Processors. White Paper, 2002. http://www.intel.com/design/network/casestudies/path1.htm.
[25]
B. Raman and R. Katz. An Architecture for Highly Available Wide-Area Service Composition. Computer Communications Journal, special issue on "Recent Advances in Communication Networking", May 2003.
[26]
G. Regnier, D. Minturn, G. McAlpine, V. Saletore, and A. Foong. ETA: Experience with an Intel Xeon Processor as a Packet Processing Engine. In Proc. of Symposium of Hot Interconnects, Stanford, CA, 2003.
[27]
S. Roy, J. Ankcorn, and S. Wee. An Architecture for Componentized, Network-Based Media Services. In Proc. of IEEE International Conference on Multimedia and Expo, July 2003.
[28]
Y. Saito, B. Bershad, and H. Levy. Manageability, Availability, and Performance in Porcupine: A Highly Scalable Cluster-based Mail Service. In Proc of 17th ACM SOSP, OS Review, Kiawah Island Resort, SC, Dec. 1999.
[29]
P. Shivam, P. Wyckoff, and D. Panda. Can User Level Protocols Take Advantage of Multi-CPU NICs? In Int'l Parallel and Distributed Processing Symposium (IPDPS '02), 2002.
[30]
T. Spalink, S. Karlin, L. Peterson, and Y. Gottlieb. Building a Robust Software-Based Router Using Network Processors. In Proc. of 18th SOSP'01, Chateau Lake Louise, Banff, Canada, Oct. 2001.
[31]
W. Thies, M. Karczmarek, and S. Amarasinghe. StreamIt: A Language for Streaming Applications. In International Conference on Compiler Construction (ICCC'02), Grenoble, France, Apr. 2002.
[32]
M. Wolf, Z. Cai, W. Huang, and K. Schwan. Smart Pointers: Personalized Scientific Data Portals in Your Hand. In Proc. of Supercomputing 2002, Nov. 2002.
[33]
Y. Xie, D. O'Hallaron, and M. Reiter. A Secure Distributed Search System. In Proc. of 11th Symposium on High Performance Distributed Systems (HPDC-11), Edinburgh, Scotland, 2002.
[34]
K. Yocum and J. Chase. Payload Caching: High-Speed Data Forwarding for Network Intermediaries. In Proc. of USENIX Technical Conference (USENIX'01), Boston, Massachusetts, June 2001.
[35]
X. Zhang, L. N. Bhuyan, and W. chun Feng. Anatomy of UDP and M-VIA for Cluster Communications. Journal on Parallel and Distributed Computing, Special Issue on Cluster and Grid Computing, 2005.
Index Terms
- Addressing data compatibility on programmable network platforms
Recommendations
Advanced networking services for distributed multimedia streaming applications
AbstractIncreased network speeds coupled with new services delivered via the Internet have increased the demand for intelligence and flexibility in network systems. This paper argues that both can be provided by new hardware platforms comprised of ...
Can infopipes facilitate reuse in a traffic application?
OOPSLA '05: Companion to the 20th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applicationsInfopipes are building blocks for creating data streaming applications, and it is claimed that Infopipes facilitate code reuse. To evaluate this claim, we have built a significant traffic application in Smalltalk using Infopipes. In this paper and ...
Addressing network heterogeneity in pervasive application environments
InterSense '06: Proceedings of the first international conference on Integrated internet ad hoc and sensor networksPervasive computing applications typically involve rich interactions and heterogeneous network types; e.g. involving the collation of data from a sensor network into a replicated repository in a fixed network. Although the middleware approach has been ...
Comments
Information & Contributors
Information
Published In
October 2005
230 pages
ISBN:1595930825
DOI:10.1145/1095890
- General Chair:
- Alan Berenbaum,
- Program Chairs:
- Kai Li,
- Jonathan Turner
Copyright © 2005 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 October 2005
Check for updates
Author Tags
Qualifiers
- Article
Conference
ANCS05: Symposium on Architecture for Networking and Communications Systems 2005
October 26 - 28, 2005
NJ, Princeton, USA
Acceptance Rates
Overall Acceptance Rate 88 of 314 submissions, 28%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 286Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
Cited By
View all- Cai ZGavrilovska AAgarwala SEisenhauer GCooper BWidener PLofstead JKumar VWolf MSeshasayee BAbbasi HSchwan KMansour M(2009)AutoFlowAutonomic Computing10.1201/9781420009354.ch14(275-303)Online publication date: 18-Nov-2009
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in