InfoQ

News

Presentation: Pipes and Y! Query Language

Posted by Abel Avram on Feb 27, 2009

Community
Architecture
Topics
Cloud Computing ,
Web 2.0 ,
Web Services
Tags
Yahoo!
Share Share |

In this presentation filmed during QCon SF 2008,  Jonathan Trevor presents two Yahoo! technologies: Pipes and Y! Query Language (YQL). Both technologies can be used to process data obtained from various sources, but while Pipes is limited to Yahoo web services, YQL can process many types of data.

Watch: Pipes and Y! Query Language (53 min.)

Yahoo Pipes uses a visual tool to specify a series of pipes through which input data flows and is filtered and processed in various ways. There are many data sources like personal data, CSV, feeds, web pages, services like Flick, Yahoo Search, and others. Processing is done through operators like: Filter, Loop, Regex, Sort, Union, and others. The result is shown in a web page, a feed, or given to an application. The service runs in Yahoo’s cloud, is free and does not offer security protection for sensitive data since anyone can copy and run a pipe made by someone else.

YQL is similar to Pipes but uses a textual textual language and can process both Yahoo web services data and any structured data with an URL. It has an SQL like syntax with three statements: SELECT, SHOW, DESC. This approach is more powerful and the applications created are protected.

Trevor explains both technologies, how they have been developed, their current status and shows demo examples.

RelatedVendorContent

XML Threat Model for REST, SOA and Web 2.0 White Paper

Security Appliance Showdown- Intel Expressway vs IBM Datapower

Taking Control of the Cloud: Addressing Security, Visibility, and Governance

Free online Flex training

Why Business Rules? A Case for Business Users of Information Technology

No comments

Watch Thread Reply

Educational Content

Reformulating the Product Delivery Process

Israel Gat, Erik Huddleston and Stephen Chin present how Inovis realized a higher product throughput by using three unconventional Kanban practices and a Lean Release Management tool called APROPOS.

Enterprise Mashups: Why Do I Care?

Ross Mason discusses how to use enterprise mashups by applying a number of patterns, such as FeedFactory, Super Search, and Pipeline, in order to find new ways to benefit from existing enterprise data

Command-Query Responsibility Segregation

Udi Dahan discusses the Command Query Responsibility Segregation (CQRS) pattern, detailing on queries and commands, what they are and how they should be used in an asynchronous programming environment

The Story of a Project

Olivier Mallassi shares a story of a typical software development project, some typical problems and what he learned from Tom Demarco about addressing those problems, and an alternative story.

Living and Working with Aging Software

Ralph Johnson discusses principles, practices and tools relating to software development starting from already existing code which needs refactoring, maintenance, and sometimes architectural change.

IIBA Debate on the Role of the Analyst in Agile Projects

At a recent IIBA New Zealand members event Shane and Pete debated the role of the business analyst on Agile projects. They looked at the importance of analysis on projects and how the role changes.

The Craftsman Learns ... or Learning the Craft

Pete Goodliffe provokes his listeners to keep learning, offering advice on how to approach learning, what is valuable and what can be ignored, how to deal with new things, having a healthy attitude.

Finding an Agile Employer

If you want a job in Agile software development, using a framework like Scrum, you need a plan of action that spans all three phases of your job search: preparation, interviewing, and assessment.