BT
x Your opinion matters! Please fill in the InfoQ Survey about your reading habits!

Google Open-Sources FlatBuffers: Efficient, Cross-Platform, Serialization Library

by Roopesh Shenoy on Jun 18, 2014 |

The Google "Fun Propulsion Labs" team has recently open-sourced FlatBuffers. Built especially to support performance needs of game developers, FlatBuffers stores serialized data in buffers which can be either stored in files or transferred across the network as-is, without any parsing overhead.

Some key features of FlatBuffers -

  • Access to serialized data without packing/unpacking
  • Memory efficiency and speed - only memory required to access data is that of the buffer; 0 additional memory required.
  • Flexibility - forwards and backwards compatibility via optional fields
  • Tiny Code footprint
  • Strongly Typed - errors caught at compile-time instead of run-time
  • Convenience - Terse code via generated C++ headers. Optional functionality to parse schemas and JSON-like representations at runtime efficiently if needed (faster and more memory efficient than other JSON parsers)
  • Cross-Platform: Written in C++ with no dependency outside of STL, so can be used on any platform that has a C++ compiler. Currently the project includes methods to build and examples to use the library for Android, Linux, Windows and OSX.

The advantage of FlatBuffers over alternative solutions such as Protocol buffers or JSON parsing, is that there is less overhead, especially due to the lack of parsing.

Using FlatBuffers in C++ involves following steps -

There are still a few rough edges, as evident by early discussions on the discussion group. Support for Java is also experimental at this stage. C# support is one of the most popular requests, and might get supported in the next release.

You can learn more about FlatBuffers by referring the documentation

Another project that avoids encoding/decoding step to achieve performance benefits and is worth a look is Cap'n Proto

 

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Tell us what you think

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

HackerNews discussion by Roopesh Shenoy

There's also an interesting discussion on hackernews on flatbuffers, involving designers of both Flatbuffers and Cap'n Proto. Definitely worth a read.

news.ycombinator.com/item?id=7901991

A lot of serialize format! by Narushima Hironori

Pretty similar messagepack. But a little faster and NO Json compatibility. Very difficult choice best option messagepack/Json/FlatBuffers some likes. A lot of serialize format!

not convinced by Binoj Antony

Let's see the implementations in java and c#, then some performance benchmarks, till then it's .....

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

3 Discuss

Educational Content

General Feedback
Bugs
Advertising
Editorial
InfoQ.com and all content copyright © 2006-2014 C4Media Inc. InfoQ.com hosted at Contegix, the best ISP we've ever worked with.
Privacy policy
BT