The Twitter Engineering team has recently provided an insight into the evolution and scaling of the core technologies behind their in-house infrastructure that powers the social media service. Core lessons shared included: Architect beyond the original specifications; there is no such a thing as a “temporary change or workaround”; and documenting best practices has been a “force multiplier”.
Microsoft is carrying out experiments with synthetic DNA for digital data storage and has recently agreed to purchase ten million strands of DNA from genetics startup Twist Bioscience.
Massive reductions in cost for flash storage along with new technologies promise to dramatically change how well IT shops can satisfy what's expected of them in the cloud era. John Roese, CTO of EMC lays out a case for why companies need to adopt new technologies in order to out-perform their competitors.
At the London Microservice User Group July meetup, Kai Davenport presented a live demonstration of ClusterHQ’s Flocker v1.0 container data volume manager tool migrating a Docker storage volume between multiple containers running within a Docker Swarm.
The RICON conference in Las Vegas last week brought together scholarship from industry and academia in a venue targeted at sharing the latest innovations in tools, technologies and concepts in the field of Distributed Systems. In hosting the conference Basho Technologies positions themselves as thought leaders in a challenging field.
Microsoft has announced a new family of virtual machines called D-Series that offers better memory, CPU and faster I/O. With this Azure joins the club of elite IaaS providers with SSD backed storage.
When teams abandons an Object-Relational Mapper, ORM, it is often due to bad usage Jimmy Bogard stated in a recent presentation highlighting what he sees as incorrect and correct ways of using an ORM, including mapping and querying problems.
Twitter Engineering has released details about Manhattan, its real-time, multi-tenant distributed database.
Amazon Glacier is a new service from Amazon Web Services (AWS) that provides extremely low cost, durable storage for archive-ready data. This service targets organizations who want to retain large, infrequently-used data sets but don’t want to maintain a local storage infrastructure.
Does data have its own gravitational pull that attracts applications and services into its orbit? That was the proposal in 2010 by VMware’s Dave McCrory who has recently put some mathematical prowess beneath his principle. In his new website, DataGravity.org, McCrory outlines the formula for data gravity and asks the technical community for help in vetting and applying his formula.
Google today disclosed details of Compute Engine, an IaaS offering that runs Linux VMs on demand utilizing Google’s cloud infrastructure. Google Compute Engine (GCE) supports 1, 2, 4 and 8 virtual core VMs with 3.75GB RAM per virtual core
The ESE Toolkit provides C++ and C# class libraries that allow easier application development using the Windows Extensible Storage Engine (ESE), a high-performance data store built into Windows.
NoSQL data stores offer alternative data storage options for non-relational data types like document based, object graphs, and key-value pairs. Can a distributed cache be used as a NoSQL store? Greg Luck from Ehcache wrote about the similarities between a distributed cache and a NoSQL data store. InfoQ caught up with him to talk about this use case and its advantages and limitations.
Google Cloud Services has announced a new version of the App Engine SDK (1.5.5) -the frontend request deadline has been raised from 30 sec. to 60 sec., Python 2.7-, Cloud SQL, Cloud Storage and Prediction API are out of Code Labs, and Premier Accounts.
Eobject.org's open-source Java framework MetaModel implements a unified API for the access, exploration, and query of different datastores. Eobjects.org, both a website and an open source software organization dedicated to "the development of Open Source software related to Business Intelligence and Data Warehousing", has recently published version 1.5 of MetaModel.