Personalized Notifications at Twitter
Gary Lam, staff engineer at Twitter, spoke about personalized notifications at QCon London 2017. This involved giving a high-level overview of their personalization and recommendations algorithms, and an explanation of how they work at scale despite the large volumes of data and bi-modal nature of Twitter.
Real-Time Notifications at Twitter
Saurabh Pathak, engineering manager at Twitter, discussed the site's notification architecture at QCon London 2017. This included highlighting key challenges which are unique to Twitter, such as the bimodal nature of the social network, dealing with spikes, and the requirement to serve notifications in real time.
The Infrastructure Behind Twitter: Scaling Networking, Storage and Provisioning
The Twitter Engineering team has recently provided an insight into the evolution and scaling of the core technologies behind their in-house infrastructure that powers the social media service. Core lessons shared included: Architect beyond the original specifications; there is no such a thing as a “temporary change or workaround”; and documenting best practices has been a “force multiplier”.
Twitter Sells Fabric to Google
Google has bought Twitter Fabric and will integrate the platform into Firebase.
Funnel Analysis at Twitter for Improving User Engagement
Funnel analysis is used to analyze a sequence of events to help with user engagement on a website or a mobile application. Data Science team at Twitter uses this concept to learn how users interact with user interfaces during sign up or tweeting for improving user engagement with Twitter.
Facebook's and Twitter's SDKs for Apple tvOS Enable Onboarding and Analytics
Facebook and Twitter have released SDKs for Apple tvOS to provide support for onboarding, user verification, and analytics.
DistributedLog at Twitter for High Performance Logging
Twitter is using replicated logs for high performance data collection and analysis of its systems. DistributedLog is the system developed at Twitter for this purpose. Twitter has developed a distributed key-value database, Manhattan. Manhattan can trade consistency for latency in reads following the eventually consistent data model. We examine Twitter's design and tradeoffs for DistributedLog.
Twitter Diffy Spots Bugs in Services by Comparing the Responses
Twitter has open sourced Diffy, an automated testing tool used in production for discovering potential bugs in new code running on Apache Trift and other HTTP-based services.
Twitter Has Replaced Storm with Heron
Twitter has replaced Storm with Heron which provides up to 14 times more throughput and up to 10 times less latency on a word count topology, and helped them reduce the needed hardware to a third.
Twitter Unveils Digits Login for Web
Twitter has officially released Digits Login for Web, the latest interaction of Digits that extends the SMS-based login system to mobile app's sites powered by Digits.
Twitter Open Sources R Programming Anomaly and Breakout Detection Packages
Twitter recently announced open sourcing an anomaly detection package in R. Anomaly detection is a major study field as it can denote different things. A major spike in followers or favorites around a topic can happen because something major is happening and this may be something that needs to be broadcast around the network. But this same spike can also happen because of bots and spammers...
Web Summit 2014 Day Two Review
Yesterday concluded the second day of the Web Summit in Dublin, Ireland. We see what happened and what is new from last day at the event.
LinkedIn and Twitter Contribute Machine Learning Libraries to Open Source
Twitter’s engineering group, known for various contributions to open source from streaming MapReduce to front-end framework Bootstrap recently announced open sourcing an algorithm that can efficiently recommend content. LinkedIn also open sourced a Machine Learning library of its own, ml-ease. In this article we present the algorithms and what they mean for the open source community.
Twitter's Manhattan: A Real-time, Multi-tenant Distributed Database
Twitter Engineering has released details about Manhattan, its real-time, multi-tenant distributed database.
Facebook, Google, LinkedIn, and Twitter Want to Make Sure that MySQL Is “Web-Scale”
Facebook, Google, LinkedIn, and Twitter have decided to make sure that a relational databases is “web-scale”, so they have put their efforts behind WebScaleSQL, a branch of MySQL 5.6 Community Edition.
