InfoQ Homepage Google BigQuery Content on InfoQ
-
Google BigQuery Introduces Vector Search
Google recently announced that BigQuery now supports vector search. The new functionality enables vector similarity search required by data and AI use cases such as semantic search, similarity detection, and retrieval-augmented generation (RAG) with a large language model (LLM).
-
Cloud Monitoring Metrics in BigQuery Provides Improved GKE Cost Analysis
Google brings Cloud Monitoring metrics in BigQuery as a new capability in preview to combine billing data with resource utilization metrics. The combination allows users to perform detailed cost analyses in BigQuery. In addition, the company provides an out-of-the-box Looker Studio template that combines Cloud Monitoring and detailed billing metrics for Google Kubernetes Engine (GKE).
-
Google Releases Hive-BigQuery Open-Source Connector
Google recently announced the general availability of the Hive-BigQuery Connector, simplifying integration and migrations between Apache Hive and Google BigQuery. The open-source connector is a Hive storage handler that enables Hive to interact with BigQuery's storage layer.
-
Fitbit Health Solution and Google Cloud Introduce Device Connect for Fitbit
Fitbit Health Solutions and Google Cloud have recently announced the release of Device Connect for Fitbit, which will provide healthcare and life sciences enterprises with accelerated analytics and insights to help people live healthier lives.
-
Google Introduces Zero-ETL Approach to Analytics on Bigtable Data Using BigQuery
Recently, Google announced the general availability of Bigtable federated queries, with BigQuery allowing customers to query data residing in Bigtable via BigQuery faster. Moreover, the querying is without moving or copying the data in all Google Cloud regions with increased federated query concurrency limits, closing the longstanding gap between operational data and analytics.
-
Write Directly from Cloud Pub/Sub to BigQuery with BigQuery Subscription
Recently Google introduced a new type of Pub/Sub subscription called a “BigQuery subscription,” allowing to write directly from Cloud Pub/Sub to BigQuery. The company claims that this new extract, load, and transform (ELT) path will be able to simplify event-driven architectures.
-
Google's BigQuery Introduces Column-Level Encryption Functions and Dynamic Masking of Information
Google recently released new features for its SaaS data warehouse BigQuery which include column level encryption functions and dynamic masking of information. Specifically, dynamic masking of information can be used for real-time transactions whereas column level encryption provides additional security for data at rest or in motion where real-time usability is not required.
-
From Natural Language Queries to Insights: GCP BigQuery Data QnA Usage in Twitter
The Twitter engineering team has shared architectural details of their Qurious data insights platform and its advantages for real-time analysis. Designed for internal business customers, the platform allows users to analyze Twitter’s BigQuery data using natural language queries and create dashboards.
-
Google Logica Aims to Make SQL Queries More Reusable and Readable
Logica is a Datalog-like declarative logic programming language for database querying. It supports the creation of reusable abstractions to build complex queries and compiles to SQL, thus making it suitable for wide application.
-
Google Releases Enterprise Database Options, Targets SQL Server Customers
In a recent blog post, Google announced enhancements to their existing Google Cloud Platform (GCP) database investments, including Cloud SQL for Microsoft SQL Server in alpha, Federated queries from BigQuery to Cloud SQL and Elastic Cloud on GCP being available in Japan and soon to be released in Sydney, Australia.
-
Google BigQuery Adds New Public Datasets
Stack Overflow recently announced making its dataset available through Google’s BigQuery. Using regular SQL statements, developers can query the full set of Stack Overflow data including posts, votes, tags, and badges. In this article we explore datasets that are available through Google's BigQuery platform.
-
Spotify Moves Infrastructure and Data Services to Google Cloud Platform
On February 23rd, 2016 Spotify announced it is moving its technical infrastructure and data services from its existing owned and leased data centers to Google Cloud Platform.
-
Google Launches Cloud Datalab Beta
At the recent Google Cloud Platform Next experience event in Paris, Google announced a beta data visualization service called Cloud Datalab. Cloud Datalab allows developers to explore and analyze their data through an interactive web-browser experience.
-
VMware Will Offer Google Cloud Services and Rackspace Offers vCloud
Cloud vendors are combining their strengths to provide extra services for their customers. The latest developments include VMware offering Google BigQuery and Rackspace building private dedicate vCloud’s.
-
Apache Drill Included in MapR Latest Distribution Release
MapR recently announced including Apache Drill in its latest release of MapR distribution. Apache Drill is the open source version of Google’s Dremel. Dremel is the infrastructure on which BigQuery is based upon. Drill is offering a low latency SQL-on-Hadoop interface. While this puts it in the same space as several other technologies around Hadoop, Drill has some unique characteristics setting it