Announcing General Availability of Databricks Feature Store
Today, we are thrilled to announce that Databricks Feature Store is generally available (GA)! In this blog post, we explore how Databricks Feature Store, the first feature store co-designed with an...
View ArticleBuild Data and ML Pipelines More Easily With Databricks and Apache Airflow
We are excited to announce a series of enhancements in Apache Airflow’s support for Databricks. These new features make it easy to build robust data and machine learning (ML) pipelines in the popular...
View ArticleA Clear Vision and Path to Execution: Why I Joined Databricks
I recently had the opportunity to join Databricks as SVP of Corporate Development and Product Partnerships and wanted to share some perspective on why I’m thrilled to embark on such an incredible...
View ArticleSpeed Up Streaming Queries With Asynchronous State Checkpointing
Background / Motivation Stateful streaming is becoming more prevalent as stakeholders make increasingly sophisticated demands on greater volumes of data. The tradeoff, however, is that the...
View ArticleMonitoring Your Databricks Lakehouse Platform with Audit Logs
This blog is part two of our Admin Essentials series, where we’ll focus on topics that are important to those managing and maintaining Databricks environments. In this series we’ll share best practices...
View ArticleHigh Scale Geospatial Processing With Mosaic
Breaking through the scale barrier (discussing existing challenges) At Databricks, we are hyper-focused on supporting users along their data modernization journeys. A growing number of our customers...
View ArticleIntroduction to Analyzing Crypto Data Using Databricks
The market capitalization of cryptocurrencies increased from $17 billion in 2017 to $2.25 trillion in 2021. That’s over a 13,000% ROI in a short span of 5 years! Even with this growth, cryptocurrencies...
View ArticleWhat to Expect At Data + AI Summit: Open source, technical keynotes and more!
Data + AI Summit, the world’s largest data and AI conference, returns June 27-30 2022, and we’re thrilled to say that this year, you can attend it in person in San Francisco (or online for FREE from...
View ArticleWhy CEOs Choose Databricks
“This initiative to modernize our data infrastructure, which includes a multi-year agreement with Databricks to unlock data at scale, will further enhance our analytical capabilities and deliver richer...
View ArticleHow Audantic Uses Databricks Delta Live Tables to Increase Productivity for...
This is a collaborative post from Audantic and Databricks. We’d like to thank co-author Joel Lowery, Chief Information Officer – Audantic, for his contribution. At Audantic we provide data and...
View ArticleStreaming Windows Event Logs into the Cybersecurity Lakehouse
Streaming windows events into the Cybersecurity Lakehouse Enterprise customers often ask, what is the easiest and simplest way to send Windows endpoint logs into Databricks in real time, perform ETL...
View ArticleSave Time and Money on Data and ML Workflows With “Repair and Rerun”
Databricks Jobs is the fully managed orchestrator for all your data, analytics, and AI. It empowers any user to easily create and run workflows with multiple tasks and define dependencies between...
View ArticleHow illimity Bank Built a Disaster Recovery Strategy on the Lakehouse
The rising complexity of financial activities, the widespread use of information and communications technology, and new risk scenarios all necessitate increased effort by Financial Services Industry...
View ArticleBuilding a Lakehouse Faster on AWS With Databricks: Announcing Our New...
As the need for data and AI applications accelerates, customers need a faster way to get started with their data lakehouse. The Databricks Lakehouse Platform was built to be simple and accessible,...
View ArticleIntroducing Databricks Workflows
Today we are excited to introduce Databricks Workflows, the fully-managed orchestration service that is deeply integrated with the Databricks Lakehouse Platform. Workflows enables data engineers, data...
View ArticleReduce Time to Decision With the Databricks Lakehouse Platform and Latest...
This is a collaborative post from Databricks and Intel. We thank Swastik Chakroborty,Regional Technical Sales Director-APJ, and Lakshman Chari, Cloud ISV Partner Manager, of Intel, for their...
View ArticleBuild Scalable Real-time Applications on the Lakehouse Using Confluent &...
This is a collaborative post between Confluent and Databricks. We thank Paul Earsy Staff Solutions Engineer at Confluent, for their contributions. In this blog we’ll be highlighting the simplified...
View ArticleHow I Built A Streaming Analytics App With SQL and Delta Live Tables
Planning my journey I’d like to take you through the journey of how I used Databricks’ recently launched Delta Live Tables product to build an end-to-end analytics application using real-time data with...
View ArticleDay In the Life of A Customer Success Engineer
At Databricks, Bricksters operate with a unified goal to make our customers successful in every part of their data strategy. This objective dictates every aspect of our organization – from engineering...
View ArticleFive Simple Steps for Implementing a Star Schema in Databricks With Delta Lake
Most data warehouse developers are very familiar with the ever-present star schema. Introduced by Ralph Kimball in the 1990s, a star schema is used to denormalize business data into dimensions (like...
View Article