How Databricks IAM Credential Passthrough Solves Common Data Authorization...
In our first blog post, we introduced Databricks IAM Credential Passthrough as a secure, convenient way for customers to manage access to their data. In this post, we’ll take a closer look at how...
View ArticleAutomated Hyperparameter Tuning, Scaling and Tracking: On-Demand Webinar and...
Try this notebook in Databricks On June 20th, our team hosted a live webinar—Automated Hyperparameter Tuning, Scaling and Tracking on Databricks—with Joseph Bradley, Software Engineer, and Yifan Cao,...
View ArticleAnnouncing the MLflow 1.1 Release
We’re excited to announce today the release of MLflow 1.1. In this release, we’ve focused on fleshing out the tracking component of MLflow and improving visualization components in the UI. Some of the...
View ArticleFast Parallel Testing at Databricks with Bazel
The Databricks Developer Tools team recently completed a project to greatly speed up the pull-request (PR) validation workflows for many of our engineers: by massively parallelizing our tests,...
View ArticleAnnouncing Databricks Runtime 5.5 with Conda (Beta)
Databricks is pleased to announce the release of Databricks Runtime 5.5 with Conda (Beta). We introduced Databricks Runtime 5.4 with Conda (Beta), with the goal of making Python library and...
View ArticleNetwork performance regressions from TCP SACK vulnerability fixes
On June 17, three vulnerabilities in Linux’s networking stack were published. The most severe one could allow remote attackers to impact the system’s availability. We believe in offering the most...
View ArticleAnnouncing the Delta Lake 0.3.0 Release
We are excited to announce the release of Delta Lake 0.3.0 which introduces new programmatic APIs for manipulating and managing data in Delta tables. The key features in this release are: Scala/Java...
View ArticleUsing ML and Azure to improve Customer Lifetime Value: On-Demand Webinar and...
On July 18th, we hosted a live webinar —Using ML and Azure to improve customer lifetime value – with Rob Saker, Industry Leader – Retail Industry, Colby Ford, Associate Faulty – School of Data...
View ArticleCelebrating Diversity with Databricks AMS at Pride 2019
At Databricks, we are proud to celebrate diversity. We believe that the core values of Databricks are found in Bricksters of all backgrounds: Team work makes the dream work, Be customer obsessed, Let...
View ArticleNew cost savings option for Azure Databricks with DBU pre-purchase
The rapid adoption of Azure Databricks through our strategic partnership with Microsoft has been remarkable, and it’s proven to be a compelling service for our customers’ big data, analytics and...
View ArticleBrickster Spotlight: Meet Greg From Intern to Senior Software Engineer
At Databricks, we’re committed to learning and development at every level, so it’s important to our teams that we recruit and develop our next generation of Databricks leaders. Our interns are...
View ArticleDeep Learning on Medical Images at Population Scale: On-Demand Webinar and...
On June 26th, we hosted a live webinar — Deep Learning on Medical Images at Population-scale— with members of the data science and engineering teams from Human Longevity Inc (HLI), a leader in medical...
View ArticleProductionizing Machine Learning with Delta Lake
Try out this notebook series in Databricks – part 1 (Delta Lake), part 2 (Delta Lake + ML) For many data scientists, the process of building and tuning machine learning models is only a small portion...
View ArticleHow (Not) To Scale Deep Learning in 6 Easy Steps
Introduction: The Problem Deep learning sometimes seems like sorcery. Its state-of-the-art applications are at times delightful and at times disturbing. The tools that achieve these results are,...
View ArticleMLflow, TensorFlow, and an Open Source Show
This summer, I interned on the ML Platform team. I worked on MLflow, an open-source machine learning management framework. This blog post details the projects I worked on, and my experience at...
View ArticleAutoML on Databricks: Augmenting Data Science from Data Prep to...
Thousands of data science jobs are going unfilled today as global demand for the talent greatly outstrips supply. Every day, businesses pay the price of the data scientist shortage in missed...
View ArticleDiving Into Delta Lake: Unpacking The Transaction Log
The transaction log is key to understanding Delta Lake because it is the common thread that runs through many of its most important features, including ACID transactions, scalable metadata handling,...
View ArticleGuest Blog: How Virgin Hyperloop One reduced processing time from hours to...
At Virgin Hyperloop One, we work on making Hyperloop a reality, so we can move passengers and cargo at airline speeds but at a fraction of the cost of air travel. In order to build a commercially...
View ArticleBuilding Foot-Traffic Insights Dataset
Where should I build my next coffee shop? Businesses want to understand both the physical world around them and how people interact with the physical world. Where should I build my next coffee shop?...
View ArticleGuest Blog: Using Databricks, MLflow, and Amazon SageMaker at Brandless to...
This is a guest blog from Adam Barnhard, Head of Data at Brandless, Inc., and Bing Liang, Data Scientist at Brandless, Inc. Launched in July 2017, Brandless makes hundreds of high-quality items,...
View Article