It was a Virtual Summer!
Our Summer 2020 Intern Olympics Kick-Off Event This summer Databricks hosted a completely virtual intern program, in which interns around the world worked on projects to help data teams solve the...
View ArticleDiving Into Delta Lake: DML Internals (Update, Delete, Merge)
Diving Into Delta Lake: DML Internals (Update, Delete, Merge) In previous blogs Diving Into Delta Lake: Unpacking The Transaction Log and Diving Into Delta Lake: Schema Enforcement & Evolution, we...
View ArticleData + AI Summit Europe Goes Virtual With a Data-Centric Agenda
Technical conferences evolve over time. They expand beyond their initial focus, adding new technologies, attracting new attendees and broadening their range of sessions and speakers. Formerly known as...
View ArticleDetecting Criminals and Nation States through DNS Analytics
You are a security practitioner, a data scientist or a security data engineer; you’ve seen the Large Scale Threat Detection and Response talk with Databricks . But you’re wondering, “how can I try...
View ArticleMeasuring Advertising Effectiveness with Sales Forecasting and Attributing
Click below to download the notebooks for this solution accelerator: Campaign Effectiveness — ETL Campaign Effectiveness — Machine Learning How do you connect the impact of marketing and your ad spend...
View ArticleFlipp Presents Their Lakehouse Architecture with Delta Lake at Tableau...
Databricks at the Tableau Conference 2020 Our session Our page The Tableau Conference 2020 begins tomorrow, with our session Databricks: Data Science & Analytics for Data Lakes at 1:30 PM PDT. In...
View ArticleAnalyzing Algorand Blockchain Data with Databricks Delta
Algorand is a public, decentralized blockchain system that uses a proof of stake consensus protocol. It is fast and energy-efficient, with a transaction commit time under 5 seconds and throughput of...
View ArticleIntegrating large-scale Genomic Variation and Annotation Data with Glow
Genomic annotations augment variant data by providing context for each change in the genome. For example, annotations help answer questions like does this mutation cause a change in the protein-coding...
View ArticleUsing MLOps with MLflow and Azure
The blog contains code examples in Azure Databricks, Azure DevOps and plain Python. Please note that much of the code depends on being inside an Azure environment and will not work in the Databricks...
View ArticleAzure Databricks in Public Preview for the Azure China Region
We are excited to announce that Azure Databricks is now available in public preview for Microsoft’s Azure China region, enabling new data and AI use cases with fast, reliable and scalable data...
View ArticleBuilding the Latinx Network and Celebrating Our Heritage
Virtual performance from Mariachi Sol Mixteco during the Cafe con Leche event This past spring, we launched our Latinx Network Employee Resource Group with a lot of excitement. We co-founded this...
View ArticleAnnouncing Summit Keynotes: Malcolm Gladwell, Dr. Kira Radinsky, Jeremy...
In less than a month, we kick off the inaugural Data + AI Summit Europe, with free general admission and expanding upon the Spark + AI Summit to cover all things data — analytics, science, engineering...
View ArticleAnnouncing Single-Node Clusters on Databricks
Databricks is used by data teams to solve the world’s toughest problems. This can involve running large-scale data processing jobs to extract, transform, and analyze data. However, it often also...
View ArticleDetecting At-risk Patients with Real World Data
With the rise of low cost genome sequencing and AI-enabled medical imaging, there has been substantial interest in precision medicine. In precision medicine, we aim to use data and AI to come up with...
View ArticleFaster SQL: Adaptive Query Execution in Databricks
Earlier this year, Databricks wrote a blog on the whole new Adaptive Query Execution framework in Spark 3.0 and Databricks Runtime 7.0. The blog has sparked a great amount of interest and discussions...
View ArticleReputation Risk: Improving Business Competency and Nurturing Happy Customers...
Why reputation risk matters? When it comes to the term “risk management”, Financial Service Institutions (FSI) have seen guidance and frameworks around capital requirements from Basel standards. But,...
View ArticleTen Simple Databricks Notebook Tips & Tricks for Data Scientists
Often, small things make a huge difference, hence the adage that “some of the best ideas are simple!” Over the course of a few releases this year, and in our efforts to make Databricks simple, we have...
View ArticleAnnouncing Databricks on AWS Quick Starts to Deploy in Under 15 minutes
We are pleased to announce the availability of Databricks on the AWS Quick Starts program. With this release, our customers can easily deploy the Databricks Unified Data Analytics Platform on Amazon...
View ArticleAnnouncing Azure Databricks Power BI Connector (Public Preview)
Databricks and Microsoft Power BI customers will be delighted to know that an enhanced Azure Databricks PowerBI connector is now natively integrated into Power BI Desktop (2.85.681.0 and above ) and...
View ArticleQuickly Deploy, Test, and Manage ML Models as REST Endpoints with MLflow...
MLflow Model Registry now provides turnkey model serving for dashboarding and real-time inference, including code snippets for tests, controls, and automation. MLflow Model Serving on Databricks...
View Article