A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

The name of Databricks' annual conference has gone from "Spark Summit" to "Spark + AI Summit" and now to "Data + AI Summit." The evolution of the event name tracks Databricks' own transition from the ...

Apache Spark was the pinnacle of advanced analytics just a few years ago. As the primary developer of this technology, Databricks Inc. has played a key role both in its commercial adoption, in the ...

Jenkins provides two different syntaxes for pipelines. When DevOps engineers write a Jenkins pipeline, they can choose between declarative and scripted. The differences between the two are both subtle ...

Since its launch in 2013, Databricks has relied on its ecosystem of partners, such as Fivetran, Rudderstack, and dbt, to provide tools for data preparation and loading. But now, at its annual Data + ...

ETL framework is the first to both automatically manage infrastructure and bring modern software engineering practices to data engineering, allowing data engineers and analysts to focus on ...

Databricks has unveiled a new extract, transform, load (ETL) framework, dubbed Delta Live Tables, which is now generally available across the Microsoft Azure, AWS and Google Cloud platforms. According ...

Databricks says new products LTAP and Lakehouse//RT unify transactional and analytical data for AI agents, delivering sub-100ms latency and no ETL pipelines.