c/machine-learning
Models, data, training and evaluation.
What is Databricks Databricks is an integrated cloud platform for data processing and artificial intelligence. It is built on Apache Spark and adds proprietary components (Delta Lake, Unity Catalog, MLflow) to create a unified lakehouse: raw data, transformed data, and AI models coexist in the same environment. Key features include collaborative notebooks, job scheduler, data engineering, data science, machine learning, and data governance. Getting started Registration – visit https://databricks.com and choose Free Edition (free trial). Enter a business or personal email and confirm the account. Workspace creation – on first login, the system automatically creates a workspace with a managed cluster. Notebook – from the Workspace menu, create a new notebook (Python, Scala, SQL, or R). Data upload – use the Data panel to upload a CSV file or connect an S3/ADLS bucket. Running a query – in a SQL notebook, write SELECT FROM mytable LIMIT 10; and press Run. Saving results – export the result to Delta Lake or a Parquet file for the next step in the workflow. Concrete use cases Pricing and plans Source: official pricing page, verified by Penzai on 11/13/2026. Prices may change: always check before purchasing. Pros and cons Pros Automatic scalability on cloud (AWS, Azure, GCP). Integrated ecosystem (Spark, Delta Lake, MLflow, Unity Catalog). Real-time collaboration on notebooks. Governance and security at the catalog level. Cons Variable cost tied to compute consumption; difficult to predict expenses without monitoring. Dependency on the chosen cloud provider. Learning curve for those unfamiliar with Spark. Not ideal for very light workloads or on-premise environments without cloud. When NOT to use it Projects with extremely limited budget and minimal workloads. Applications requiring ultra-low latency (e.g., high-frequency trading). Situations where all data must remain on-premise for regulatory reasons. Alternatives There are alternative solutions for data and AI management; some are better suited for on-premise contexts or fixed costs. - Tableau AI by Salesforce: Data analysis and visualization with Salesforce AI features. Hex by Hex: Notebooks and data analysis apps with AI agent. Julius AI by Julius: Data analysis and charts by asking in natural language. Dataiku by Dataiku: Enterprise platform for data science, AI, and agents. Integrations and APIs Apache Spark (core engine) – native support for Python, Scala, SQL, R. Delta Lake – ACID storage for structured and semi-structured data. MLflow – tracking, packaging, and deployment of models. Unity Catalog – centralized governance for data and AI. REST API – management of workspace, clusters, jobs, and secret scopes. JDBC/ODBC – connection from BI tools (Tableau, Power BI, Looker). Kafka, Kinesis, Event Hubs – streaming ingestion. For integrations not listed or newer versions, consult the official Databricks documentation. GitHub, open source, and skills Databricks releases open-source components (Delta Lake, MLflow, Spark) on GitHub, but does not have a single official repository for the platform. - dbeaver/dbeaver: Free universal database tool and SQL client (52,442 stars, Java, Apache-2.0 license) getredash/redash: Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data. (28,887 stars, TypeScript, BSD-2-Clause license) cube-js/cube: 📊 Cube Core is open-source semantic layer for AI, BI and embedded analytics (21,227 stars, Rust) APIJSON/APIJSON: 🏆 Real-Time no-code, powerful and secure ORM 🚀 providing APIs and Docs without coding by Backend, and Frontend(Client) can customize response JSONs 🏆 实时 零代码… (18,391 stars, Java) Canner/WrenAI: GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashb… (18,295 stars, Python) GitHub data as of 11/17/2026. "Official" only if the repository belongs to the vendor's organization. Skills to develop Basic: data lake concepts, SQL, notebooks, Spark cluster management. Intermediate: Delta Lake, Structured Streaming, MLflow tracking. Advanced: Unity Catalog, cost optimization, CI/CD for notebooks, model deployment as services. Tips and insights Enable Databricks cost monitoring to avoid billing surprises. Use cluster autoscaling to balance performance and costs. Version notebooks with Git integration (if available) or export them periodically. Leverage job clusters to run batch pipelines isolated from the development cluster. Participate in Databricks Community Forums for best practices and pipeline templates. Questions for the community What cost optimization patterns have you adopted on Databricks in production environments? How do you manage data governance (access, lineage) with Unity Catalog? Have you integrated Databricks with CI/CD tools? What challenges did you encounter?
What is Tableau AI Tableau AI is the set of artificial‑intelligence features built into Tableau, Salesforce’s data visualization and analytics platform. It lets you leverage pre‑trained machine‑learning models to: Generate automatic insights (Explain Data, Ask Data). Time‑series forecasting. Visualization recommendations. Anomaly detection. These functions are available both in Tableau Desktop and Tableau Server/Online, with no need to install additional components. Getting started Create a Tableau account – Sign up at https://tableau.com and choose the plan that best fits your needs (free trial available). Install Tableau Desktop (or use Tableau Online) and sign in with your Salesforce credentials. Connect your data source – Use a connector (Excel, CSV, SQL database, Snowflake, BigQuery, etc.). Enable AI features: Ask Data: type a natural‑language question in the sidebar. Explain Data: select a point on a chart and choose “Explain” to get probable causes. Forecast: add a forecast to a time‑series visualization. Save and share – Publish the workbook to Tableau Server/Online so colleagues can interact with it. Concrete use cases Pricing and plans Source: official pricing page, verified by Penzai on 11/13/2026. Prices may change: always check before purchasing. Pros and cons Pros Native integration with the Salesforce ecosystem. No data scientist required to obtain basic insights. Familiar drag‑and‑drop interface for Tableau users. Cons AI features are only available in paid licenses (Tableau Creator/Explorer). Model customization is limited compared to dedicated data‑science solutions. Not suitable for extremely large datasets (>10 M rows) without adequate infrastructure. Alternatives Several BI solutions offer built‑in AI capabilities. - Databricks by Databricks: Data and AI platform for enterprises, with models and agents on data. Hex by Hex: Notebooks and data‑analysis apps with an AI agent. Julius AI by Julius: Data analysis and charts by asking in natural language. Dataiku by Dataiku: Enterprise platform for data science, AI, and agents. Integrations and APIs Official integrations include connectors for Salesforce CRM, Snowflake, Google BigQuery, Microsoft SQL Server, and flat files (CSV, Excel). For the complete list and latest integrations, consult the documentation on the official site. Available APIs Tableau REST API: management of resources (workbooks, users, permissions). Tableau Server Client (Python): Python wrapper for the REST API. Web Data Connector (WDC): enables connection to custom web data sources. GitHub, open source, and skills There is no official GitHub repository for Tableau AI. - TomerMoskov/tableau-ai-skill: no description (14 stars, Python, MIT license) meet-afk/Tableau-Airbnb-Data-Analysis: This project explores Airbnb listings using Tableau to visualize key metrics such as price distribution, listing availability, host activity, and neighborhood t… (3 stars, MIT license) starschema/tableau-ai-use-cases: Code repository for the Five Ways to Leverage AI and Tableau Webinar (3 stars, Jupyter Notebook) abbibr/tableauAirBnb: AirBnb Tableau Full Project (1 star) Prince-git17/Tableauairbnb: This includes the booking data of Airbnb throughout the year 2016. I have used this data to create a dashboard for the given data and gain useful insights from … (1 star) GitHub data as of 11/17/2026. “Official” only if the repository belongs to the vendor’s organization. Skills to develop Basic: Tableau Desktop, Tableau Prep, data‑visualization concepts. Intermediate: using Ask Data, Explain Data, creating forecasts. Advanced: scripting with Tableau Server Client (Python), integration via REST API, query‑performance optimization. Tips and further reading Start with clean, well‑modeled datasets; Tableau’s AI works best on quality data. Use Explain Data to validate hypotheses before diving into more complex analyses. Leverage trial versions to assess AI feature coverage against your business requirements. Monitor licensing costs and evaluate whether the Tableau + Salesforce combination already meets your analytics needs, avoiding extra tools. Community questions Which Tableau AI feature has delivered the most value in your organization? Have you encountered difficulties integrating Tableau AI with on‑premise data sources? What best practices do you follow to ensure data quality before using Explain Data?