Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Sujitha
by Databricks Employee
  • 30462 Views
  • 18 replies
  • 33 kudos

Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...

Screenshot 2024-01-24 at 11.32.01 PM.png
  • 30462 Views
  • 18 replies
  • 33 kudos
Latest Reply
AIChief
New Contributor II
  • 33 kudos

thanks for sharing

  • 33 kudos
17 More Replies
shivamrai162
by New Contributor III
  • 109 Views
  • 3 replies
  • 2 kudos

Resolved! Multi Agent Supervisor not able to coordinate with genie when deployed as a databricks app

Hello,I've provided necessary permissions to a chatbot that i created using DAB and deployed on databricks apps following this documentation. At the backend its using below agentsMulti Agent SupervisorKnowledge AssistantAI/BI GenieI've provided can_q...

shivamrai162_0-1764239231427.png
  • 109 Views
  • 3 replies
  • 2 kudos
Latest Reply
shivamrai162
New Contributor III
  • 2 kudos

Hello Bianca,After following what you told, i found issues at two levelsOne was the missing genie-space configuration within databricks.ymlOther was with granting permissions to the service principal (app identity) access to the underlying tables.tha...

  • 2 kudos
2 More Replies
Daya3189
by New Contributor
  • 37 Views
  • 0 replies
  • 0 kudos

Databricks app services

Hi- I have built node.js based chatbot app that uses Azure OpenAI API to build connection and get query answers from it. I am using my organization deployed API on azure that requires cert.pem and cacert.pem certificates to authenticate. everything i...

  • 37 Views
  • 0 replies
  • 0 kudos
rafaelgildin
by New Contributor
  • 108 Views
  • 3 replies
  • 1 kudos

Error from mlflow traces in Databricks notebook

I'm unable to log my traces in my mlflow experiments.The goal is to have the tracing from my genAI calls like described in Tutorial: Connect your development environment to MLflow .So I'm able to create my experiment run, but they are every time empt...

rafaelgildin_0-1764261207256.png
  • 108 Views
  • 3 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

@rafaelgildin , I see that you have raised an Issue in the OSS mlflow repo, while the issue that you are encountering is on Databricks. The issue here is that you are explicitly adding trace.set_tracer_provider(tracer_provider). Databricks installs i...

  • 1 kudos
2 More Replies
Rahul-vlk
by New Contributor
  • 83 Views
  • 1 replies
  • 1 kudos

model-specific tools (code interpreters, search, etc.) for OpenAI / Anthropic / Google

Hi,I’m happy to see that the latest models from the three major AI labs (OpenAI, Anthropic, and Google) are now available on Databricks. I had a follow-up question about what exactly is supported.Is Databricks only exposing the base models, or are so...

  • 83 Views
  • 1 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

Hi @Rahul-vlk  You can use the models both as Databricks-hosted “first‑party” endpoints and via “external model” endpoints that proxy to the provider’s hosted APIs, all through a unified, OpenAI‑compatible interface for chat, embeddings, vision, and ...

  • 1 kudos
snarayan
by New Contributor
  • 129 Views
  • 1 replies
  • 1 kudos

Resolved! Lakesense Auth Error When Creating Multiple Knowledge Assistant Agents in Databricks

I’m encountering an issue related to Lakesense authentication when working with Agent Bricks Knowledge Assistant (KA) agents (I recreated thisAgent Bricks Knowledge Assistant agent), and I haven’t found any documentation on this. Hoping someone here ...

Generative AI
Agent Bricks
  • 129 Views
  • 1 replies
  • 1 kudos
Latest Reply
snarayan
New Contributor
  • 1 kudos

Update: The new agents I create are now working as expected. A Databricks architect suggested that the earlier issue might have been due to a backend outage, since customers typically shouldn’t encounter Lakesense errors. At this point, any newly cre...

  • 1 kudos
Suheb
by New Contributor III
  • 71 Views
  • 1 replies
  • 0 kudos

How do I build a retrieval-augmented generation (RAG) pipeline on Databricks — what are the best pra

How can I build an AI system (using Databricks) where the AI model doesn’t just rely on its built-in knowledge, but also retrieves real information from a database or documents before answering?

  • 71 Views
  • 1 replies
  • 0 kudos
Latest Reply
KaushalVachhani
Databricks Employee
  • 0 kudos

@Suheb , We have a bunch of resources around Databricks RAG. Did you have a chance to look at the available documentation? Adding a few of them below. Databricks docs for RAG: https://docs.databricks.com/aws/en/generative-ai/retrieval-augmented-gener...

  • 0 kudos
Shivani_Pande
by New Contributor
  • 57 Views
  • 0 replies
  • 0 kudos

Serving model issue in databricks

I’m facing an issue while trying to deploy a custom pyfunc model for Qwen3-Embedding-8B (GGUF format) registered in Unity Catalog. The GGUF model file is stored inside a Unity Catalog Volume, and during model training and registration everything work...

  • 57 Views
  • 0 replies
  • 0 kudos
maikel
by New Contributor III
  • 34 Views
  • 0 replies
  • 0 kudos

Custom MCP deployment

Hi Community!I have a question - could somebody please guide me how to deploy my custom MCP server to databricks?What I would like to achieve is the following:I have a unity catalog in databricks for which I would like to have MCPif the data in unity...

  • 34 Views
  • 0 replies
  • 0 kudos
Rajat-TVSM
by New Contributor III
  • 107 Views
  • 2 replies
  • 1 kudos

Random/Rare Bad Request error with Agent Serving endpoint

Whats the reason behind receiving below error at some rare occassions (once in a month)?"error_code": "BAD_REQUEST", "message": "Encountered an unexpected error while evaluating the model. Verify that the input is compatible with the model for infere...

  • 107 Views
  • 2 replies
  • 1 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 1 kudos

@Rajat-TVSM  That message is the generic model-serving “bad request” wrapper we return when a predict operation fails or the request doesn’t match the model’s expected input. The quickest way forward is to validate your payload against the model sign...

  • 1 kudos
1 More Replies
OliverMini
by New Contributor
  • 100 Views
  • 1 replies
  • 1 kudos

Resolved! How to retrieve Genie's narrative text summary (final_summary) via API?

Dear Databricks Community,I am trying to programmatically access the narrative text summary that Databricks Genie displays in the UI, but I cannot find it in the public API responses.What I see in the UI: When I ask Genie a question, the UI displays ...

  • 100 Views
  • 1 replies
  • 1 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 1 kudos

Hi @OliverMini , The “answer summary”/“final summary” shown in the UI is a newer attachment type and is not yet exposed in the public API. It is being tracked internally as a potential enhancement as there appears to be a good amount of demand for it...

  • 1 kudos
old_school
by New Contributor II
  • 204 Views
  • 3 replies
  • 2 kudos

Tags are not getting propagated immediately to Genie space for filtering Data Assets

Hi Databricks Team,I have created a Table and added a tag to it but i couldn't see that tag immediately in the Genie Space for filtering. It seems to be an issue of eventual consistency. I added a tag to a table and it seems to take 2 days to reflect...

  • 204 Views
  • 3 replies
  • 2 kudos
Latest Reply
old_school
New Contributor II
  • 2 kudos

Hi @Louis_Frolio ,Thanks for your inputs.Is there a way to add tables / views via SDK / API to Genie spaces?

  • 2 kudos
2 More Replies
stephs
by New Contributor
  • 132 Views
  • 1 replies
  • 1 kudos

agent bricks - can't figure out how to enable Knowledge Assistant

Hi, getting this error when trying to build a Knowledge Assistant agent: I have a premium account in the eastus region. The docs say I need to have a 'serverless budget policy' configured, but despite all my attempts, i can't get it to show up as an ...

stephs_0-1763743451769.png
  • 132 Views
  • 1 replies
  • 1 kudos
Latest Reply
Thompson2345
New Contributor III
  • 1 kudos

Hi Steph, it sounds like the Knowledge Assistant requires a serverless budget policy linked to your premium account. If it’s not showing in admin settings, it’s often a region/configuration issue. I’d recommend:Double-check that your East US account ...

  • 1 kudos
the_peterlandis
by New Contributor II
  • 159 Views
  • 2 replies
  • 1 kudos

Resolved! Help with hybrid search function

I need help writing a filter.  I want to pre-filter a vector index before performing a hybrid search and create this as a function.  Below is a simple example of searching for products for a given customer.  A prefilter is key as this provides author...

  • 159 Views
  • 2 replies
  • 1 kudos
Latest Reply
KaushalVachhani
Databricks Employee
  • 1 kudos

@the_peterlandis, Yes, currently vector_search SQL function doesn't provide pre filter support. However, if you must implement the UC function for this, you can do it something like below using Python code with filters.   %sql CREATE OR REPLACE FUNCT...

  • 1 kudos
1 More Replies
Saurabh2406
by New Contributor II
  • 142 Views
  • 1 replies
  • 2 kudos

Multi-agent chatbot Optimization

We have developed a multi-agent chatbot using LangGraph within the Databricks environment. The solution is functional, but we are facing challenges related to performance observability and end-to-end optimization.We need guidance in the following are...

  • 142 Views
  • 1 replies
  • 2 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 2 kudos

Hi @Saurabh2406 , This sounds like a fairly advanced use case - are you in touch with your account team at Databricks? They would be able to provide you with more detailed guidance on this use case. They could also get you connected with internal spe...

  • 2 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now