Posts

Showing posts from November, 2025

Create Bonze-Silver-Gold-table in minutes in Databricks following mediation architecture

Image
 AI is doing a good job in Databricks platform.  Earlier, following typical mediation architecture, we used to write bunch of code to read the raw data, create a bronze table and then silver table, and finally the gold table.  Now, I open databricks and upload the raw CSV data file. Next, I prompt properly and ask AI to create the code for me.   Code generate within seconds. Ready to execute. However, AI is not always right as I'm. This is acceptable. Code unable to understad the final level aggregration columns there. Good news is AI is there to diagnose the error and recomend the right code. AI, understand what code change is required while doing analysis generated SCHEMA in the dataframe. AI recomending you the right python code to fix this. Let's divide the phase in two sefment. Creating Bronze and Silver table in one segment and Gold one is another code segment. Once the Silver DataFrame generates, print the dataframe schema and review the column before wri...

Custom AI Agent using Open AI Agent Builder

Image
Agent Builder from Open AI is a game changer! Using this tool, you can easily create custom ai agent without writing a single line of code. Below the flow was built using Agent Builder.  Agent is taking input and based on the search query, agent is going to search from different MCP unit i.e. Google-drive, or SharePoint, or even using websearch.  Simple to create and FAST to implement the Buisness Workflow! Below the generated the back-end code. Go for Agent Builder :) import { hostedMcpTool, Agent, AgentInputItem, Runner, withTrace } from "@openai/agents"; import { OpenAI } from "openai"; import { runGuardrails } from "@openai/guardrails"; import { z } from "zod"; // Tool definitions const mcp = hostedMcpTool({   serverLabel: "sharepoint",   allowedTools: [     "fetch",     "get_profile",     "get_site",     "list_recent_documents",     "search"   ],   authorization: "https://gr...