Building Data Platforms That Transform Complex Data Into Intelligent Action.
I am Santosh Pothnak, a Lead Data & BI Architect with 16+ years of expertise. I have spearheaded the migration of legacy report layers to Azure Cloud, optimized data pipelines, and automated data discovery. Skilled in PySpark, SQL query tuning, and Power BI Embedded, I have enhanced dashboard refresh times by 50% and cut manual report processing overhead by 40%.
Profile
With 16 years of experience in BI & Data Architecture and AI platforms, I have spearheaded the migration of legacy report layers to Azure Cloud, optimized data pipelines, and automated data discovery.
Skilled in PySpark, SQL query tuning, and Power BI Embedded, I have enhanced dashboard refresh times by 50% and cut manual report processing overhead by 40%. My current focus is architecting enterprise Medallion Lakehouses inside Databricks, deploying metadata-driven Data Agents in Microsoft Fabric, and building LangChain/GPT-4 powered conversational AI systems that sit directly on top of enterprise semantic models.
Work Experience
BI & Data Architect (Data & AI Platform)
- Architecting end-to-end Microsoft Fabric Lakehouse environments for enterprise clients, transitioning legacy siloes to Delta Open Table formats.
- Scaling Medallion Data Architectures within Databricks, enforcing data consistency while reducing end-to-end pipeline processing times.
- Orchestrating metadata-driven AI Data Agents to automate lineage discovery and observability across cross-cloud data warehouse landscapes.
- Developing highly-performant Gold-layer semantic models to serve as the single source of truth for downstream Power BI Embedded applications.
Application Development Team Lead (Data & AI)
- Architected and developed a conversational Learning Spend AI Agent using Python, LangChain, and GPT-4 that securely queried Power BI dataset APIs via the 'executeQueries' REST endpoint, eliminating manual report slicing.
- Grounded the LLM in existing Power BI semantic models to enforce conformed business logic, dynamic Row-Level Security (RLS), and ensure 100% mathematical alignment with executive dashboards.
- Automated end-to-end data ingestion pipelines by integrating Microsoft Power Automate with Power BI capacities, reducing manual data processing overhead by 40% while meeting strict production SLAs.
- Supervised a cross-functional Agile/Scrum team of data developers and analysts, successfully delivering over 15 high-priority corporate MIS projects directly to the executive leadership team.
Technology Lead (Data Engineering & BI)
- CoE (Center of Excellence) Lead: Mentored a team of 20+ developers in advanced semantic modeling, star schema best practices, and high-performance DAX optimization strategies.
- Re-engineered legacy siloed databases into unified enterprise data pipelines, enhancing dashboard and report refresh times by 50% through advanced SQL query tuning, CTE optimization, and index restructuring.
- Programmed custom analytical data parsers in Python to identify market shifts, converting raw unstructured data into clean structured elements for corporate decision-making frameworks.
- Designed and optimized enterprise-scale Power BI tabular models with complex DAX calculations, resolving performance bottlenecks using DAX Studio and Tabular Editor to minimize memory footprint.
- UNIPER (Germany): Led cloud reporting migration, designed comprehensive migration data models, and managed universes in SAP BusinessObjects.
- Anglian Waters (UK): Managed a reporting team of 4 to migrate legacy Crystal reports to Web Intelligence (Webi), completing critical data model updates.
- E.ON (Germany): Supervised regression testing of 800+ upgraded reports during a major migration from SAP BO 3.1 to 4.1.
SAP BI Consultant
- Engineered complex universe structures and information models using SAP Business Objects, establishing robust semantic definitions that served as the predecessor for modern cloud metadata warehouses.
- Wildlife Conservation Society: Developed analytical dashboards for donation tracking and donor engagement, completing extensive data profiling and cleansing.
- Schwan Food Company: Replicated Cognos reports and calculations in SAP BO 3.1 universes and developed Webi and Crystal reports using stored procedures.
- Hyderabad Chemicals Limited: Designed operational universes and built sales KPI dashboards with multi-level drill-down capabilities, integrating non-SAP data via Data Services.
- Sesa Goa Limited: Designed custom mining operations universes and production dashboards using SAP BI 7.0 for management tracking.
Software Engineer
- Set up software infrastructure and supported reporting requirements using SAP BOBJ for production-readiness verification.
- Cornell University: Executed data profiling, cleansing, match, and consolidation tasks to improve data quality using BODS 3.2.
- Verifone: Tested Web Intelligence (Webi) reports after database migration from Oracle R11 to R12 to ensure data consistency.
Software Developer
- Debugged application code across Java, HTML, and PHP to ensure secure system integrations and proprietary features.
- Employee Management System: Built a console-based CRUD system in Core Java implementing file-based persistent storage, exception handling, and object-oriented design.
Projects & System Architectures
Key client engagements and technical platforms built across my career.
Fabric Metadata Data Agents
Designed active scanning agents within Microsoft Fabric to automate data asset discovery and cataloging, while constructing semantic Gold layers optimized for downstream Power BI Embedded consumption and enterprise-wide BI reporting.
- Deployed metadata-driven Fabric agents to automate schema and lineage mapping.
- Engineered semantic architectures integrated with downstream Vector DBs.
- Bridged corporate lakes with conversational analytics interfaces.
Learning Spend AI Agent
Built an autonomous AI agent using LLM orchestration to query enterprise BI dataset APIs, isolate anomalous spend patterns, and generate natural language MIS reports for corporate executives.
- Developed agent flows using LangChain and advanced Python scripting.
- Queried Power BI Embedded dataset APIs directly to extract key metrics.
- Generated conversational narrative reports with zero human intervention.
Retail Sales & Operations Dashboards
Designed retail performance dashboards monitoring network-wide sales, freezer compliance, and operational check compliance to prevent inventory loss.
- Visualized retail sales performance by region and categories.
- Created temperature check trackers and compliance alert alerts.
- Reduced network product spoilage by 15% through proactive alerts.
Azure Cloud PGFS Lakehouse
Led the migration of legacy operational reporting environments to a modern Azure-hosted Medallion Lakehouse using distributed PySpark clusters.
- Transformed raw PostgreSQL databases into high-performance semantic layers.
- Architected Gold-layer structures using Bronze-Silver-Gold partitions.
- Optimized distributed pipelines for analytical dashboard ingestion.
BusinessObjects Cloud Migration
Aimed at migrating UNIPER's existing reporting environment to the cloud, creating a sustainable data model, and ensuring seamless integration of reports.
- Designed a comprehensive data model for the migration activity.
- Migrated reporting systems to the cloud and resolved integration issues.
- Developed and maintained reports and universes in BusinessObjects.
AWS Reporting Solution
Adapted existing reporting systems to support updated data models while developing new reports and maintaining system integrity during migration.
- Migrated Crystal reports to Webi after significant data model updates.
- Managed a team of four to develop reports and address user requests.
- Coordinated with the ETL team for accurate data integration.
One2Two Regression Testing
Ensured a smooth transition during the major upgrade of trading reporting systems from SAP BO 3.1 to 4.1, minimizing errors and maximizing performance.
- Conducted regression testing for 800+ upgraded reports.
- Created and executed test cases, ensuring data accuracy and functionality.
- Delivered development support for Webi reports.
EIW Migration & Development
Focused on high-scale database migration from SQL Server to Teradata, resolving data integrity errors and improving performance.
- Migrated databases from SQL Server to Teradata and fixed integrity errors.
- Developed Webi reports and enhanced system performance post-migration.
- Supported UAT deployment and handled end-user issues.
Sales and KPI Dashboards
Developed dashboards that provided sales and performance analysis, enabling data-driven decision-making for regional and product-specific trends.
- Designed mock-ups and developed multi-level drill-down capabilities.
- Brought non-SAP data into BOBJ via Data Services and designed universes.
- Created KPI dashboards using column, bar charts, and scorecards.
Data Quality & Cleansing
Enhanced data quality and integrity for Cornell University by performing comprehensive data cleansing and transformation processes.
- Executed data profiling and created jobs for cleansing and parsing.
- Performed match and consolidation tasks to improve data quality.
- Coordinated with stakeholders and uploaded reports to management console.
Cognos to BO Replacement
Replaced legacy Cognos reports with modern Webi and Crystal reports over RDBMS, supporting sales, expense, and route performance lines.
- Analyzed and replicated Cognos calculations and functionalities.
- Created Universes in BO 3.1 tailored to Cognos reports.
- Developed Webi reports using stored procedures and advanced logic.
Wildlife Conservation Dashboard
Created an operational reporting dashboard for tracking global donations and donor engagement, enhancing data transparency.
- Developed dashboards for donation analysis and reporting.
- Conducted data profiling and cleansing for accurate reports.
Verifone R11 to R12 Migration
Ensured data consistency and reporting functionality after migrating databases to the upgraded Oracle environment.
- Tested and validated Webi reports after database migration from Oracle R11 to R12.
Employee Management System
Developed a simple console-based Employee CRUD system focusing on practical exposure to Core Java principles like OOP, exception handling, and file storage.
- Developed basic CRUD operations for employee records using Core Java.
- Designed and implemented console-based user interface.
- Used file handling to store and retrieve data persistently.
Community & Leadership
Evangelizing data technologies, hosting developer forums, and training the next generation of engineers.
Global Education & Mentorship
- Instructor of popular online courses focusing on enterprise BI, including "Getting Started with Power BI" and "Understanding Key DAX Functions".
- Created a specialized course enabling Project Managers and Scrum Masters to connect Power BI with Azure DevOps (ADO) data via OData feeds and Analytics Views.
- Maintained high course ratings while answering technical queries and coaching learners globally on data architecture.
Speaking & Community Impact
- Core Member of the Hyderabad Data & AI Community, driving local tech outreach, developer networking, and Fabric adoption.
- Microsoft Fabric Bootcamps: Delivered sessions at Microsoft Offices in Hyderabad (300+ attendees) and Bangalore (400+ attendees) on semantic modeling and end-to-end data platform scenarios.
- Conference Speaker: Guest speaker at MACC3 (Microsoft Analytics Community Conference) and Data Toboggan 2025, presenting Microsoft Fabric Data POC architectures.
- Academic Mentorship: Conducted Power BI workshops at IIM Raipur (2 sessions) and PSG College of Arts & Science; guest lectured at Acharya Nagarjuna University UGC National Seminar.
- Industry & Hackathon Panelist: Served as a panelist at Siva Sivani Institute of Management (SSIM) and invited back as a Hackathon Jury Member at CBIT (Oct 2025).
Speaking & Community
Community Leader & Contributor
Analytics Discovery Hub & Microsoft Fabric Skool
- Analytics Discovery Hub: Host free weekly Zoom calls to clarify student doubts every Thursday (9:00 PM - 10:00 PM).
🔗 Join the Weekly Sessions - Microsoft Fabric Skool: Active top-contributor sharing knowledge and helping members.
🔗 View Leaderboard Post
Speaker
Global Fabric Day
- Delivered in-person sessions on Microsoft Fabric Data POC Projects at N. L. Dalmia Institute of Management Studies and Mindlyft AI.
🔗 View Post / Event
Speaker
Microsoft Analytics Community Conference 3 (MACC3)
- Delivered deep-dive sessions across Microsoft Fabric, AI & Copilot, and Power Platform to a global audience.
🔗 View LinkedIn Post
Jury Member
Chaitanya Bharathi Institute Of Technology (CBIT) Hackathon
- Invited as an expert jury member to evaluate innovative data and AI solutions developed by students.
Speaker
Power BI & Fabric ReStart Bootcamp
- Delivered a featured session on Semantic Models in Power BI for the Hyderabad Data & AI Community.
🔗 View LinkedIn Post
Speaker
Global Fabric Day
- Presented on Analytics using Microsoft Fabric to an audience of 200+.
🔗 View LinkedIn Post
Speaker
Microsoft Analytics Community Conference 2
- Showcased a Fabric Demonstration with Use Cases to a virtual audience of 200+ professionals.
🔗 View LinkedIn Post
Guest Instructor
IIM Raipur
- Conducted two comprehensive Power BI Workshop Training sessions for management students.
Technical Speaker
UGC-Sponsored National Seminar
- Invited speaker on 'Advances in Business Analytics and Intelligence'.
🔗 View LinkedIn Post
Speaker
Data Toboggan - Winter Edition
- Presented a session on 'Microsoft Fabric Data POC Project'.
🔗 View LinkedIn Post
Networking Star & Host
The AI & Data Fest 2025 (Codebasics)
- Hosted and facilitated networking for AI and data enthusiasts.
Panellist
Business Analytics Panel Discussion
- Participated as an industry expert discussing 'Business Analytics: Insights & Impact'.
Speaker
Microsoft Fabric Bootcamp
- Demonstrated an end-to-end use case of Microsoft Fabric and Power BI to 300+ attendees.
🔗 View LinkedIn Post
Speaker
Microsoft Analytics Community Online Conference
- Conducted an online session on Microsoft Fabric use cases.
🔗 View LinkedIn Post
Speaker
Microsoft Fabric Bootcamp
- Delivered a session on Semantic Models in Microsoft Fabric to 400+ attendees.
🔗 View LinkedIn Post
Workshop Instructor
AI Universal University College
- Conducted an intensive virtual workshop on Power BI for over 120 students.
🔗 View LinkedIn Post
Speaker & Mentor
Power BI and Career Guidance
- Hosted a workshop on Power BI skills and career guidance for 150+ attendees.
🔗 View LinkedIn Post
Guest Speaker
Rotary Club of Hyderabad
- Delivered a special knowledge-sharing session for members on data analytics.
🔗 View LinkedIn Post
Workshop Instructor
Power BI Workshop
- Conducted a workshop covering report building and dashboards.
Technical Skills
A cleanly categorized mapping of my technologies, architectural focus, and credentials.
Data Engineering
- PySpark
- Microsoft Fabric
- Databricks
- Delta Lake
- Medallion Architecture
- ETL/ELT Pipelines
- Azure ADLS Gen2 / OneLake
- PostgreSQL
- Snowflake
AI & Automation
- Autonomous AI Agents
- LLM Orchestration
- OpenAI API Integration
- Python
- Streamlit
- Power Automate
BI & Semantic Layer
- Enterprise Power BI Architecture
- Advanced DAX
- Power BI Embedded / Premium
- DirectLake Semantic Models
- Semantic Layer Modeling
- SAP Business Objects
- MicroStrategy
Programming & Web
- Python
- SQL
- PySpark
- Java
- HTML & CSS
- PHP
Professional Certifications
Education
Bachelor of Engineering (ECE)
Muffakham Jah College of Engineering & Technology, Hyderabad
Class of 2005 – 2009High School Diploma / Intermediate (MPC)
Vikas Junior College (aka Holy Cross Co-operative Junior College)
Class of 2003 – 2005SSC (Regulars)
Mt. Helicon Public School
Class of 1993 – 2003Get In Touch
Have a pipeline to optimize, an AI agent to architect, or a data model to structure? Let's connect.
Contact Information
Feel free to reach out through the form or directly via the details below.