AI Reliability Platform for LLM Evaluation
Built a full-stack system to monitor and control LLM generation at the token level, with adaptive instability detection and real-time intervention.
Software Engineer with 4+ years building enterprise microservices at Bank of America • M.S. in AI at Columbia University (Expected Dec 2027).
Building LLM evaluation tools, entropy-based generation controls, and drift-aware ML pipelines.

I've always been drawn to understanding how complex systems actually work. Whether it's enterprise software or machine learning, I care most about how things behave under pressure, why they break, and how to make them more reliable.
I spent four years at Bank of America building and maintaining backend services for CashPro, their enterprise digital banking platform. That taught me a lot about the trade-offs in designing software that has to keep evolving without falling over. I picked up multiple Global Recognition Awards along the way and got involved in AI initiatives within the org.
I bring that same systems thinking to AI. Over the past year, I've been building LLM evaluation tools, reliability frameworks, and model governance pipelines, while getting deeper into Python, PyTorch, and Transformers.
Now I'm at Columbia doing an M.S. in Artificial Intelligence (Finance & Operations concentration) to go deeper on the research side.
Evaluating model behavior token by token. Catching failure modes during generation, not after user delivery.
Building policy controllers, CI gates, and business-loss promotion metrics that prevent silent model degradation.
Four years of enterprise engineering at Bank of America across 17+ production releases and 13 CashPro services serving 550K+ users.
Integrating real-time PSI & KL drift detection with shadow deployment to evaluate recovery before promotion.
4+ years building and scaling enterprise systems at Bank of America and fintech. Went from production engineering to SME to AI patent inventor.
Served as Subject Matter Expert (SME) for CashPro Search, the primary search platform across Bank of America's digital banking ecosystem. It serves 550,000+ corporate users across 40,000 companies with 18 million+ searches since launch.
Owned OpenShift deployments, CI/CD configuration, release validation, and production stabilization across 17+ release cycles. First point of contact for cross-team production escalations and architectural decisions.
Contributed to modernization initiatives including JDK 17, Spring 6, containerization, and cloud enablement across 13 CashPro services, improving team standing in vulnerability, security, and modernization metrics via Checkmarx and SonarQube scans. Orchestrated AI adoption initiatives for 50+ CashPro colleagues.
Named inventor on a pending Bank of America patent application (2026) in AI for financial services. Led 10+ team discussions to refine the idea, architecture, and presentation.
Global Recognition • BofA
Backend delivery, release ownership, & cross-team SME lead
Global Recognition • BofA
Cloud enablement & OpenShift service containerization
Global Recognition • BofA
Production incident stabilization & rapid defect triage
Software and AI systems I've built for evaluation, monitoring, and governance in production environments.
Built a full-stack system to monitor and control LLM generation at the token level, with adaptive instability detection and real-time intervention.
Extracts live probability distribution P(x_t) and calculates Shannon entropy H(x) per generated token in real-time.
H(x) = -sum(P(w) * log2(P(w)))Built a full-stack system to monitor and control LLM generation at the token level, with adaptive instability detection and real-time intervention.
Built an end-to-end ML system that detects data drift, evaluates model degradation, and governs retraining decisions.
Production validation system for AI-generated outputs in financial services: threshold optimisation, conservative AND escalation policy, priority-scored human review queue, and audit-grade provenance.

End-to-end multilingual LLM training pipeline targeting Hindi/English code-switching. Dataset curation, LoRA fine-tuning, inference evaluation, and deployment packaging across 6 Kaggle notebooks.
ML-based workout song recommender using BPM and VADER sentiment analysis. Co-authored research with K-Means clustering on Billboard Top 100 to match songs to exercise intensity.
Notebooks Expert rank #2,441 / 59,663 (personal best #707). 34 notebooks, 11 datasets, 3 models, 1 competition entry. 10 bronze medals across ML, DL, NLP, Computer Vision, and regression.
Predicted and generated new headlines using NLP and LSTM networks.
Speech recognition system that detects the trigger word 'activate' using NLP and plays a chime sound upon detection.
Built a face recognition system using OpenCV in Python to detect faces, eyes, and smiles, identifying individuals with confidence scores.
Predicted Tesla stock prices using ML algorithms with descriptive, prescriptive, and predictive analysis. Also applied classification algorithms to PIMA India Diabetes dataset.
Core skills in this area
Right now I'm focused on the overlap between ML research and production engineering: building evaluation tools, deployment governance, and reliability infrastructure.
Rank 2,441 / 59,663 · Personal Best #707 · 10 Bronze Medals
Expected Dec 2027 · Finance & Operations Concentration
Kaggle & Deep Learning Specialization · 2025
Band 8 / 9 · Dec 2025
From undergraduate computer science foundations to enterprise banking systems, Kaggle global rank, and AI graduate research at Columbia University.
Columbia University · New York, NY · Concentration: Finance & Operations
Graduate student in Artificial Intelligence, focusing on ML systems and AI reliability. Building on four years of enterprise software engineering and hands-on work with LLM evaluation frameworks.
Bank of America
Promoted to Subject Matter Expert for CashPro Search, serving 550,000+ corporate users. Owned deployments, CI/CD, and release validation across 17+ cycles. Named inventor on a pending Bank of America patent application (2026).
Bank of America
Increasing ownership of backend services through feature development, production support, and service reliability. Diagnosed and resolved 20+ production incidents spanning application and infrastructure layers.
Bank of America
Built foundational experience in enterprise software engineering by contributing to the CashPro Search platform using Java, Spring Boot, and Agile delivery practices.
Top 4.1% Globally
Notebooks Expert ranked #2,441 / 59,663 (personal best #707). 34 notebooks and 10 bronze medals across ML, DL, NLP, Computer Vision, and regression.
SRM IST · 94.4% GPA
Graduated with 94.4% GPA in Computer Science. Built foundation in algorithms, data structures, and software engineering. Active in college tech/coding clubs and tech fests.
SHUBHANKAR TIWARI // INTELLIGENT SYSTEMS TERMINAL v2.5.0
Type 'help' to see available commands or click quick suggestions below.
Open to opportunities in ML Systems, AI Infrastructure, Reliability Engineering, and Platform Architecture.