Aman
Hanspal

With Dr. Gargi Phadke, as Research Assistant at DY Patil University, RAIT (Jul 2026 – present). Benchmarks YOLO-World v2 and frame-sampling strategies on OVT-B (1,972 videos) for retrieval quality, latency and compute, and tests Qwen3-VL as a verifier to cut false positives. Fully reproducible on a 4 GB laptop GPU, with frozen test sets and results. Built on VisionQuery.

• YOLO-World v2
• Qwen3-VL
• OVT-B
• Benchmarking

Indian patent application 202321037263, "System and Method to Enhance Security using AR Smart Glasses". It grew out of ThirdEye, AR glasses for organisational security, which took First Place at Anveshan 2023 (West Zone).

• Augmented Reality
• Computer Vision
• Hardware

DiffSinger pipeline for an Ogilvy × Cadbury campaign that reached 14,000+ users at Christmas 2024. Phoneme alignment, variance modeling, and acoustic synthesis on a 3-hour custom dataset, with real-time inference on AWS Lambda.

• DiffSinger
• OpenUtau
• Python
• AWS

Deployed FaceFusion for internal and marketing use. Accepts a per-segment JSON faceswap config, applies it frame-accurately, and stitches output with ffmpeg.

• Modal
• Replicate
• ffmpeg
• Python

Natural-language search over video via open-vocabulary detection. Frame sampling + a YOLO-World inference pipeline for dynamic classes with no retraining, exposed through upload/query/timestamp APIs.

• Python
• FastAPI
• YOLO-World

Full-stack RAG over 11,000+ SIGGRAPH paper chunks. Hybrid retrieval (semantic + BM25), Cohere re-ranking, cited LLM answers, and real-time SSE streaming.

• Next.js
• FastAPI
• Qdrant
• OpenRouter
• Cohere

Local-first multimodal video search for editors. Drop in footage, search in natural language, export timestamped clips — fully on-device. Dual retrieval (BGE transcript + OpenCLIP keyframe vectors) fused per video, evidence-gated chat that rejects uncited answers, and a 30-query eval harness that locks clip suggestions until top-3 accuracy ≥ 0.70.

• Electron
• React
• FastAPI
• OpenCLIP
• Whisper
• LanceDB
• Ollama

Enterprise RAG for querying internal knowledge bases in natural language. Hybrid retrieval (embeddings + BM25), re-ranking, and RAGAS-based quality evaluation.

• LangChain
• LlamaIndex
• RAGAS

Led R&D on an English-to-Indian-regional-language speech POC. Benchmarked pipelines on latency, speed, and accuracy in a technical report; shipped on OpenAI's Realtime API.

• OpenAI Realtime
• Python

End-to-end PDF parser for scanned and digital documents, handling mixed content — text, tables, and images — with PyMuPDF. OCR and layout extraction via Reducto and Qwen3-VL (through OpenRouter), normalized into a schema and saved as structured JSON for downstream LLM analysis. Async Celery + Redis pipeline for parallel processing with retry logic and API rate limiting.

• Python
• PyMuPDF
• Reducto
• Qwen3-VL
• Celery
• Redis
• Supabase

Open-source Python package for scraping Pinterest images — search, download, HTML gallery generation, rate-limit handling, and a CLI. Published on PyPI.

• Python
• Playwright
• PyPI

Brave New Art (JioHotstar × Lenovo) — India's first fully AI-generated short film, produced end-to-end. Plus a Mother's Day film for SMFG India Credit.

• FLUX
• Midjourney
• Runway
• Kling AI
• Hunyuan
• ComfyUI

Generated images in varied artistic styles. Fine-tuned FLUX, SDXL, and SD 3.5 LoRAs on Kohya_SS and published models to CivitAI.

• Stable Diffusion
• FLUX
• LoRA
• Dreambooth
• ComfyUI
• A1111

Fine-tuned and published LoRA models on CivitAI across film, portrait, and product styles.

• SDXL
• FLUX
• Kohya_SS
• ComfyUI

Agentic study companion for VideoDB's "Unlock the Footage" Global Media Intelligence Hackathon. Turns any lecture video into a full study pack — grounded clips, an AI-generated explainer video (FLUX visuals + TTS narration + auto-captions), flashcards, and summaries — from one natural-language prompt. A GPT-4o tool-loop agent picks the tools and streams live progress; optional Telegram delivery.

• VideoDB
• FastAPI
• React
• TypeScript
• GPT-4o
• FLUX

Desktop learning agent for educational videos (VideoDB Global Online Hackathon). A floating Electron overlay captures screen + audio via VideoDB, indexes streams with multimodal models, and writes structured notes into Notion.

• Electron
• React
• FastAPI
• VideoDB
• Notion