Aman Dalmia

I build tools that help propagate the benefits of technology to people it wouldn't reach by default

Principal ML Engineer @ Artpark, IISc

Simplifying AI evals with Calibrate: open-source AI agent evaluation tool for non-profits. Read more here.
Building FormBharo: turn any form into a voice agent that fills the form by simply speaking with the end user. Read more here.

Lead AI engineer @ The Agency Fund

Supporting evidence-based NGOs achieve cost-effective impact at scale by helping them build and strengthen their AI evals and creating reusable tools, playbooks and standards for the sector.
Core contributor to the AI evaluation playbook for the development sector
Leading the Health AI benchmarking initiative to build strong benchmarks and shared standards for evaluating AI in public health.

@ Noora Health

Building a copilot to help nurses support millions of caregivers across the world

@ HyperVerge Academy

Building SensAI, an AI-powered LMS that automates assessments for educators and gives real-time, personalized 1:1 coaching to learners using AI.

2025-

I have built AI models and products for almost 10 years (before it was all the rage) at companies like Artpark (at IISc), Wadhwani AI, Noora Health, HyperVerge, and Avanti Fellows.

Now, I help social impact organizations make AI work for them, conduct workshops to help their teams leverage AI to become better at what they do and help engineering teams integrate AI into their products.

If you work at a non-profit, please book a free 60 minute call. Otherwise, you can book a paid consulting call: 30 mins or 60 mins.

2023-2025

AI Lead @ HyperStart Built a copilot for legal teams and grew it from 0 to $100K MRR.

I returned to HyperVerge after 5 years and led AI for HyperStart, a legal Contract Lifecycle Management (CLM) platform in our journey from 0 to $100k MRR. I built our AI engine from scratch. It is a highly customised RAG pipeline to convert unstructured PDF contracts into a structured format for our customers with >99% accuracy and perform automated contract review saving hours of manual work. I was responsible for every step of the pipeline from data preparation and model optimisation to deployment and monitoring, while setting up internal processes and building tools to bring in more efficiency.

I also built SensAI, an open-source, AI-powered LMS, for our non-profit arm HyperVerge Academy where we support students from low-income backgrounds to get jobs in the tech sector.

You can join in too:

SensAI is open-source, fork it/clone it/play around with it
Join our community of builders in AI + education and share how you would like to contribute
Look at our public roadmap and share your ideas/requests
Help spread the word and gather more feedback on how we can do better

2022-2023

Tech Lead @ WisdomCircle Built a platform for retirees to find meaningful things to do post-retirement and set up the engineering team.

Joined an early-stage startup named WisdomCircle as a Consultant Tech Lead. Built the first version of product with Joanna and the rest of the team to help retirees find meaningful things to do post-retirement and set up the engineering team.

2020-2022

Senior Software Engineer @ Avanti Fellows Kickstarted the open framework for Edtech within Avanti Fellows. Built Plio, an open-source tool for converting any YouTube video into an interactive lesson, which drove a 5x increase in completion rates on our videos.

Lucky to have had the experience of building something meaningful from scratchwith my close friends, getting extreme autonomy, experiencing what good leadership looks like, learning a lot about building products and systems, the cost of overengineering, premature optimisation and not speaking to users enough.

I worked as a Software Engineer at Avanti Fellows, a non-profit that helps students from low-income backgrounds get into good engineering and medical colleges, providing a pathway out of poverty.

We built several open-source products to improve how our students learn.

Plio, an open-source tool that converts any YouTube video into an interactive lesson plan and provides educators all the learning data at the level of each student.

It increased the completion rates on our videos by 5x and was used by > 40000 students in Haryana during the COVID-19 pandemic. We were part of the 7th Cohort of The Nudge Incubator and won the Tools Competition by Schmidt Futures under the "Accelerating Learning" track in 2022-23. Plio continues to be used by Avanti Fellows to support students in their learning and is being used by other non-profits like The Apprentice Project (TAP) in their programs as well.

I built the first version of Avanti's Quizzing Engine, an open-source platform for students to practice and prepare for their exams. The quizzing engine is in active development and regularly being used by thousands of students. Here is a demo of the quizzing engine in action!

In the journey, we got to go to incredible places and meet amazing people. We even gave a presentation only using memes. Visiting Tehri for a retreat with other tech-focused non-profits is a memory that I will always cherish. You can read about our experience here!

2018-2020

Research Fellow @ Wadhwani AI Trained and deployed AI models for pest management, identifying low-birth weight babies and screening for COVID-19 using cough sounds.

Met some of the best people I know and worked on really meaningful, technically challenging problems. Learnings of a lifetime, beyond just the technical stuff, with insights on how people think and behave, building a good team and culture, keeping a high bar, communicating my ideas to diverse audiences, trusting my instincts, having healthy skepticism and my own biases.

I was the founding team member of Wadhwani AI, a non-profit dedicated to using AI for social good. We built AI-based solutions for pest-management in cotton farms (featured on the PyTorch blog, won the Google AI impact challenge for $2M, published a paper in KDD), estimating the weight of newborns from a video to identify low-birth weight babies (accepted as best paper at Computer Vision for Physiological Measurement (CVPM) Workshop, CVPR 2024) and screening for COVID-19 using cough sounds (paper published at ICLR 2021 AI for Public Health and Machine Learning for Preventing and Combating Pandemics Workshops, code).

2014-2018

B.Tech @ IIT Guwahati Graduated in Electronics & Communication Engineering, worked for many startups on campus and through internships, built a startup which failed, fell in love with open-source and machine learning, got my first taste of working in social impact, published a few papers.

Most importantly, met some of my best friends, went way beyond my comfort zone to do things I could never imagine doing and made memories that will always stay with me.

B.Tech at IIT Guwahati with a major in Electronics & Communication Engineering. But I hardly focused on my major until my curriculum included a lot of math and ML. I got into programming in my first year [android development], worked with a lot of startups on campus, started (and failed) my own startup in education, and then, got into Machine Learning, mostly learning on my own, making open-source contributions to scikit-learn, working with Prof. Amit Sethi on applying deep learning to predict cancer recurrence using histopathology images, working with Prof. Ashish Anand during my Bachelor Thesis Project on predicting splice sites using genome sequences (paper) and interning at Niramai [detecting breast cancer in thermal images using deep learning (paper)] and HyperVerge [change detection in geospatial images using deep learning].

tools

Calibrate is an open-source AI agent evaluation tool, built to remove the friction in AI evals, for non-profits.

Watch the step-by-step walkthrough of Calibrate: evaluating LLMs using structured tests, finding the best model across latency, cost and quality, aligning LLM judges with human experts, continuously monitoring agent performance, evaluating speech-to-text and text-to-speech models, and running simulated conversations with agents to evaluate them end-to-end.

[CLI] [Frontend] [Backend] [Docs] [Join our WhatsApp community]

Book a demo for Calibrate Paid

FormBharo: form-filling voice agents for public health.

Forms are a central part of the public health system in India. A majority of users have limited literacy, excluding them from most digital interfaces. Voice is the universal way they interact.

Often a frontline health worker speaks with the end user to fill different forms on their behalf. But the system has limited capacity of health workers.

Can an AI agent speak to the end user to fill forms instead?

[Try it] [Paper] [Reach out for collaboration]

SensAI is an open-source, AI-first LMS that automates assessments for educators and gives real-time, personalized 1:1 coaching to learners using AI.

[Frontend] [Backend] [Community]

Plio is an open-source tool to convert any YouTube video into an interactive lesson by adding questions in between and get actionable insights on how students learn.

[Frontend] [Backend]

talks

Gave a tutorial on evaluating AI agents using Calibrate at the FOSS United Bangalore monthly meetup (slides)

Walkthrough of Calibrate, guiding domain experts on evaluating AI agents. Include a demo of FormBharo as a use case. (recording | slides)

Model evaluation workshop for leaders at non-profits (recording | slides)

Lightning talk showcasing SensAI at OpenAI's event on AI for Social Impact (slides)

Demo-ing SensAI + thoughts on AI's role in education (slides)

Knowledge sharing session on rapid prototyping using LLMs, Cursor & Streamlit (slides)

State of LLMs @ Non-Profit CTO Convergence (slides)

Learnings from building an AI tutor @ LLM Sprint (slides)

AI and Social Good - Experiments, successes and warnings (slides)

Building OSS for govt. school students (slides)

Practical AI, Living with ADHD and more @ Democratizing AI

My journey in AI @ Democratizing AI

publications

Auditable Emergency Triage for Maternal and Newborn Care in India

arXiv 2026

Shobhit Jagga*, Aman Dalmia*, Niharika Priyadarshini*, Neelima Devadas, Amrita K Prasen, Nikhil Nalin, Santhosh SJ, Sreeram Nurani Ramasubramanian, Muhammed Afeer K, Anubhav Arora

View paper See how it works Learn more

FormBharo: Designing and Evaluating a Voice Agent for Conversational Form Filling in Rural India

arXiv 2026

Aman Dalmia, Sanskriti Midha, Jigar Doshi

View paper Read blog post Learn more

Script gap: Evaluating LLM triage on Indian languages in native vs romanized scripts in a real world setting

EMNLP 2026 Industry Track

Manurag Khullar, Utkarsh Desai, Poorva Malviya, Aman Dalmia, Zheyuan Ryan Shi

View paper

Best Paper Award

NurtureNet: A Multi-task Video-based Approach for Newborn Anthropometry

Computer Vision for Physiological Measurement Workshop, CVPR 2024

Yash Khandelwal, Mayur Arvind, Sriram Kumar, Ashish Gupta, Sachin Kumar Danisetty, Piyush Bagad, Anish Madan, Mayank Lunayach, Aditya Annavajjala, Abhishek Maiti, Sansiddh Jain, Aman Dalmia, Namrata Deka, Jerome White, Jigar Doshi, Angjoo Kanazawa, Rahul Panicker, Alpan Raval, Srinivas Rana, Makarand Tapaswi

View paper Learn more

Impact of data-splits on generalization: Identifying COVID-19 from cough and context

ICLR 2021 AI for Public Health and Machine Learning for Preventing and Combating Pandemics Workshops

Makkunda Sharma, Nikhil Shenoy, Jigar Doshi, Piyush Bagad, Aman Dalmia, Parag Bhamare, Amrita Mahale, Saurabh Rane, Neeraj Agrawal, Rahul Panicker

View paper View code, model, data