TestNinja

Won 1st place & "Most Interesting Technical Achievement" at South Park Commons x Meta AI hackathon (August 2024).

TestNinja is an autonomous agent platform for robust and context-aware test generation in GitHub CI/CD pipelines. When a pull request is submitted, TestNinja constructs a dependency graph of all altered functions. Utilizing graph retrieval augmented generation (RAG), it then generates and runs contextually relevant unit tests for these changes.

We used Llama 3.1 in our TestNinja agentic workflow to generate a comprehensive test suite for a function based on the context of how it’s used in other functions. We passed in a prompt that outlined the purpose of the agent, code snippets of the function being called (fetched via graph-based RAG), and a specific format the output needed to be for us to parse.

Twitter demo: https://twitter.com/ameyajadhav_/status/1820535584466870780

YouTube demo: https://youtu.be/cH-eiGTKLr4