Qodo (formerly CodiumAI)
Agentic AI for testing, reviewing, and writing code.
Start new thread

CodiumAI - Generating meaningful tests for busy devs

by•
CodiumAI analyzes your Python, JS, or TS code and generates meaningful tests to catch bugs before you ship. With CodiumAI, you can easily and quickly generate comprehensive test suites that help you ensure the reliability and correctness of your software.

Add a comment

Replies

Best
Maker
📌
Hello Product Hunt ! 🚀 I'm thrilled to announce the launch of CodiumAI [beta], an innovative solution to generate component testing of your Python, JS, or TS code. 🧪 Testing your code is important. Aside from catching bugs, it gives you valuable insight into your code, and lets you know you’re coding with a purpose. 🌰 But writing non-trivial test cases is tedious, frustrating, and time consuming. And when bugs still pop up, it can be hard to figure out how you missed that edge case. In retrospect, it’s so obvious! 🤝 As devs, we get it. And that’s why we made CodiumAI. As a veteran developer and R&D manager, I'm excited to present this powerful tool that can generate comprehensive test suites for your software quickly and easily, within your IDE. ✅ CodiumAI generates meaningful tests. Tests that actually check the functionality of your code – and suggests them right inside your IDE, as you type. It does this by analyzing and deeply understanding your code, docstrings, and comments, and by interacting with you, the dev. So if you want code that functions like you meant it to, get CodiumAI for meaningful test generation. Try CodiumAI today! You can find CodiumAI / TestGPT in VS Code or JetBrain marketplace. 🙏 We greatly value your input and take all feedback into consideration as we aim to deliver the best possible solution for your software testing needs. Please drop your comments and questions below, we'll be here all day and are excited to hear from you! Itamar, the CEO and Co-founder of CodiumAI
Is Java somewhere in the pipeline?
Maker
, definitely. Probably next in line. Although, recently, on our discord server we got more requests for Ruby..
Congrats on the launch!
Maker
thank you!
Maker
, thank you!
Maker
📌
Hey guys, I'm with the CodiumAI team, I made a few videos to introduce some of our features. Just a taste of what CodiumAI can do :) Basic showcase: Basic configuration options: Reference tests:
Maker
thanks! Great share! One of our users also created a video showing with an excellent example of using CodiumAI to generate tests for the Gilded Rose kata (typescript):
Hunter
📌
Congrats Itamar and team on the launch!
Maker
, thank you Ben! We are lucky to have such an excellent Hunter! We are just Gathering feedback here :)
Congrats on the launch! This looks super useful as we have a growing Python codebase and I'm not always doing the best job when it comes to writing tests due to lack of time... Have installed Codium and will give it a go 👌🏿 What are the next steps for this project?
Maker
Hi Eddie. In a week or two, we plan to upgrade the Pycharm GUI, and add capabilities that are currently only in our VS-Code extension. For example, auto-mocks, example input, example test, give-me-more,... So if you are a Python-PyCharm user, stay tuned :-) Under the hood, a lot is going on. We will definitely continue to improve the quality of our tests, enable them to have a larger context, and add capabilities and features.
Maker
Thank you, Eddie! I hope our product will benefit you. Next, we are planning to support more languages, and more IDEs, we will, of course, keep improving the test results (getting feedback from users will certainly help!) and we are planning to add Team's plan with more advanced capabilities. I invite you to register for our newsletter and stay tuned 🌻
Maker
, thank you for asking! 1> We wish to make sure that almost any type of code (different frameworks, different languages) is well supported by CodiumAI. 2> We want to improve our UX/UI according to feedback we hear from our dear users. These are the top urgent items in the roadmap. In our seed funding announcement, we share a longer roadmap of our plans!
This is really awesome. I'll let our team try it and let you know how it went. Can you share some results so far? like do devs trust this?
Maker
Hi Nevo, Thank you for your question. We constantly benchmark on HumanEval Test Generation Task among other benchmarks internal benchmarks. On HumanEval Test Generation, CodiumAI's TestGPT delivers tests with higher Branch Coverage compared to simple Test completion with GPT3.5-Turbo (97.3% vs 92%) and a higher test pass rate of 97% vs 61%.
That's interesting! I'm not a tech person, but as Product Manager I know that `testing` is one the most crucial steps in shipping a product/feature. Glad if there's a tool to help the engineers (and testers) to prevent a `hotfix/rollback` required once a bug/defect found in the production env. Good luck!
Maker
, thank you! By the way, in the long term, we hope to introduce the concept of "executable specification". In such a future, Product Managers will also be able to test code behavior. You can read a bit about it here:
Amazing, will give it a read!
Congratulations on your launch! Brilliant idea to leverage TestGPT to generate test cases, catch bugs, and check code. Looking forward to putting this through the paces!
Maker
, thank you! We really want to help developer to make code logic testing a less tedious and frustrating task... it could even be a fun experience.
Generating test cases using AI sounds interesting, writing test cases is a challenge. Congratulations team codium.
Maker
, agree! Generating meaningful tests is a challenging task, even with the latest AI capabilities! And we are serious about it. We're so excited to announce our first milestone today, and we'll keep adding capabilities and features, and improving our product accordingly.
Writing tests is a painful problem for us devs. Generating it via AI will be very useful
Maker
, definitely ! It could even be fun. I just tried giving CodiumAI this general instruction: "Add funny, pirate-like, docstrings. Make them different for each test." and got this test: >>> # Tests that a call is dispatched to an available operator. tags: [happy path] def test_dispatch_call_to_operator(self): """ Ahoy matey! Let's test if a call can be dispatched to an available operator. If there be an operator available, the call should be taken and the test should pass with flying colors! """ operator1 = Operator(1, "Jack Sparrow") operator2 = Operator(2, "Blackbeard") call = Call(Rank.OPERATOR) call_center = CallCenter([operator1, operator2], [], []) call_center.dispatch_call(call) assert call.employee == operator1 or call.employee == operator2
Haha I was wondering when we’d see the first app of this genre. Can’t wait to have my team try it!
Maker
, thank you Philip. I really appreciate such an endorsement from the maker of ! We would love to hear your team feedback!
Maker
Thanks Will be glad to hear your team's feedback about the tool :-)
123
•••
Next