Ben Lang

CodiumAI - Generating meaningful tests for busy devs

by
CodiumAI analyzes your Python, JS, or TS code and generates meaningful tests to catch bugs before you ship. With CodiumAI, you can easily and quickly generate comprehensive test suites that help you ensure the reliability and correctness of your software.

Add a comment

Replies

Best
Itamar Friedman
Hello Product Hunt ! 🚀 I'm thrilled to announce the launch of CodiumAI [beta], an innovative solution to generate component testing of your Python, JS, or TS code. 🧪 Testing your code is important. Aside from catching bugs, it gives you valuable insight into your code, and lets you know you’re coding with a purpose. 🌰 But writing non-trivial test cases is tedious, frustrating, and time consuming. And when bugs still pop up, it can be hard to figure out how you missed that edge case. In retrospect, it’s so obvious! 🤝 As devs, we get it. And that’s why we made CodiumAI. As a veteran developer and R&D manager, I'm excited to present this powerful tool that can generate comprehensive test suites for your software quickly and easily, within your IDE. ✅ CodiumAI generates meaningful tests. Tests that actually check the functionality of your code – and suggests them right inside your IDE, as you type. It does this by analyzing and deeply understanding your code, docstrings, and comments, and by interacting with you, the dev. So if you want code that functions like you meant it to, get CodiumAI for meaningful test generation. Try CodiumAI today! You can find CodiumAI / TestGPT in VS Code or JetBrain marketplace. 🙏 We greatly value your input and take all feedback into consideration as we aim to deliver the best possible solution for your software testing needs. Please drop your comments and questions below, we'll be here all day and are excited to hear from you! Itamar, the CEO and Co-founder of CodiumAI
Dean Šoć
@maritamar Is Java somewhere in the pipeline?
Itamar Friedman
@dean_soc , definitely. Probably next in line. Although, recently, on our discord server we got more requests for Ruby..
Aamir Mursleen
@maritamar Congrats on the launch!
Itamar Friedman
@imtiyaz922 thank you!
Itamar Friedman
@aamir_khan_wal , thank you!
Shai Geva
Hey guys, I'm with the CodiumAI team, I made a few videos to introduce some of our features. Just a taste of what CodiumAI can do :) Basic showcase: https://www.loom.com/share/658d0... Basic configuration options: https://www.loom.com/share/22f2d... Reference tests: https://www.loom.com/share/a607c...
Itamar Friedman
@shai_g thanks! Great share! One of our users also created a video showing with an excellent example of using CodiumAI to generate tests for the Gilded Rose kata (typescript):
Ben Lang
Hunter
📌
Congrats Itamar and team on the launch!
Itamar Friedman
@benln , thank you Ben! We are lucky to have such an excellent Hunter! We are just Gathering feedback here :)
Eddie Forson
Congrats on the launch! This looks super useful as we have a growing Python codebase and I'm not always doing the best job when it comes to writing tests due to lack of time... Have installed Codium and will give it a go 👌🏿 What are the next steps for this project?
Tal Ridnik
@ed_forson Hi Eddie. In a week or two, we plan to upgrade the Pycharm GUI, and add capabilities that are currently only in our VS-Code extension. For example, auto-mocks, example input, example test, give-me-more,... So if you are a Python-PyCharm user, stay tuned :-) Under the hood, a lot is going on. We will definitely continue to improve the quality of our tests, enable them to have a larger context, and add capabilities and features.
Almog Lavi
@ed_forson Thank you, Eddie! I hope our product will benefit you. Next, we are planning to support more languages, and more IDEs, we will, of course, keep improving the test results (getting feedback from users will certainly help!) and we are planning to add Team's plan with more advanced capabilities. I invite you to register for our newsletter and stay tuned https://www.codium.ai/#home-wait 🌻
Itamar Friedman
@ed_forson , thank you for asking! 1> We wish to make sure that almost any type of code (different frameworks, different languages) is well supported by CodiumAI. 2> We want to improve our UX/UI according to feedback we hear from our dear users. These are the top urgent items in the roadmap. In our seed funding announcement, we share a longer roadmap of our plans! https://www.codium.ai/blog/codiu...
Nevo Alva
This is really awesome. I'll let our team try it and let you know how it went. Can you share some results so far? like do devs trust this?
hussam lawen
@nevoalva Hi Nevo, Thank you for your question. We constantly benchmark on HumanEval Test Generation Task among other benchmarks internal benchmarks. On HumanEval Test Generation, CodiumAI's TestGPT delivers tests with higher Branch Coverage compared to simple Test completion with GPT3.5-Turbo (97.3% vs 92%) and a higher test pass rate of 97% vs 61%.
Razii Abraham
That's interesting! I'm not a tech person, but as Product Manager I know that `testing` is one the most crucial steps in shipping a product/feature. Glad if there's a tool to help the engineers (and testers) to prevent a `hotfix/rollback` required once a bug/defect found in the production env. Good luck!
Itamar Friedman
@razii_abraham , thank you! By the way, in the long term, we hope to introduce the concept of "executable specification". In such a future, Product Managers will also be able to test code behavior. You can read a bit about it here: https://www.codium.ai/blog/codiu...
Razii Abraham
@maritamar Amazing, will give it a read!
Farooq (SF Ali) Zafar
Congratulations @maritamar on your launch! Brilliant idea to leverage TestGPT to generate test cases, catch bugs, and check code. Looking forward to putting this through the paces!
Itamar Friedman
@sfali789 , thank you! We really want to help developer to make code logic testing a less tedious and frustrating task... it could even be a fun experience.
Karan bhansali
Generating test cases using AI sounds interesting, writing test cases is a challenge. Congratulations team codium.
Itamar Friedman
@karan_bhansali , agree! Generating meaningful tests is a challenging task, even with the latest AI capabilities! And we are serious about it. We're so excited to announce our first milestone today, and we'll keep adding capabilities and features, and improving our product accordingly.
Anil Matcha
Writing tests is a painful problem for us devs. Generating it via AI will be very useful
Itamar Friedman
@matcha_anil , definitely ! It could even be fun. I just tried giving CodiumAI this general instruction: "Add funny, pirate-like, docstrings. Make them different for each test." and got this test: >>> # Tests that a call is dispatched to an available operator. tags: [happy path] def test_dispatch_call_to_operator(self): """ Ahoy matey! Let's test if a call can be dispatched to an available operator. If there be an operator available, the call should be taken and the test should pass with flying colors! """ operator1 = Operator(1, "Jack Sparrow") operator2 = Operator(2, "Blackbeard") call = Call(Rank.OPERATOR) call_center = CallCenter([operator1, operator2], [], []) call_center.dispatch_call(call) assert call.employee == operator1 or call.employee == operator2
philip tannor
Haha I was wondering when we’d see the first app of this genre. Can’t wait to have my team try it!
Itamar Friedman
@ptannor , thank you Philip. I really appreciate such an endorsement from the maker of https://deepchecks.com/ ! We would love to hear your team feedback!
Tal Ridnik
Thanks @ptannor Will be glad to hear your team's feedback about the tool :-)
123
•••
Next
Last