Happy Hump Day! Donāt forget to check out our latest newsletter, Maker Stacks. Today, weāre interviewing productivity content creator Francesco DāAlessio on his stack.Ā
Hereās some news:Ā
š Ever wanted to run MacOS on a Gameboy? Someone did it.Ā
š Uber is launching a new, robot-operated delivery service in Japan.
š¤ Barely a week after the latest Gemini models, Google has dropped two new LLMs.
Another AI company is lighting up the headlines, and its name is Groq. Not to be confused with Grok (Elonās sassy AI chatbot), Groq creates AI chips called Language Processing Units (LPUs) which are apparently so fast, they are giving Nvidiaās GPUs a run for their money.
Groq is an āinterface engine,ā not a chatbot, and is built to help the likes of ChatGPT and Gemini run incredibly fast.Ā
According to the CEO, Jonathan Ross, who also founded Googleās AI chip division, Groq accomplishes this by bypassing two bottlenecks that GPUs and CPUs get stuck on: compute density and memory bandwidth.Ā
How fast is it? In a recent demo posted on X (formerly Twitter), Groq, when given a prompt, outputs a factually correct answer, coupled with sources to back it up, in a split second. Thereās no loading animation and no wait times. If you still have your suspicions, you can check out Groqās site, where you can test multiple LLMs on Groqās LPU to see for yourself.
How does it compare? According to tests, Groq produces 247 tokens/second compared to Microsoftās 18. In plain English, that means that theoretically, ChatGPT could run up to 14 times faster if it was built on top of Groq. So yeah, pretty fast.Ā
Over the past week, AI chips have been getting a lot of attention. Nvidia leap-frogged Amazon and Alphabet in market value because of its own chip building efforts . Itās a lucrative business for future tech. To put a tag on it, SoftBank CEO Masayoshi Son is seeking $100B in funding for his own AI chip venture.
Demonstrate Strong AI Governance: Get the ISO 42001 Compliance Checklist
The ISO 42001 framework enables organizations to demonstrate trustworthy AI practices in accordance with global standards. With Vanta, completing the requirements to achieve ISO 42001 compliance can be done in a fraction of the time. 95% of required document templates are pre-built for you, accelerating your path to compliance and helping you build trust. With Vantaās ISO 42001 framework you can:
Vanta's ISO 42001 compliance checklist helps to lay the foundation for what your organization should expect when working towards certification.
- Talently launched an AI assistant that helps you prepare for your next job interview.
- buywith is a shopping assistant that lets you engage with brands and assistants.Ā
- Fusion Copilot uses AI to give you detailed insights into your day-to-day activities.
- Swizzle lets you build apps in your browser with natural language.Ā
- Jet Admin is a visual tool to build and ship your next website faster.Ā
- ChatSimple helps your customers find the parts of your business they need.