Just hooked Context.dev to my OpenClaw. Blown away!
I am using it now (will explore more use cases later) as a meeting prep.
Dropped the name of the person I'm meeting with to my agent, it used Context's API, then created the PERFECT meeting prep using everything it could find on that person.
It's like putting your agent on steroids.
Context.dev
@yahia_bakour3 Hey Yahia!
Awesome product, we plan to integrate it with the product we're building. Hopefully it improves our agents web capabilities :)
Cheers!
Context.dev
@ankushkun Amazing! Happy to help with the integration, my email is yahia@context.dev if you have any questions.
Content Writing Jobs
@yahia_bakour3 let's goooo Yahia!
@yahia_bakour3 This product looks really cool. How does it get around user permission restrictions? Often, we don't want to grant access to overly sensitive
Context.dev
@auula_ hey! what type of permission restrictions?
Congrats on launch #2 @yahia_bakour3 — "extract structured data into your own schema" caught my eye. I spend a lot of my time building exactly this kind of pipeline for e-commerce catalog data, so two questions from that trench:
How do you handle sites behind serious bot protection (Akamai/Kasada-tier)? Is the escalation abstracted away, or do those URLs fail with an error I can act on?
And is JS rendering on by default, or a per-request flag with its own latency + pricing cost? Recently when I looked for a solution related to it, came across this nice model from https://huggingface.co/jinaai/ReaderLM-v2 Jina AI, its really good.
Context.dev
@akbar_b Excellent question
For context (pun): I'm the founder, i also wrote 90% of the code myself, probably half of that by hand.
I built the API i always wish i had, which means
per minute rate limit, no concurrency bs
relentless focus on quality + cost efficiency
permanent backwards compatibility
Every single request is JS rendered.
1 credit = 1 successful scrape, even if we had to go to the moon to get the data.
Stealth is built in and automatic.
@yahia_bakour3 thats wonderful hear every request is JS rendered, will definetly give a strong try :)
the brittle scraping problem is real. every ai agent i've built ends up with a graveyard of playwright scripts held together with hope. one clean api for "the web as markdown" is where we should have started.
genuine question: how do you handle sites that fingerprint requests? does the api rotate infrastructure or is that not really an issue at your scale yet?
Context.dev
@thenameisarian everything is handled for you, we do upwards of 40M requests per month right now and climbing super fast.
We're set up for scale.
Hey @yahia_bakour3, I've been following you and context.dev for some time. Congrats on the launch!
I'm curious to ask, what's the main differentiator between a product like this and Tavily?
I personally had concerns about the accuracy/quality of info coming from Tavily - curious to hear your thoughts.
Context.dev
@ziyad_elhamzawi Tavily is search, they built their own index of the web, hence why so many people have issues about the quality
We have world class extraction infrastructure, so it's far more accurate since we always go and grab data in whatever format from the source directly!
Spent a few minutes pulling structured data from a couple of sites and it just worked, no fiddling with selectors. The brand extraction endpoint was a nice surprise, saved me wiring up a separate service.
Context.dev
@idemx532 we have a relentless focus on quality + cost efficiency.
The goal is, we're always cheaper than if you try to stitch together an in-house solution, and always higher quality than ANY other competitor.
We are 1s slower on avg than other competitors, but for the tradeoffs mentioned, it's never been a blocker.
Pricing tied to successful scrapes only looks useful! Paying for failed fetches could be painful, I know this from own experience. Curious on the stealth layer as plenty of sites serve completely different content by visitor country (price, availability, language)... Can I pin the exit region per request or does the geo just fall out of whatever proxy the pool grabs that day?
Context.dev
@artstavenka1 yep the country parameter is in there!!
Voquill
Interesting. Congrats on the launch. How does it handle sites with aggressive bot protection or frequent layout changes?
Context.dev
@henry_habib we handle both. you never have to worry about a thing :)