Sitebulb
The website auditing tool for SEO consultants and agencies
Start new thread
Ria Blagburn

Sitebulb - Crawl and visualize your website structure

by
Pivot
•

Sitebulb is a website crawler for Windows and Mac that actually audits your site for you, presenting comprehensive lists of prioritised, context-specific hints that bubble up important issues. Sitebulb's intuitive visualizations help you understand deep-rooted issues and better communicate complex ideas with your clients or colleagues.

Add a comment

Replies

Best
Patrick Hathaway
Maker
Hi everyone, I'm the co-founder of Sitebulb. Myself and Gareth (the other co-founder) will be on-hand all day to answer any questions. We started Sitebulb with a vision of creating a website crawler that combines the power and reporting functionality of a cloud-based crawler, with the cost and convenience of a desktop one. Some of the specific pain points we’re addressing are: 1. Scale – Sitebulb saves to a database rather than storing crawl data in RAM, meaning a typical desktop computer can comfortably crawl 500,000+ page websites. 2. Reporting – the reports are designed to highlight potential issues and help SEOs get to the root of the problem without having to manipulate a ton of data. 3. Visualization – Sitebulb’s interactive Crawl Maps help solve one of the most pervasive issues with technical SEO: understanding and communicating website structure. It’s always been important to us that our products are affordable to pretty much anyone doing SEO, which is one of the reasons we’ve focused on desktop products. Our ultimate goal is to help small agencies and consultants do amazing technical SEO work. There's a free 2 week trial for everyone, with no credit card required - just head over to the site and download. If you've got feedback about the tool; we'd love to hear from you. Patrick P.S. Thanks @riaface for Hunting us!
Peyton Hayslette
This looks really awesome. Solid mix of visualization and presentation of opportunities for improvement. Excited to give it a whirl!
Patrick Hathaway
Maker
@peytonhayslette Thanks Peyton, glad you like the look of it. Any questions just ping me.
Paul Shapiro
My favorite part of Sitebulb, especially compared to other, similar products has been the organization of the crawl information. It's just a little bit more in-line with what I'm looking for when auditing a website for any issues.
Patrick Hathaway
Maker
@fighto Thanks for the comment Paul. We tried as best we could to approach it from the perspective of: 'when doing an audit for SEO, how do users work through each section.' Although we had to rip it apart and put it back together again more than a few times!
Stacey MacNaught
Looks great, guys. Quick question - realistically, on a site with say 100,000 URLs (so not absolutely huge) how long would you expect a complete crawl to take?
Patrick Hathaway
Maker
@staceycav Hey Stacey. Well, that question is a little bit like 'how long is a piece of string'. There are a number of variables that affect how long a crawl will take, the biggest one obviously being how many URLs there are. And a site with 100,000 URLs indexed in Google could easily have 300,000 URLs when you include resources, external links etc... But for the sake of argument let's call it 100,000 HTML URLs in total, with no page resources switched on. On most websites it's not healthy (not to mention polite) to crawl TOO fast, so we recommend a speed of 5 URLs/second. At that rate you can crawl a 100k site in about 6 hours (including time to build the reports at the end). However, sometimes even 5 URLs/second is too fast for some websites, and can cause the server to slowdown. Sitebulb is able to detect this and slow it's crawling rate down, so as not to cause any user disruption. For example, I crawled a 100k page site the other day and it took almost exactly 12 hours (~2.8 URLs/second). I've written more on all this here: https://sitebulb.com/resources/g... Thanks for the question!
Tom Davenport
I've been using the beta of this product and it's fantastic. Has replaced Deep Crawl, the former gold standard in technical SEO crawl tools, and gives a nice clear overview of issues to fix. I'm sure there's more to come and they've been responsive to feedback and bugs through the beta, so looking forward to seeing how Sitebulb continues to improve in future. Question for you @hathawayp; where do you see Sitebulb going in the future? Any features you were keen to include that didn't make it to this initial launch?
Patrick Hathaway
Maker
@tomdavenport Hey Tom, thanks for the kind words :) There are a few big features which we are really keen to build, which definitely seem to be in demand based on our feedback so far: - 'Printable' Reports: Generating PDF reports automatically for users, either to be shared internally or sent to clients. - Segments: Allowing users to segment their site based on page type (e.g. 'products', 'blog posts') and building reports/drilldowns based on these segments. - Scheduling: Allowing users not only to queue (as they can now) but also to schedule crawls to run at a specific time.
Wayne Barker

Ive been using this as a beta user for some time and for the price you arent going to find anything else that points you in the right direction like sitebulb does. It makes complex technical issue easier to understand and the exports are super organised.

Pros:

Simple to use. Easy to understand

Cons:

Segmentation ;)

Patrick Hathaway
Maker
Segments are on their way!
Joe Sinkwitz
My agency has been a beta user for the last 6 months and we're pleased with where the product is at. It's better than certain loud amphibians and tech crawlers named after evil space aliens.
Patrick Hathaway
Maker
LOL thanks @cygnusseo - and thanks for your assistance with our launch and throughout the beta. So many helpful people in our community :)
CCarter

I never took SEO audits seriously until I started with the beta of Sitebulb. The interface is easy to use and the segmentation makes organizing and knowing what to focus on effortless!

I already bought a subscription - came here to support a great product!

Pros:

Easy Interface

Cons:

Nada

Patrick Hathaway
Maker
Thank you, and thanks for signing up!
Joona Tuunanen

Started to use Sitebulb when they launched their public beta. Definitely a good alternative to other similar tools with a bit of extra (=crawlmaps). Interesting to see the evolution of this product.

Pros:

Crawlmaps <3, good visualisations, covers most things you need

Cons:

No custom extraction (yet), would be nice to be able to change the colors to match our agencys branding

Patrick Hathaway
Maker
Thanks Joona :) Custom extraction is on the roadmap (we already do it in URL Profiler) but we'd like to do a more comprehensive job of helping users identify the right selectors. Changing colours is a new one! Do you mean the overall interface, or the graphs etc...?
Dan Thornton

I've been using Sitebulb during the beta period, and found it really useful for any projects involving SEO, whether that's doing a quick overview and check, or a full website audit.

I've used most of the competitors, and it seems to be the best yet for being able to run a full website crawl and analysis in a way that's easy to understand and share. Which means I can easily use it to demonstrate to clients without having to explain reams of spreadsheets (which is nice).

Crawled urls by depth is a really nice addition to help locate bottlenecks with navigation and internal linking

Pros:

Nice visualisations which are easy to understand or send straight to clients.

Covers everything from tiny to pretty big sites

Cons:

Adding sharable client reports and page type segments are on the way, and I can't wait.....

Gareth Brown
Maker
Thanks Dan. Client reports and page segments are just the beginning. Our new feature list will keep us busy until 2020!
123
Next
Last