Does Google Crawl URLs In Structured Knowledge?


Google’s John Mueller answered whether or not Google would use hyperlinks in structured knowledge for crawling. Getting hyperlinks found, crawled, after which listed is important to search engine marketing, so any accessible benefit for getting extra pages crawled can be useful.

What Does Google Use Hyperlinks For In Structured Knowledge?

The particular person asking the query desires to know if Google makes use of hyperlinks found in structured knowledge for crawling.

In addition they wish to know if Google doesn’t use the hyperlinks for crawling in the event that they’re simply saved.

Right here is the query:

“Does Google crawl URLs situated in structured knowledge markup or does Google simply retailer the information?”

Google Tries Crawling Many Sorts Of URLs

Mueller’s reply might sound a little bit shocking as a result of, amongst different issues, he mentions that Google would possibly attempt to crawl a hyperlink that’s in a textual content file.

One other focal point is that he says Google will crawl something that “seems to be” like a hyperlink, adopted up with examples of what “seems to be like a hyperlink” means.

Mueller’s reply:

“So for essentially the most half, after we take a look at HTML pages, if we see one thing that appears like a hyperlink, we’d go off and form of like attempt that URL out as effectively.

That’s one thing the place if we discover a URL in JavaScript, we will attempt to choose that up and attempt to use it.

If we discover a hyperlink in form of a textual content file on a website, we will attempt to crawl that and use it.”

Mueller’s reply is a fairly good overview of what Google would possibly do with different hyperlinks, hyperlinks that aren’t conventional HTML hyperlinks with anchor textual content.

What adopted is Mueller’s reminder that each one of those different types of hyperlinks shouldn’t be seen as substitutes for precise HTML hyperlinks, what Mueller calls a “regular hyperlink.”

Mueller strongly recommends utilizing a normal HTML hyperlink if you’d like one thing that performs like a hyperlink.

He continued his reply:

“But it surely’s probably not a traditional hyperlink.

So it’s one thing the place I might suggest if you’d like Google to go off and crawl that URL, be sure that there’s a pure HTML hyperlink to that URL, with a transparent anchor textual content as effectively, that you just give some details about the vacation spot web page.

In case you don’t need Google to crawl that particular URL, then possibly block it with robots.txt or on that web page use a rel=canonical pointing to your most well-liked model, something like that.

So these are form of the instructions I might go there.

I might not blindly assume that simply because it’s in structured knowledge it won’t be discovered.

Nor would I blindly assume that simply because it’s in structured knowledge it is going to be discovered.

It may be discovered.

It may not be discovered.

I might as an alternative deal with what you wish to have occur there.

If you wish to have it seen as a hyperlink, then make it a hyperlink.

In case you don’t wish to have it crawled or listed, then block crawling or indexing.

That’s all completely as much as you.”

Different Hyperlinks

SEOs have created many various types of hyperlinks, a few of which (like “hyperlink mentions”) haven’t any foundation in actuality and are pure conjecture and opinion.

A few years in the past, SEOs started working towards one thing known as Google Stacking, which included including hyperlinks to Google Sheets after which pointing hyperlinks to that Google sheet believing that the apply would assist rankings.

The thought was much like Internet 2.0 hyperlink constructing, the place some SEOs had the mistaken notion that so-called “authority” from a Google-affiliated website would trickle over by means of the hyperlinks on Google Sheets and Google Websites.

Including this to Mueller’s reply about hyperlinks in structured knowledge, Mueller confirmed that Google would possibly crawl hyperlinks in structured knowledge, JavaScript and textual content information. However he additionally mentioned that relating to structured knowledge, Google may not crawl these hyperlinks.

Mueller affirms that it’s greatest to make use of precise hyperlinks if you’d like the facility of hyperlinks.


Watch John Mueller reply the query on the 23:20 minute mark.

Featured Picture:, June 2022. 


Please enter your comment!
Please enter your name here