We were unable to load Disqus. If you are a moderator please see our troubleshooting guide.

Daniel Ballesteros • 4 years ago

If someone need it, heres the working script that you need to paste in your web:

<script type="text/javascript">
window.setTimeout(function () {
parent.postMessage("sitemapgenerator:: "+JSON.stringify(window.document.body.innerHTML),"*");
}, 3000);
</script>

Sadiq Pang • 4 years ago

Hi,
I generated a sitemap using this tool and attached it with my web app, but when testing the site url with google search console it says that 'URL is not available to Google', what can I do for this ?

Renato Parreira • 4 years ago

Hi, nice tool!
Everything worked perfectly here.
Can I automate this process somehow?
The website I used for create dynamic links everyday so I would need to update the sitemap regurlarly...

VISUALZ • 5 years ago

I'm working on a new version built in ng7. That will work better, incorporate your suggestions and should be out shortly. I'm about halfway done.

VISUALZ • 5 years ago

Hey guys this is back up at botmap.surge.sh

Alexandre • 5 years ago

Hi VISUALZ

Thank you for your work. Great job.
My site is a angularjs 1 page : https://airdropers.io and from what I see; your app too.

I have tried to add some robots.txt rules ( that are working on Google Search Engine); but the excluded pages are still taken into green state from the crawler.

I found your code here https://github.com/madchops...
I would like to generate the sitemap on a daily / weekly basis within my factory process.
Is it something already possible ?

Regards,
Alexandre

Alexandre • 5 years ago

Rules added :
---
User-agent: *
Disallow: *search*
Disallow: *admin*
Disallow: *uid*
Disallow: *terms*
Disallow: *disclaimer*

----
but even with that, url including for example "dashboard?uid=" are sitemapped

Parth • 5 years ago

@Karl not working for dynamic & nested routes in my application which is created in angular 5.

VISUALZ • 5 years ago

The bot still crawls href attributes. It will crawl dynamic routes as long as it finds an href with the URL. Sometimes sites need to be built to be crawled that is the essence of SEO. So for example you may have a click event that opens a page or a state, that is not connected to a URL. This will be uncrawlable (for now) by this bot. I have converted click functions into functions that output a url and called them in the href prop instead of using the click js event to solve this in the past.

Sabhari Alagapan • 5 years ago

Hi VISUALZ , The website for which I wanted to generate sitemap is built with React JS on WordPress.

www.fourkites.com

I checked by installing BotMap.io in my local machine, it worked well but it is not picking up the WordPress pages which generated through posts. Can you please help me on that?

Thanks.

VISUALZ • 5 years ago

Copy the script to your site.

Hanry • 5 years ago

Hi
Cannot scan sites that use https.
Example: https://stalkig.com/
can you help me?

VISUALZ • 5 years ago

Https should work fine. I've used it on many https sites. Make sure the script is installed. I did not see it on the example you sent.

Gandalf life • 5 years ago

Thanks for it :)

Sam Lepak • 5 years ago

Any solutions for react apps, or for react router v4?

VISUALZ • 5 years ago

Should work as long as your routes are in the href attribute so the bot can crawl it

Boris Egan • 5 years ago

VISUALZ I have the script installed on my site, but am getting the "Error! Your homepage URL does not have the script installed. See directions below." message. My site is https://www.coinopinions.com . I am using next.js, which makes it difficult to have the script at the very bottom right before the closing <body> tag, but it is there in the body. Would you be so kind as to take a look? Thanks in advance.

VISUALZ • 5 years ago

Hmm... checking

VISUALZ • 5 years ago

I would keep playing around with including the script. The script looks a little funky on your site. I will make an npm package :)

Boris Egan • 5 years ago

Thank you. Could you specify what you mean by 'a little funky'? I copied it as is - if you could point me in the direction of what to tweak, I could definitely try.

Francesco Rossi • 5 years ago

Hello, does it work also following dropdown select menu in a form?

Saida Rao • 5 years ago

my site is loaded but only few links not all links are loaded

VISUALZ • 5 years ago

The bot will only crawl href urls in the site...

Nandkishor • 5 years ago

VISUALZ I have added sitemap generator script in index.html page before closing body but it displays an error message i.e "Error! Your homepage URL does not have the script installed. See directions below." My URL is https://www.paycheckalpha.com

Please give me suggestion for the above problem

VISUALZ • 5 years ago

Your site is passing the x-frame-options header

In the notes above:
Passing the "X-Frame-Options" header will prevent the crawler from working properly. Please make sure you are not passing this header back in your page responses.

That will prevent the crawler from working.

VISUALZ • 5 years ago

Weird. Not seeing a reason other than... Got you. Found the issue

VISUALZ • 5 years ago

checking for ya

verishal • 5 years ago

Hello
i'm doing try create site map in angular js but given me error "Error! Your homepage URL does not have the script installed. See directions below."
can you help me
what i do

VISUALZ • 5 years ago

Confirm that you have the script on the pages being crawled/your index file? What is the URL?

verishal • 5 years ago

VISUALZ .Which one need the script on the pages for crawled

verishal • 5 years ago

thank you VISUALZ for response me . My url https://www.paycheckalpha.com/
.Didn't create site map .Why?

VISUALZ • 5 years ago

You need to add the script above

This one:

```

<script type="text/javascript">
var _0xaea9 = ["sitemapgenerator:: ", "innerHTML", "body", "document", "stringify", "*", "postMessage", "setTimeout"]; window[_0xaea9[7]](function () { parent[_0xaea9[6]](_0xaea9[0] + JSON[_0xaea9[4]](window[_0xaea9[3]][_0xaea9[2]][_0xaea9[1]]), _0xaea9[5]) }, 3000);
</script>
```

verishal • 5 years ago

Hello VISUALZ . i have add script in bottom of the page in index.html .but how to do test .Is working ya not . please suggest me .

VISUALZ • 5 years ago

Hey verishal what is your domain URL?

Hieu Huynh • 5 years ago

I same the issue. It's not working

VISUALZ • 5 years ago

The generator is working. What is the domain of your site. I can look into it.

VISUALZ • 5 years ago

What is your domain? I'll check

verishal • 5 years ago

Ok @karl .but How can i do test the sitemap. Is generate ya not? can you suggest me

verishal • 5 years ago

Thank you VISUALZ . but where i put this script . In index.html Ya other in file . because my web site create in angular js . What i do follow next step @karl ?

VISUALZ • 5 years ago

I would copy it from at the top of the page, not from the comment here.

VISUALZ • 5 years ago

... and place it in the file with your fb-root.

Bharath Chowdary • 5 years ago

Hi, I'm not seeing all URLs crawled during sitemap generation for my react.js website. It was working fine a week ago. Seems something went wrong recently. Could you please check?

VISUALZ • 5 years ago

Hi, Ya I'll check. What is your url if you don't mind sharing. It may help.

Bharath Chowdary • 5 years ago

Thanks for the quick reply Karl !
Here is my dev instance: http://sproaddev.uvaaninfot...

VISUALZ • 5 years ago

Try again please. Fixed.

Bharath Chowdary • 5 years ago

Some problems again? I can only get 5 links listed now.

Vitaliy Malets • 5 years ago

I have the same problem (

VISUALZ • 5 years ago

Ok the 5 page limit is fixed.

Vitaliy Malets • 5 years ago

It works! Thank you so much!

Bharath Chowdary • 5 years ago

Thanks Karl. It’s working fine now.