This demo web crawler illustrates how identity-based tokens can be used to access and crawl protected websites.There are two sample URLs provided: