1
Vote

Multiple threads problem

description

Hello,

I've recently tried to use NCrawler from WinService application and faced to strange problem - when I try to crawl sites which have at least 100-200 pages crawler silently stops to work. Experimenting I discovered that if crawler uses only one thread (MaximumThreadCount = 1) it works correctly even for sites with 25000 pages. Otherwise at some point it stops to work without noticeable error messages...

Can someone please advise how to solve this problem?

Thanks in advance,
Mick.

comments