How can I best manage and sequence the repeated firing of threads for a web
spider that uses TIdHttp objects? I have looked at this problem from several
angles and still haven't got a mental grasp of it.
I have 12 threads with TIdHttp objects and I'm using a TDataSet in the main
thread to hold the parsed href URLs from the html returned from within a
Synchronize routine on each thread. I also have a TQueueList to hold
pointers to the available threads that aren't currently busy downloading.
My problem is the restarting the TThreads after the available threads or
URLs have been temporarily exhausted. What can I use to signal the main
thread to pop a thread from the queue when a thread or a URL again becomes
available?
