Are your Full Text Indexing numbers not catching up? Try this...

With datasources growing and growing, some by 20,000 files a day, the problem of Full Text Indexing keeping all of the documents indexed and keeping them up to date has become an ever increasing problem.  Some users have been stuck over 1 million documents un-indexed for a while now with no help in site.  After some testing we have a solution for this, with the links below users have successfully indexed 1 million un-indexed documents in a weeks time.  The big caveat to this is that this WILL NOT work unless the prerequisites are followed and please note not everyone will see the expected results that some other users may see.  The hardware of the machine is the limiting factor, so like I have said please do not attempt this unless you can meet the prerequisites.  

First we need to understand how the Automated File Processing numbers are generated here:

http://communities.bentley.com/products/projectwise/content_management/b/weblog/archive/2013/10/25/why-won-t-my-automated-file-processing-unprocessed-files-statistic-go-down.aspx

The first optimization link is to add in another set of processors to increase processing production:

http://communities.bentley.com/products/projectwise/content_management/w/wiki/increasing-your-full-text-indexing-processing-power.aspx

The second link is how to properly adjust your processing configuration numbers, this deals with numbers sent to the queue, retry time and time to check for documents.  This process is ever growing that will require you to monitor your system until you find the right numbers for you:

http://communities.bentley.com/products/projectwise/content_management/b/weblog/archive/2012/08/08/optimizing-automated-file-processing.aspx

Also if you need to push your index off on another drive, which i would recommend because the index will not be fighting for IO with the operating system, please follow this:

http://communities.bentley.com/products/projectwise/content_management/b/weblog/archive/2010/12/02/is-the-projectwise-index-taking-up-all-of-your-drive-space.aspx

And last but not least, if you are running in a cluster, this blog needs to be followed so that your users can properly search:

http://communities.bentley.com/products/projectwise/content_management/b/weblog/archive/2012/06/19/how-to-configure-ftr-so-searches-work-in-a-load-balancing-cluster.aspx

If you have any further questions on these links please let us know in TSG by either submitting a service request or reply to this blog and I will answer questions here.