Added the creation of a symbolic link for each json file inserted into the filesystem. The symbolic link pathname is of the form:  {config.storageRoot}/index/{hostname}/{uuid}.symlink Any intervening directories that do not exist ("index" & {hostname}) will be created on demand.
Added the creation of a symbolic link for each json file inserted into the filesystem.
The symbolic link pathname is of the form:  {config.storageRoot}/index/{hostname}/{uuid}.symlink
Any intervening directories that do not exist ("index" & {hostname}) will be created on demand.

This gives us set of indexes into the json/dump directories for a much faster access.  Monitor's 
standard allocation loop can look to these symbolic links rather than having to walk a tree 
searching for new file entries.  As the standard allocation loop finds a symbolic link, it 
fetches the actual file location and enters the relevant information into the database.  It 
then deletes the symbolic link.  The mere existance of a symbolic link means that it is a json 
file in need of processing. 
 
Finding the json file for a specific uuid that isn't already in the database (done by priority 
processing) now requires just looking through the various {hostname} directories for the 
appropriately named symbolic link.



git-svn-id: 0429bb2eb6f71f8cd87fe9410a915008a087abca@410 efcc4bdc-162a-0410-a8af-5b4b46c5376d

KaiRo-at/socorro,pcabido/socorro,pcabido/socorro,yglazko/socorro,luser/socorro,Tchanders/socorro,cliqz/socorro,spthaolt/socorro,bsmedberg/socorro,bsmedberg/socorro,Tayamarn/socorro,KaiRo-at/socorro,AdrianGaudebert/socorro,mozilla/socorro,Tchanders/socorro,KaiRo-at/socorro,adngdb/socorro,linearregression/socorro,luser/socorro,linearregression/socorro,twobraids/socorro,adngdb/socorro,lonnen/socorro,bsmedberg/socorro,m8ttyB/socorro,yglazko/socorro,Serg09/socorro,Tchanders/socorro,luser/socorro,spthaolt/socorro,lonnen/socorro,pcabido/socorro,Serg09/socorro,KaiRo-at/socorro,linearregression/socorro,twobraids/socorro,spthaolt/socorro,mozilla/socorro,Tayamarn/socorro,Serg09/socorro,spthaolt/socorro,Tayamarn/socorro,Serg09/socorro,adngdb/socorro,bsmedberg/socorro,lonnen/socorro,m8ttyB/socorro,rhelmer/socorro,m8ttyB/socorro,linearregression/socorro,spthaolt/socorro,mozilla/socorro,twobraids/socorro,cliqz/socorro,Serg09/socorro,bsmedberg/socorro,Tchanders/socorro,pcabido/socorro,AdrianGaudebert/socorro,adngdb/socorro,Tayamarn/socorro,Tayamarn/socorro,cliqz/socorro,AdrianGaudebert/socorro,Tayamarn/socorro,m8ttyB/socorro,spthaolt/socorro,AdrianGaudebert/socorro,adngdb/socorro,adngdb/socorro,AdrianGaudebert/socorro,AdrianGaudebert/socorro,cliqz/socorro,cliqz/socorro,rhelmer/socorro,rhelmer/socorro,twobraids/socorro,mozilla/socorro,pcabido/socorro,yglazko/socorro,pcabido/socorro,rhelmer/socorro,twobraids/socorro,yglazko/socorro,twobraids/socorro,luser/socorro,m8ttyB/socorro,mozilla/socorro,yglazko/socorro,Tchanders/socorro,luser/socorro,linearregression/socorro,cliqz/socorro,yglazko/socorro,Tchanders/socorro,mozilla/socorro,KaiRo-at/socorro,rhelmer/socorro,KaiRo-at/socorro,rhelmer/socorro,lonnen/socorro,m8ttyB/socorro,linearregression/socorro,Serg09/socorro,luser/socorro