The VGG Face Finder (VFF) Engine

Transcription

1 The VGG Face Finder (VFF) Engine Performs a visual search over a dataset of images with faces Automatically finds images matching your query within the dataset Input can be a text string or an image It can be used to make your images searchable

2 How to make your images searchable 1.Start VFF 2. Remove previous demo images and metadata (if present) and copy your own 3. Login to the administrative tools 4. Stop the backend engine 5. Remove previous backend data 6. Start the processing of your images 7. Input data check 8. Wait for the image processing pipeline to finish 9. Start the backend engine 10. Search your images!

3 1. Start VFF Start VFF using Kitematic as described in Mac: Windows: Linux: Start VFF using the command-line or the helper scripts, as described in

4 2. Copy your own images and metadata Remove any previous file in [MY_FOLDER]/vgg/mydata/images/mydataset (WARNING: Remove the contents of the folder but not the folder itself) Please take the following into account: Only the following image extensions (uppercase or lowercase) are allowed:.jpeg,.jpg,.png,.bmp,.dib,.tiff,.tif,.ppm Do not mix images with other data files as this will interrupt the data ingestion If your files are larger than 2 mega-pixels, please make sure that your docker service has enough memory allocated (at least 4 GB) before attempting the data ingestion, see Win: Mac:

5 2. Copy your own images and metadata If you are adding new metadata or your images have no metadata, remove the [MY_FOLDER]/vgg/mydata/metadata/indexdir folder (if present) as well as any previous file in [MY_FOLDER]/vgg/mydata/metadata/mydataset (WARNING: in this case do not remove the folder itself). Then, copy your own CSV file in [MY_FOLDER]/vgg/mydata/metadata/mydataset Remove this folder completely (if present) Remove just this file and other files INSIDE the folder, but not the folder itself

6 3. Login Use the Sign In link in the top-left corner of the VFF home page to go to the login page. If you are already signed in, use the Admin Tools link and go to Step 4. Use the credentials user: admin passwd: vggadmin

7 4. Stop the image classification engine Go to the Manage Backend Service tab and Stop the backend service

8 5. Remove previous backend data If you removed files as in step #2, you should remove the existent backend data. Go to the Manage Backend Data, and under CLEAR BACKEND DATA press the Clear button. This is NOT necessary if you are just adding new images

9 6. Start the processing of your images Go to the Manage Backend Data, and under DATA INGESTION make sure the Input Type is set to Images (because this example does not deal with videos) and then press the Ingest button. The process for Videos is similar, but you can only input a text file with the COMPLETE path to the videos.

10 7. Input data check VFF always checks the images you are providing as input. If your input contains invalid files or files that are not images the ingestion process will not start. If you are submitting a large number of files, VFF might present a screen similar to the one below while checking your input files. NOTE: Videos are not checked!

11 8. Wait for the image processing pipeline to finish Wait until your images are processed (100 images if you used the sample images)

12 9. Start the image classification engine Go to the Manage Backend Service tab and Start the backend service

13 10. Go back to the search page Click on the Home link to go back to the main page and start a query!

14 Remember to Stop VFF Stop VFF using Kitematic as described in Mac: Windows: For Linux: Stop VFF using the command-line or the helper scripts, as described in

15 Data Ingestion Tips 1. If [MY_FOLDER]/vgg/mydata/images/mydataset is empty or if you just want to ADD A FEW IMAGES to your dataset, you can also press the Choose Files button shown in step #6, and select manually the files you want to add. Note that you can only select files, not folders. The new files will be automatically copied to [MY_FOLDER]/vgg/mydata/images/mydataset. 2. If you want to add a large number of images, and you choose the method described in step #6 for the data ingestion (i.e., ingesting the complete images folder), the input data check in step #7 might take a long time because the COMPLETE images folder is scanned to acquire the paths to the files. To avoid this, create a text file (with extension.txt ) with the paths to your image files, relative to the folder [MY_FOLDER]/vgg/mydata/images/mydataset. After that use the Choose Files button shown in step #6 and specify the text file you created. This will avoid the folder scanning and the data ingestion will start immediately.

16 Metadata Tips 1. The format of the metadata file in described in the README file at