Home > Explainable Deep Metric Learning with Applications in Combating Human Trafficking

Explainable Deep Metric Learning with Applications in Combating Human Trafficking

Start:

10/15/2020 at 3:55PM

End:

10/15/2020 at 5:10PM

Location:

(This seminar is a virtual talk)

Host:

College of Engineering close button
headerbottom

Walter Scheirer

Walter Scheirer

VIEW FULL PROFILE Email: walter.scheirer@nd.edu
Phone: 574-631-2436
Website: http://www.nd.edu/~wscheire
Office: 182D Fitzpatrick Hall of Engineering

Affiliations

College of Engineering Associate Professor
Primary interests in Computer Vision, Machine Learning, Biometrics,and Digital Humanities. Specific areas of research include Open Set Recognition, Extreme Value Theory Models for Visual Recognition, Biologically-inspired Learning Algorithms, and Stylometry.
Click for more information about Walter
574-631-2436
Add to calendar:
iCal vCal

While convolutional neural networks have become a transformative tool for many image analysis tasks, it is still common in literature to describe these deep learning approaches as 'black boxes.' To address these concerns, there have been substantial efforts to understand and visualize the features of classification networks, which take in an image and predict a class label. There has, however, been much less work to visualize and understand similarity networks, which learn an embedding that maps similar examples to nearby vectors in feature space and dissimilar examples to be far apart. This talk will focus on efforts to improve these sorts of embedding networks, and visualize and understand them, with a focus on networks trained on hotel recognition, the task of identifying what hotel is seen in a photograph taken in a hotel. Hotel recognition is a challenging recognition problem due to the properties of hotel rooms, including low visual similarity between rooms in the same hotel and high visual similarity between rooms in different hotels, particularly those from the same chain. Building accurate approaches for hotel recognition is important to investigations of human trafficking. Images of human trafficking victims are often shared by traffickers among criminal networks and posted in online advertisements, and these images are often taken in hotels. Using hotel recognition approaches to determine the hotel a victim was photographed in can assist in investigations and prosecutions of human traffickers.

Seminar Speaker:

Abby Stylianou

Abby Stylianou

Dr. Stylianou's research has focused on building very large datasets of images and their metadata, and the deep learning approaches to digest and understand those datasets for a variety of tasks. These tasks include performing hotel-specific image retrieval in order to locate victims of sex trafficking who have been photographed in hotels, making measurements of the natural environment in time-lapse imagery to understand climate change, and observing how individuals interact with the world around them in outdoor webcam images to support better design of the built environment. She is particularly interested in how motivated communities of non-experts can participate in the collection of these datasets and what artifacts and challenges are introduced by capturing data from such diverse populations. She additionally works to understand how computer vision and machine learning solutions to complex geometric and image retrieval problems can be made accessible and understandable to non-technical individuals, such as citizen journalists and law enforcement investigators, through software interfaces designed specifically with non-experts in mind.