V-ASK: A Visual Analytics of Spending and Kinematics Application to Explore and Identify Suspicious Activities

Archie Quiambao Dolit, Nurulasyiqah Mohammad Taha, Kevin Magic Rialubin Sunga


School of Computing and Information Systems, Singapore Management University

Objective

To use interactive visual analytic techniques on financial and movement data to assist law enforcement with their investigation into the mysterious disappearance of several GAStech employees.

Using interactivity, we’re able to bring together disparate data together to extract insights such as linking location with transaction information to identify credit card owners or mapping unofficial relationships using transaction patterns.

Approach

We apply a simplified interactive design and drill down framework - see Figure 1. With our users’ objectives in mind, we structure our application to start at a high-level aggregation. From there, we incorporate the following interactive dynamics: navigating, filtering and sorting, selecting, and sharing annotations to enable the user to drill down to more granular levels of detail.
Left: Interaction Framework. Right: Drill Down Framework.Left: Interaction Framework. Right: Drill Down Framework.

Figure 1: Left: Interaction Framework. Right: Drill Down Framework.

In addition to the packages in Figure 2, we use several geospatial R packages for handling the movement data: sf, raster, and tmap. We also use visNetwork and collapsibleTree for visualising networks. For interactivity, Plotly is invaluable especially given its compatibility with ggplot.
R Packages

Figure 2: R Packages

Results

Spending

The bar chart in Figure 3 shows the number of transactions at each location. Selecting a bar from the chart generates a box plot that enables a drill down into anomalous transactions at that location.

Top: Bar Chart of Number of Transactions by Location., Bottom: Box plot of Transactions at Selected Location.Top: Bar Chart of Number of Transactions by Location., Bottom: Box plot of Transactions at Selected Location.

Figure 3: Top: Bar Chart of Number of Transactions by Location., Bottom: Box plot of Transactions at Selected Location.

Patterns of Life

Figure 4 is a visualisation of vehicle paths and points of interest (POI). Clicking on a POI surfaces a tooltip that surfaces details such as duration of stay at the POI.

Car ID 28 Vehicle Path on 2014-01-06 Shows Irregularities

Figure 4: Car ID 28 Vehicle Path on 2014-01-06 Shows Irregularities

Figures 5 and 6 bring together financial and movement data. Through the use of filtering and selecting, it is possible to identify the owner of a credit card by narrowing down who was at a given location when a credit card transaction was made.

Table of Credit Card Transactions Filtered for 2014-01-12 and Desafio Golf Course

Figure 5: Table of Credit Card Transactions Filtered for 2014-01-12 and Desafio Golf Course

Top image: POIs on 2014-01-14. The POIs closest to the Desafio Golf Course are selected. Bottom image: The details of the selected POIs in tabular format.Top image: POIs on 2014-01-14. The POIs closest to the Desafio Golf Course are selected. Bottom image: The details of the selected POIs in tabular format.

Figure 6: Top image: POIs on 2014-01-14. The POIs closest to the Desafio Golf Course are selected. Bottom image: The details of the selected POIs in tabular format.

Relationship Networks

Figure 7 visualises the official relationships of GASTech employees using Collapsible Tree and an interactive data table.

Top: Tree Visualisation of GASTechs Engineering Drill Technician Department. Bottom: Table Rendering of the Tree.Top: Tree Visualisation of GASTechs Engineering Drill Technician Department. Bottom: Table Rendering of the Tree.

Figure 7: Top: Tree Visualisation of GASTechs Engineering Drill Technician Department. Bottom: Table Rendering of the Tree.

Figure 8 is an interactive network of transaction data, which has been enriched by credit card ownership mapping generated from the ‘Patterns of Life Kinematics’ module

Left: Network for transactions made at Chostus Hotel. Right: The details of the transactions from Chostus Hotel.Left: Network for transactions made at Chostus Hotel. Right: The details of the transactions from Chostus Hotel.

Figure 8: Left: Network for transactions made at Chostus Hotel. Right: The details of the transactions from Chostus Hotel.

Future Work

  1. Employee-to-employee network graph using movement data to capture relationships that do not involve transaction data.

  2. Network graph of credit card and loyalty cards to visually identify mappings that deviate from 1 credit card to 1 loyalty card. For example, 1 credit card to multiple loyalty cards.