Strategy Page notes that military digital intelligence technology is increasingly making its way into the civilian economy.
Several small commercial firms are producing software systems that enables non-military users to quickly, often instantly, analyze large quantities of digital data to track trends. Developers of this software are building on decades of work in this area plus improved communications and computer technology.
For example, one of these firms ... offers what they describe as AI (Artificial Intelligence) powered software that quickly performs geospatial analysis on huge collections of commercially available data from satellite, UAV, balloon and other images, along with phone geolocation data. This rapid analysis provides accurate predictions about vehicle sales, crop yields and insurance risks.
These techniques were first developed by the military after 2001, to detect and track threats. This included terrorist attacks or the actions of irregular fighters as well as the effectiveness of friendly forces. Intelligence agencies also used it to track the strategic (wide scale, long term) capabilities of nations and their military forces. The military and intel agencies often did this by adapting commercial security software. Now there is so much commercial data available that potential users find the services ... affordable and effective for many business applications.
What made this all possible was the appearance, since the 1990s, of huge quantities of data and inexpensive supercomputers to analyze it.
. . .
Since the 1990s the U.S. has been using software to help scour satellite and aerial recon pictures for useful information. There were simply not enough trained photo analysts to examine the growing number of photos generated in the course of intelligence work. A related problem was the boredom of watching videos for hours. This problem was gradually alleviated by the use of pattern matching software that could detect movement that was in need of human attention.
. . .
By the 1990s there was a shift from analog to digital video and pictures. With digital it was easier to translate the video into numbers, and then analyze those numbers. Government security organizations have been doing this for some time but after the fact. It's one thing to have a bunch of computers analyze satellite photos for a week, to see if there was anything useful there. It's quite another matter to do it in real time. But computers have gotten faster, cheaper, and smaller in the last few years, and programmers have kept coming up with more efficient algorithms for analyzing the digital images. Commercial firms soon had software on the market that could analyze, in real time, video and alert a human operator if someone, or something you are looking for, appears to be there.
. . .
The new systems are possible because GPU data processing allows older video to be scanned faster than real time, allowing a lot of valuable information to be extracted from video taken years ago.
There's more at the link.
That's pretty impressive compared to this technology's formative years, which we discussed back in 2010. We discussed part of its new civilian application, and its implications for our personal privacy and security, in November last year.
What concerns me is that this new technology also makes it much easier for nation-states to gain access to potentially game-changing intelligence about an enemy state, using only public-domain records. A nation no longer needs to send reconnaissance flights over another country, or launch satellites of its own. It can purchase, often relatively cheaply, digital images from commercial satellite operators or local surveying firms, and can buy entire libraries of past images from archives if it so wishes. It can then analyze that data hoard using these new technologies, and gain all sorts of intelligence about target locations, methods of access, personnel traffic patterns, and so on. This might then be used in strategic or tactical military plans and operations.
To give just one example, the Pantex nuclear warhead facility near Amarillo, Texas, is a strategic asset to the USA - the only one of its kind in the country. If an enemy state wanted to destroy our warfighting capability, it would be a very high-value target. Therefore, as might be expected, stringent security measures are in place to make gathering information about it very difficult. However, what if a potential enemy state were to use modern analytical techniques on commercially available data about not just the site, but the area around it? Pattern analysis of traffic to and from the plant would show how goods reached it and/or were dispatched from it, and the rail and road connections it used. The vehicles used by its personnel could be tracked to and from their homes. Those connections and/or personnel might be targeted by unnamed, unidentified "terrorists", thereby causing crippling indirect damage to the Pantex facility, without any overt act by a nation-state that might result in its identification, or retaliation against it.
The same thing applies to commerce and industry. A few weeks ago we looked at China's worldwide logistics software, and how it provides that country with competitive advantage and priceless commercial intelligence. I'm sure its government uses this sort of analytical software on the information thus obtained, applying it to its geopolitical advantage. Frankly, they'd be fools not to do so - and the Chinese are emphatically not fools. Are we doing the same thing? I hope so, and I'm sure commercial firms here are doing so: but our administration is currently so focused on political correctness and partisan infighting that I can't help but wonder whether official bodies are doing all they could in that regard.
All in all, these commercial applications of digital intelligence analysis strike me as very much a two-edged sword. We can use them to our advantage, but our enemies are doubtless using them for theirs as well; and there's usually far more freely available digital information to analyze about our open society than there is about more closed ones.
Food for thought.