User Tools

Site Tools


projects:wifi:scan_3

This is an old revision of the document!


Project Wifi Scanner: Data Scan 3

Full scan of March 2020 - are people self isolating for COVID-19?

Extract just March's data, then import it to the database:

grep -E "^2020-03" tcpdump.log > /tmp/march.wifi.log
php trim.php /tmp/march.wifi.log > march-trimmed.csv

Raw data for March was 21Gb, approx 168 million lines.

Then import to the mySQL database:

LOAD DATA INFILE 'march-trimmed.csv' INTO TABLE wifi_data;

Basic Stats

SELECT DATE(seen_time), COUNT(mac) FROM simple_data WHERE DATE(seen_time) >= '2020-03-01' AND seen_time <= '2020-04-01' GROUP BY DATE(seen_time) INTO OUTFILE '/tmp/march-rawdata.csv';
DateHits
2020-03-01119994
2020-03-02122174
2020-03-03127180
2020-03-04138274
2020-03-05142102
2020-03-06150793
2020-03-07142417
2020-03-08135554
2020-03-09137481
2020-03-10125954
2020-03-11131901
2020-03-12135391
2020-03-13127303
2020-03-14118234
2020-03-15113126
2020-03-16106237
2020-03-17110425
2020-03-18106013
2020-03-19108127
2020-03-20115171
2020-03-21113031
2020-03-22108512
2020-03-23118570
2020-03-24110394
2020-03-25109092
2020-03-26113263
2020-03-27117891
2020-03-28114374
2020-03-29111808
2020-03-30116348
2020-03-31119926
projects/wifi/scan_3.1585713435.txt.gz · Last modified: 2020/04/01 04:57 by neil