code_public/ja4-platform
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: CSV generation scripts, API filter params, enriched CSV stubs

Browse Source 
- scripts/generate_bot_ip.py: download Tor exit nodes + curate scanner IPs (1353 entries)
- scripts/generate_bot_ja4.py: 31 bot JA4 fingerprints across 16 families
- scripts/generate_asn_data.py: 38 ASNs + 96 IP-to-ASN prefixes
- scripts/update-csv-data.sh: master orchestrator with --install-stubs
- api.py: add asn_org/country_code/ja4/bot_name filters on detections+scores
- pages.py: add /network route
- csv-stubs: enriched with generated data (Tor nodes, scanner IPs, etc.)

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This commit is contained in:
toto
2026-04-08 15:05:43 +02:00
parent c6ca352db9
commit b6184e6529
14 changed files with 3779 additions and 27 deletions
Download Patch File Download Diff File Expand all files Collapse all files

26
tests/integration/platform/csv-stubs/bot_ja4.csv
View File

@ -1,5 +1,31 @@
t13d030500_ffd59bab1b39_6e7f7df63e98,curl_scanner
t13d030600_ffd59bab1b39_6e7f7df63e98,curl_scanner
t13d020400_ffd59bab1b39_6e7f7df63e98,curl_scanner
t12d030500_ffd59bab1b39_6e7f7df63e98,curl_scanner
t13d020300_6b9b1b2c3d4e_ffd59bab1b39,python_requests_scanner
t13d020200_6b9b1b2c3d4e_ffd59bab1b39,python_requests_scanner
t13d010300_6b9b1b2c3d4e_aabbccddeeff,python_requests_scanner
t12d020300_6b9b1b2c3d4e_ffd59bab1b39,python_requests_scanner
t13d1517h2_8daaf6152771_b0da82dd1658,go_http_scanner
t13d1517h2_8daaf6152771_02713d6af862,go_http_scanner
t12d1517h2_8daaf6152771_b0da82dd1658,go_http_scanner
t10d170000_0a1b2c3d4e5f_1b2c3d4e5f60,Masscan
t10d010000_0a1b2c3d4e5f_000000000000,Masscan
t12d050700_5a6b7c8d9e0f_1a2b3c4d5e6f,zgrab_scanner
t12d050600_5a6b7c8d9e0f_1a2b3c4d5e6f,zgrab_scanner
t12d030400_5a6b7c8d9e0f_0000deadbeef,zmap_scanner
t13d010100_aabbccddeeff_0011223344aa,Headless_Chrome_Automation
t13d010100_aabbccddeeff_ffeeddccbbaa,Headless_Chrome_Automation
t13d1517h2_aabbccddeeff_0011223344aa,Headless_Chrome_Automation
t13d030500_deadbeef1234_cafebabe5678,node_scanner
t13d020300_deadbeef1234_cafebabe5678,node_scanner
t13d1517h2_1234567890ab_abcdef012345,java_scanner
t12d1517h2_1234567890ab_abcdef012345,java_scanner
t13d020300_fedcba987654_0123456789ab,ruby_scanner
t12d010100_aabbccddeeff_deadbeefdead,nikto_scanner
t12d010100_ffeeddccbbaa_baddcafef00d,sqlmap_scanner
t13d030600_deadbeefcafe_babe12345678,nuclei_scanner
t13d020200_abcdef012345_fedcba987654,scrapy_crawler
t13d020300_abcdef012345_1234abcd5678,scrapy_crawler
t10d010000_0000000000_000000000000,malware_c2_minimal
t12d010100_1111111111_222222222222,cobalt_strike_beacon

1 t13d030500_ffd59bab1b39_6e7f7df63e98 curl_scanner
2 t13d030600_ffd59bab1b39_6e7f7df63e98 curl_scanner
3 t13d020400_ffd59bab1b39_6e7f7df63e98 curl_scanner
4 t12d030500_ffd59bab1b39_6e7f7df63e98 curl_scanner
5 t13d020300_6b9b1b2c3d4e_ffd59bab1b39 python_requests_scanner
6 t13d020200_6b9b1b2c3d4e_ffd59bab1b39 python_requests_scanner
7 t13d010300_6b9b1b2c3d4e_aabbccddeeff python_requests_scanner
8 t12d020300_6b9b1b2c3d4e_ffd59bab1b39 python_requests_scanner
9 t13d1517h2_8daaf6152771_b0da82dd1658 go_http_scanner
10 t13d1517h2_8daaf6152771_02713d6af862 go_http_scanner
11 t12d1517h2_8daaf6152771_b0da82dd1658 go_http_scanner
12 t10d170000_0a1b2c3d4e5f_1b2c3d4e5f60 Masscan
13 t10d010000_0a1b2c3d4e5f_000000000000 Masscan
14 t12d050700_5a6b7c8d9e0f_1a2b3c4d5e6f zgrab_scanner
15 t12d050600_5a6b7c8d9e0f_1a2b3c4d5e6f zgrab_scanner
16 t12d030400_5a6b7c8d9e0f_0000deadbeef zmap_scanner
17 t13d010100_aabbccddeeff_0011223344aa Headless_Chrome_Automation
18 t13d010100_aabbccddeeff_ffeeddccbbaa Headless_Chrome_Automation
19 t13d1517h2_aabbccddeeff_0011223344aa Headless_Chrome_Automation
20 t13d030500_deadbeef1234_cafebabe5678 node_scanner
21 t13d020300_deadbeef1234_cafebabe5678 node_scanner
22 t13d1517h2_1234567890ab_abcdef012345 java_scanner
23 t12d1517h2_1234567890ab_abcdef012345 java_scanner
24 t13d020300_fedcba987654_0123456789ab ruby_scanner
25 t12d010100_aabbccddeeff_deadbeefdead nikto_scanner
26 t12d010100_ffeeddccbbaa_baddcafef00d sqlmap_scanner
27 t13d030600_deadbeefcafe_babe12345678 nuclei_scanner
28 t13d020200_abcdef012345_fedcba987654 scrapy_crawler
29 t13d020300_abcdef012345_1234abcd5678 scrapy_crawler
30 t10d010000_0000000000_000000000000 malware_c2_minimal
31 t12d010100_1111111111_222222222222 cobalt_strike_beacon