Commit Graph

83 Commits

Author SHA1 Message Date
29d8f1d89e moved structs to types.rs 2026-01-12 18:50:44 +01:00
c0c9bc0ed9 added bond extraction from figi 2026-01-12 15:58:06 +01:00
659757482d öi 2026-01-12 01:01:19 +01:00
bd74f36f4c added integrity dir for set data collection; one state.jsonl 2026-01-11 16:57:36 +01:00
e6f8393660 merged enriching functions into one module 2026-01-11 14:24:18 +01:00
aff340ee2f migrated checkpoint handling in integrity.rs to ssot principle 2026-01-11 13:05:31 +01:00
0487c2ec49 changed file names for openfigi 2026-01-11 12:21:10 +01:00
04f4b0d0c4 added integrity check to openfigi functions 2026-01-11 00:06:25 +01:00
6f05dc8c99 added integrity check to forex and exchange collection functiosn 2026-01-10 19:46:21 +01:00
ac1345798d added integrity check to cleanse functions 2026-01-10 18:42:39 +01:00
766eb803f1 added integrity check to enrichment functions 2026-01-10 17:40:16 +01:00
151c96e35f working code :) 2026-01-10 15:11:06 +01:00
ae1876b014 cleaned up main 2026-01-10 00:30:59 +01:00
c86d828940 cleaned up main 2026-01-10 00:30:42 +01:00
c6d301d434 added helper functions to reduce bloat 2026-01-09 21:24:18 +01:00
ba841248f0 cleaned up update.rs eco and corp 2026-01-09 19:52:26 +01:00
8dd75f7bdf added yahoo exchange extraction 2026-01-09 19:09:42 +01:00
ea128f6187 added options chart enrichment 2026-01-08 11:35:25 +01:00
1720716144 added event enrichment 2026-01-08 00:35:10 +01:00
f9ce5bad99 fixed yahoo api calls for cleansing low profile data 2026-01-06 00:15:57 +01:00
fc25f32cbc fixed yahoo api calls for cleansing low profile data 2026-01-06 00:15:46 +01:00
3d16475b79 readded yahoo 2026-01-05 17:00:42 +01:00
86944a9c58 cleaned yahoo hits 2025-12-24 00:00:21 +01:00
f9f09d0291 added working hard reset 2025-12-23 15:07:40 +01:00
fb0876309f added hard reset for navigation timeout after 3 hours 2025-12-22 00:31:28 +01:00
c01b47000f removed serial data scraping for yahoo tickers 2025-12-19 16:58:22 +01:00
5e81959322 updated yahoo company extraction js to get the most data rich row 2025-12-19 14:43:36 +01:00
b366f366e6 added atomic writer action for ctr c abort 2025-12-19 14:12:56 +01:00
cd91de253b added pool rotation to chromedriver pool 2025-12-18 15:59:56 +01:00
c51b36c125 added session detection with requests per task 2025-12-18 14:01:51 +01:00
9c66f0d361 added parallelized scraping instances for company yahoo ticker seeding 2025-12-18 13:05:23 +01:00
d26e833d93 added update_rule for incremental change 2025-12-15 23:47:28 +01:00
d744769138 added companie mapping with yahoo tickers 2025-12-14 16:48:02 +01:00
00c9d45642 added data streaming instead of laoding 2025-12-12 10:54:01 +01:00
1bda78897b implement vpn pool 2025-12-11 23:18:04 +01:00
470f0922ed capabable spawning multiple openvpn instances 2025-12-11 00:36:46 +01:00
c9da56e8e9 removed unused functions 2025-12-09 23:27:51 +01:00
dde859b071 removed unused imports 2025-12-09 23:27:14 +01:00
2416947e9d getting vpn ovpn data 2025-12-09 23:24:51 +01:00
3ab5d0dcc3 added fetching openvpn packages 2025-12-09 19:51:11 +01:00
c2408d9a56 added gettin opnv setup files 2025-12-09 19:23:54 +01:00
f95e9e2427 commented unused function 2025-12-09 16:56:45 +01:00
c00bfd8687 removing not map-able LEIs 2025-12-07 17:38:32 +01:00
0f89c8c0ce updated cache saving 2025-12-07 14:49:25 +01:00
a6823dc938 moved data capturing into cache folder 2025-12-05 22:32:42 +01:00
58a498e694 added logging 2025-12-05 21:20:12 +01:00
f7083bf9f0 changed noting 2025-12-04 23:55:52 +01:00
f05df0b5ee updated .gitignore 2025-12-04 21:08:36 +01:00
b0a471ea84 added mapping figi info onto common shares / warrants / options 2025-12-04 21:03:55 +01:00
787a08d6f1 removed unused imports economic 2025-12-04 13:38:14 +01:00