Commit Graph

70 Commits

Author SHA1 Message Date
c86d828940 cleaned up main 2026-01-10 00:30:42 +01:00
c6d301d434 added helper functions to reduce bloat 2026-01-09 21:24:18 +01:00
ba841248f0 cleaned up update.rs eco and corp 2026-01-09 19:52:26 +01:00
8dd75f7bdf added yahoo exchange extraction 2026-01-09 19:09:42 +01:00
ea128f6187 added options chart enrichment 2026-01-08 11:35:25 +01:00
1720716144 added event enrichment 2026-01-08 00:35:10 +01:00
f9ce5bad99 fixed yahoo api calls for cleansing low profile data 2026-01-06 00:15:57 +01:00
fc25f32cbc fixed yahoo api calls for cleansing low profile data 2026-01-06 00:15:46 +01:00
3d16475b79 readded yahoo 2026-01-05 17:00:42 +01:00
86944a9c58 cleaned yahoo hits 2025-12-24 00:00:21 +01:00
f9f09d0291 added working hard reset 2025-12-23 15:07:40 +01:00
fb0876309f added hard reset for navigation timeout after 3 hours 2025-12-22 00:31:28 +01:00
c01b47000f removed serial data scraping for yahoo tickers 2025-12-19 16:58:22 +01:00
5e81959322 updated yahoo company extraction js to get the most data rich row 2025-12-19 14:43:36 +01:00
b366f366e6 added atomic writer action for ctr c abort 2025-12-19 14:12:56 +01:00
cd91de253b added pool rotation to chromedriver pool 2025-12-18 15:59:56 +01:00
c51b36c125 added session detection with requests per task 2025-12-18 14:01:51 +01:00
9c66f0d361 added parallelized scraping instances for company yahoo ticker seeding 2025-12-18 13:05:23 +01:00
d26e833d93 added update_rule for incremental change 2025-12-15 23:47:28 +01:00
d744769138 added companie mapping with yahoo tickers 2025-12-14 16:48:02 +01:00
00c9d45642 added data streaming instead of laoding 2025-12-12 10:54:01 +01:00
1bda78897b implement vpn pool 2025-12-11 23:18:04 +01:00
470f0922ed capabable spawning multiple openvpn instances 2025-12-11 00:36:46 +01:00
c9da56e8e9 removed unused functions 2025-12-09 23:27:51 +01:00
dde859b071 removed unused imports 2025-12-09 23:27:14 +01:00
2416947e9d getting vpn ovpn data 2025-12-09 23:24:51 +01:00
3ab5d0dcc3 added fetching openvpn packages 2025-12-09 19:51:11 +01:00
c2408d9a56 added gettin opnv setup files 2025-12-09 19:23:54 +01:00
f95e9e2427 commented unused function 2025-12-09 16:56:45 +01:00
c00bfd8687 removing not map-able LEIs 2025-12-07 17:38:32 +01:00
0f89c8c0ce updated cache saving 2025-12-07 14:49:25 +01:00
a6823dc938 moved data capturing into cache folder 2025-12-05 22:32:42 +01:00
58a498e694 added logging 2025-12-05 21:20:12 +01:00
f7083bf9f0 changed noting 2025-12-04 23:55:52 +01:00
f05df0b5ee updated .gitignore 2025-12-04 21:08:36 +01:00
b0a471ea84 added mapping figi info onto common shares / warrants / options 2025-12-04 21:03:55 +01:00
787a08d6f1 removed unused imports economic 2025-12-04 13:38:14 +01:00
ef2393ab70 added creating CompanyInfo mapping 2025-12-04 13:33:32 +01:00
95fd9ca141 working api calls 2025-12-02 17:10:34 +01:00
de875a3ebe added figi.md for figi description 2025-12-01 13:24:55 +01:00
2fe06a9d88 changed types might remove ticker info bc replaced by figi 2025-11-26 00:34:23 +01:00
9db4320c40 adding openfigi as identifier for company data 2025-11-25 22:18:57 +01:00
eeae94e041 adding openfigi as identifier for company data 2025-11-25 22:18:52 +01:00
e57a013224 added lei to isin mapping 2025-11-25 00:21:51 +01:00
bbc19f2110 storing data for multiple exchanges for a single isin 2025-11-24 18:33:13 +01:00
9cfcae84ea added function aggregating multiple ticker data 2025-11-24 17:19:36 +01:00
7b680f960f fetching 5min data only for the last 60 days 2025-11-23 21:43:53 +01:00
462f7ca672 added corporate quarterly announcments for the last 4 years 2025-11-23 16:02:23 +01:00
cd3f47d91f using chromedriver for collecting corporate earnings 2025-11-22 20:47:24 +01:00
fc56ae5d82 fixed force update for new data and changes without new_event change 2025-11-22 19:56:56 +01:00