Commit Graph

58 Commits

Author SHA1 Message Date
f4b20f824d removed crossplatformcompany from types 2026-01-14 14:49:00 +01:00
93fbefc9d4 removed id creation on scrape 2026-01-14 14:28:16 +01:00
4ea0c78d3d added ids for companies 2026-01-12 23:03:01 +01:00
1d025a04ce updated securities directory 2026-01-12 22:23:34 +01:00
98e1bca12f moved helper functions into helpers.rs 2026-01-12 22:06:13 +01:00
29d8f1d89e moved structs to types.rs 2026-01-12 18:50:44 +01:00
c0c9bc0ed9 added bond extraction from figi 2026-01-12 15:58:06 +01:00
659757482d öi 2026-01-12 01:01:19 +01:00
bd74f36f4c added integrity dir for set data collection; one state.jsonl 2026-01-11 16:57:36 +01:00
e6f8393660 merged enriching functions into one module 2026-01-11 14:24:18 +01:00
aff340ee2f migrated checkpoint handling in integrity.rs to ssot principle 2026-01-11 13:05:31 +01:00
0487c2ec49 changed file names for openfigi 2026-01-11 12:21:10 +01:00
04f4b0d0c4 added integrity check to openfigi functions 2026-01-11 00:06:25 +01:00
6f05dc8c99 added integrity check to forex and exchange collection functiosn 2026-01-10 19:46:21 +01:00
ac1345798d added integrity check to cleanse functions 2026-01-10 18:42:39 +01:00
766eb803f1 added integrity check to enrichment functions 2026-01-10 17:40:16 +01:00
151c96e35f working code :) 2026-01-10 15:11:06 +01:00
ae1876b014 cleaned up main 2026-01-10 00:30:59 +01:00
c86d828940 cleaned up main 2026-01-10 00:30:42 +01:00
c6d301d434 added helper functions to reduce bloat 2026-01-09 21:24:18 +01:00
ba841248f0 cleaned up update.rs eco and corp 2026-01-09 19:52:26 +01:00
8dd75f7bdf added yahoo exchange extraction 2026-01-09 19:09:42 +01:00
ea128f6187 added options chart enrichment 2026-01-08 11:35:25 +01:00
1720716144 added event enrichment 2026-01-08 00:35:10 +01:00
f9ce5bad99 fixed yahoo api calls for cleansing low profile data 2026-01-06 00:15:57 +01:00
fc25f32cbc fixed yahoo api calls for cleansing low profile data 2026-01-06 00:15:46 +01:00
3d16475b79 readded yahoo 2026-01-05 17:00:42 +01:00
86944a9c58 cleaned yahoo hits 2025-12-24 00:00:21 +01:00
f9f09d0291 added working hard reset 2025-12-23 15:07:40 +01:00
fb0876309f added hard reset for navigation timeout after 3 hours 2025-12-22 00:31:28 +01:00
c01b47000f removed serial data scraping for yahoo tickers 2025-12-19 16:58:22 +01:00
5e81959322 updated yahoo company extraction js to get the most data rich row 2025-12-19 14:43:36 +01:00
b366f366e6 added atomic writer action for ctr c abort 2025-12-19 14:12:56 +01:00
cd91de253b added pool rotation to chromedriver pool 2025-12-18 15:59:56 +01:00
9c66f0d361 added parallelized scraping instances for company yahoo ticker seeding 2025-12-18 13:05:23 +01:00
d26e833d93 added update_rule for incremental change 2025-12-15 23:47:28 +01:00
d744769138 added companie mapping with yahoo tickers 2025-12-14 16:48:02 +01:00
00c9d45642 added data streaming instead of laoding 2025-12-12 10:54:01 +01:00
c2408d9a56 added gettin opnv setup files 2025-12-09 19:23:54 +01:00
f95e9e2427 commented unused function 2025-12-09 16:56:45 +01:00
c00bfd8687 removing not map-able LEIs 2025-12-07 17:38:32 +01:00
0f89c8c0ce updated cache saving 2025-12-07 14:49:25 +01:00
a6823dc938 moved data capturing into cache folder 2025-12-05 22:32:42 +01:00
58a498e694 added logging 2025-12-05 21:20:12 +01:00
b0a471ea84 added mapping figi info onto common shares / warrants / options 2025-12-04 21:03:55 +01:00
ef2393ab70 added creating CompanyInfo mapping 2025-12-04 13:33:32 +01:00
95fd9ca141 working api calls 2025-12-02 17:10:34 +01:00
de875a3ebe added figi.md for figi description 2025-12-01 13:24:55 +01:00
2fe06a9d88 changed types might remove ticker info bc replaced by figi 2025-11-26 00:34:23 +01:00
9db4320c40 adding openfigi as identifier for company data 2025-11-25 22:18:57 +01:00