Commit Graph

30 Commits

Author SHA1 Message Date
fb0876309f added hard reset for navigation timeout after 3 hours 2025-12-22 00:31:28 +01:00
b366f366e6 added atomic writer action for ctr c abort 2025-12-19 14:12:56 +01:00
9c66f0d361 added parallelized scraping instances for company yahoo ticker seeding 2025-12-18 13:05:23 +01:00
d26e833d93 added update_rule for incremental change 2025-12-15 23:47:28 +01:00
d744769138 added companie mapping with yahoo tickers 2025-12-14 16:48:02 +01:00
1bda78897b implement vpn pool 2025-12-11 23:18:04 +01:00
470f0922ed capabable spawning multiple openvpn instances 2025-12-11 00:36:46 +01:00
c2408d9a56 added gettin opnv setup files 2025-12-09 19:23:54 +01:00
58a498e694 added logging 2025-12-05 21:20:12 +01:00
ef2393ab70 added creating CompanyInfo mapping 2025-12-04 13:33:32 +01:00
eeae94e041 adding openfigi as identifier for company data 2025-11-25 22:18:52 +01:00
9cfcae84ea added function aggregating multiple ticker data 2025-11-24 17:19:36 +01:00
cd3f47d91f using chromedriver for collecting corporate earnings 2025-11-22 20:47:24 +01:00
9d0d15f3f8 adding corporate data to webscraper 2025-11-21 00:17:59 +01:00
71df92965f working update function 2025-11-18 20:16:16 +01:00
0ca53bf585 added dual key usage for event detection 2025-11-18 15:10:36 +01:00
4dec97ef63 added changes saving to seperate folder 2025-11-17 15:56:56 +01:00
32ae002fc9 added updating future data 2025-11-17 15:32:19 +01:00
c56fcfdd72 persistent scraping 2025-11-17 15:20:09 +01:00
0af0c1e615 moved functions for date parsing together 2025-11-17 13:52:41 +01:00
b8c98163da working scraping 2025-11-16 21:15:37 +01:00
6302c8749a removed seperate description scraping 2025-11-16 19:20:09 +01:00
3df871f69f cleaned up main 2025-11-16 19:18:20 +01:00
67ecc1e89a updated ignore config 2025-11-16 17:25:49 +01:00
a91447cace uncommented unnecessary code 2025-11-16 17:15:30 +01:00
d6e244c8d8 restricting collected data to important 2025-11-16 17:12:56 +01:00
0853124918 validation of scraped data 2025-11-16 16:34:22 +01:00
59aad09f71 extracting data from js 2025-11-16 15:34:30 +01:00
2604caab0e date change check working 2025-11-16 12:29:47 +01:00
e6729b06b8 getting on website; edit date and importance 2025-11-16 02:06:25 +01:00