Commit Graph

Select branches

Hide Pull Requests

feature/browser-vpn

main

Mono Color

• eff1412c0f removed claudes md main donpat1to 2026-01-15 00:23:29 +01:00
• 75ab1969c7 added cross compatiblity between shutdown flag and state entries donpat1to 2026-01-15 00:22:55 +01:00
• f4b20f824d removed crossplatformcompany from types donpat1to 2026-01-14 14:49:00 +01:00
• 93fbefc9d4 removed id creation on scrape donpat1to 2026-01-14 14:28:16 +01:00
• 4ea0c78d3d added ids for companies donpat1to 2026-01-12 23:03:01 +01:00
• 1d025a04ce updated securities directory donpat1to 2026-01-12 22:23:34 +01:00
• 98e1bca12f moved helper functions into helpers.rs donpat1to 2026-01-12 22:06:13 +01:00
• 29d8f1d89e moved structs to types.rs donpat1to 2026-01-12 18:50:44 +01:00
• c0c9bc0ed9 added bond extraction from figi donpat1to 2026-01-12 15:58:06 +01:00
• 659757482d öi donpat1to 2026-01-12 01:01:19 +01:00
• bd74f36f4c added integrity dir for set data collection; one state.jsonl donpat1to 2026-01-11 16:57:36 +01:00
• e6f8393660 merged enriching functions into one module donpat1to 2026-01-11 14:24:18 +01:00
• aff340ee2f migrated checkpoint handling in integrity.rs to ssot principle donpat1to 2026-01-11 13:05:31 +01:00
• 0487c2ec49 changed file names for openfigi donpat1to 2026-01-11 12:21:10 +01:00
• 04f4b0d0c4 added integrity check to openfigi functions donpat1to 2026-01-11 00:06:25 +01:00
• 6f05dc8c99 added integrity check to forex and exchange collection functiosn donpat1to 2026-01-10 19:46:21 +01:00
• ac1345798d added integrity check to cleanse functions donpat1to 2026-01-10 18:42:39 +01:00
• 766eb803f1 added integrity check to enrichment functions donpat1to 2026-01-10 17:40:16 +01:00
• 151c96e35f working code :) donpat1to 2026-01-10 15:11:06 +01:00
• ae1876b014 cleaned up main donpat1to 2026-01-10 00:30:59 +01:00
• c86d828940 cleaned up main donpat1to 2026-01-10 00:30:42 +01:00
• c6d301d434 added helper functions to reduce bloat donpat1to 2026-01-09 21:24:18 +01:00
• ba841248f0 cleaned up update.rs eco and corp donpat1to 2026-01-09 19:52:26 +01:00
• 8dd75f7bdf added yahoo exchange extraction donpat1to 2026-01-09 19:09:42 +01:00
• ea128f6187 added options chart enrichment donpat1to 2026-01-08 11:35:25 +01:00
• 1720716144 added event enrichment donpat1to 2026-01-08 00:35:10 +01:00
• f9ce5bad99 fixed yahoo api calls for cleansing low profile data donpat1to 2026-01-06 00:15:57 +01:00
• fc25f32cbc fixed yahoo api calls for cleansing low profile data donpat1to 2026-01-06 00:15:46 +01:00
• 3d16475b79 readded yahoo donpat1to 2026-01-05 17:00:42 +01:00
• 86944a9c58 cleaned yahoo hits donpat1to 2025-12-24 00:00:21 +01:00
• f9f09d0291 added working hard reset donpat1to 2025-12-23 15:07:40 +01:00
• fb0876309f added hard reset for navigation timeout after 3 hours donpat1to 2025-12-22 00:31:28 +01:00
• c01b47000f removed serial data scraping for yahoo tickers donpat1to 2025-12-19 16:58:22 +01:00
• 5e81959322 updated yahoo company extraction js to get the most data rich row donpat1to 2025-12-19 14:43:36 +01:00
• b366f366e6 added atomic writer action for ctr c abort donpat1to 2025-12-19 14:12:56 +01:00
• cd91de253b added pool rotation to chromedriver pool donpat1to 2025-12-18 15:59:56 +01:00
• c51b36c125 added session detection with requests per task donpat1to 2025-12-18 14:01:51 +01:00
• 9c66f0d361 added parallelized scraping instances for company yahoo ticker seeding donpat1to 2025-12-18 13:05:23 +01:00
• d26e833d93 added update_rule for incremental change donpat1to 2025-12-15 23:47:28 +01:00
• d744769138 added companie mapping with yahoo tickers donpat1to 2025-12-14 16:48:02 +01:00
• 00c9d45642 added data streaming instead of laoding donpat1to 2025-12-12 10:54:01 +01:00
• 1bda78897b implement vpn pool donpat1to 2025-12-11 23:18:04 +01:00
• 470f0922ed capabable spawning multiple openvpn instances donpat1to 2025-12-11 00:36:46 +01:00
• c9da56e8e9 removed unused functions donpat1to 2025-12-09 23:27:51 +01:00
• dde859b071 removed unused imports donpat1to 2025-12-09 23:27:14 +01:00
• 2416947e9d getting vpn ovpn data donpat1to 2025-12-09 23:24:51 +01:00
• 3ab5d0dcc3 added fetching openvpn packages donpat1to 2025-12-09 19:51:11 +01:00
• c2408d9a56 added gettin opnv setup files donpat1to 2025-12-09 19:23:54 +01:00
• f95e9e2427 commented unused function donpat1to 2025-12-09 16:56:45 +01:00
• 81f216f3bc added vpn ip rotation feature/browser-vpn donpat1to 2025-12-09 14:57:18 +01:00
• c00bfd8687 removing not map-able LEIs donpat1to 2025-12-07 17:38:32 +01:00
• 0f89c8c0ce updated cache saving donpat1to 2025-12-07 14:49:25 +01:00
• a6823dc938 moved data capturing into cache folder donpat1to 2025-12-05 22:32:42 +01:00
• 58a498e694 added logging donpat1to 2025-12-05 21:20:12 +01:00
• f7083bf9f0 changed noting donpat1to 2025-12-04 23:55:52 +01:00
• f05df0b5ee updated .gitignore donpat1to 2025-12-04 21:08:36 +01:00
• b0a471ea84 added mapping figi info onto common shares / warrants / options donpat1to 2025-12-04 21:03:55 +01:00
• 787a08d6f1 removed unused imports economic donpat1to 2025-12-04 13:38:14 +01:00
• ef2393ab70 added creating CompanyInfo mapping donpat1to 2025-12-04 13:33:32 +01:00
• 95fd9ca141 working api calls donpat1to 2025-12-02 17:10:34 +01:00
• de875a3ebe added figi.md for figi description donpat1to 2025-12-01 13:24:55 +01:00
• 2fe06a9d88 changed types might remove ticker info bc replaced by figi donpat1to 2025-11-26 00:34:23 +01:00
• 9db4320c40 adding openfigi as identifier for company data donpat1to 2025-11-25 22:18:57 +01:00
• eeae94e041 adding openfigi as identifier for company data donpat1to 2025-11-25 22:18:52 +01:00
• e57a013224 added lei to isin mapping donpat1to 2025-11-25 00:21:51 +01:00
• bbc19f2110 storing data for multiple exchanges for a single isin donpat1to 2025-11-24 18:33:13 +01:00
• 9cfcae84ea added function aggregating multiple ticker data donpat1to 2025-11-24 17:19:36 +01:00
• 7b680f960f fetching 5min data only for the last 60 days donpat1to 2025-11-23 21:43:53 +01:00
• 462f7ca672 added corporate quarterly announcments for the last 4 years donpat1to 2025-11-23 16:02:23 +01:00
• cd3f47d91f using chromedriver for collecting corporate earnings donpat1to 2025-11-22 20:47:24 +01:00
• fc56ae5d82 fixed force update for new data and changes without new_event change donpat1to 2025-11-22 19:56:56 +01:00
• 9d0d15f3f8 adding corporate data to webscraper donpat1to 2025-11-21 00:17:59 +01:00
• 0ea3fcc3b5 updated gitignore donpat1to 2025-11-18 20:18:19 +01:00
• 71df92965f working update function donpat1to 2025-11-18 20:16:16 +01:00
• 0ca53bf585 added dual key usage for event detection donpat1to 2025-11-18 15:10:36 +01:00
• 4dec97ef63 added changes saving to seperate folder donpat1to 2025-11-17 15:56:56 +01:00
• 32ae002fc9 added updating future data donpat1to 2025-11-17 15:32:19 +01:00
• c56fcfdd72 persistent scraping donpat1to 2025-11-17 15:20:09 +01:00
• 0af0c1e615 moved functions for date parsing together donpat1to 2025-11-17 13:52:41 +01:00
• a44e22df0b updated readme donpat1to 2025-11-16 22:07:24 +01:00
• b8c98163da working scraping donpat1to 2025-11-16 21:15:37 +01:00
• 6302c8749a removed seperate description scraping donpat1to 2025-11-16 19:20:09 +01:00
• 3df871f69f cleaned up main donpat1to 2025-11-16 19:18:20 +01:00
• 67ecc1e89a updated ignore config donpat1to 2025-11-16 17:25:49 +01:00
• a91447cace uncommented unnecessary code donpat1to 2025-11-16 17:15:30 +01:00
• d6e244c8d8 restricting collected data to important donpat1to 2025-11-16 17:12:56 +01:00
• 0853124918 validation of scraped data donpat1to 2025-11-16 16:34:22 +01:00
• 59aad09f71 extracting data from js donpat1to 2025-11-16 15:34:30 +01:00
• 2604caab0e date change check working donpat1to 2025-11-16 12:29:47 +01:00
• e6729b06b8 getting on website; edit date and importance donpat1to 2025-11-16 02:06:25 +01:00
• 645f7a546b Initial commit Patrick Mahnke-Hartmann 2025-11-15 18:53:48 +01:00