Estimate installs by country#55

Open

ddxv wants to merge 85 commits intoappgoblin-dev:mainfrom

ddxv:estimate-installs-by-country

Commits on Nov 13, 2025

Commits on Nov 14, 2025

Commits on Nov 16, 2025

Commits on Nov 24, 2025

Refresh schema
James O'Claire
committed
Refresh schema
James O'Claire
committed
Refresh schema
James O'Claire
committed

Commits on Dec 1, 2025

Drop some long b64 strings from ios insert
James O'Claire
committed
Reduce overhead memory in individual processes
James O'Claire
committed
Remove testing string
James O'Claire
committed

Commits on Dec 2, 2025

Add back in threadpoolexecutor but with the workers as well
James O'Claire
committed
Add back in threadpoolexecutor but with the workers as well
James O'Claire
committed

Commits on Dec 3, 2025

Try fewer default threads
James O'Claire
committed
avoid hammering when using threads
James O'Claire
committed
avoid hammering when using threads
James O'Claire
committed
Threading is causing issues with Google, which uses urllib rather than requests, remove for google but keep for apple
James O'Claire
committed

Commits on Dec 4, 2025

Merge branch 'appgoblin-dev:main' into main
ddxv
authored
Organize store_scrape log messages
James O'Claire
committed
Merge branch 'main' of github.com:ddxv/adscrawler
James O'Claire
committed
Organize store_scrape log messages
James O'Claire
committed
Add slight delay and jitter
James O'Claire
committed

Commits on Jan 21, 2026

Skip missing base64s
James O'Claire
committed
Stop tracking new_company
James O'Claire
committed
Add example
James O'Claire
committed
Use new fdw table
James O'Claire
committed

Commits on Jan 27, 2026

Update apps to crawl more often
James O'Claire
committed
WIP: new global keywords logic
James O'Claire
committed
WIP: new global keywords logic
James O'Claire
committed
Update apps to crawl more often
James O'Claire
committed

Commits on Jan 29, 2026

Dont retry apps that appear to have not updated recently
James O'Claire
committed

Commits on Jan 30, 2026

Use new logging table to cut down on query time for apps to keyword extract
James O'Claire
committed
Add optional dependencies related to keyword cleaning
James O'Claire
committed
Update query apps to download logic
James O'Claire
committed
Working on new global keywords logic
James O'Claire
committed
Better processing of app keyword extraction
James O'Claire
committed

Commits on Jan 31, 2026

Allow bad version strings
James O'Claire
committed
Allow bad version strings
James O'Claire
committed
Allow bad version strings
James O'Claire
committed

Commits on Feb 2, 2026

Clean weekly rank table after importing data
James O'Claire
committed
Clean weekly rank table after importing data
James O'Claire
committed

Commits on Feb 3, 2026

Commits on Feb 4, 2026

interim schema
James O'Claire
committed
interim schema
James O'Claire
committed
interim schema
James O'Claire
committed
interim schema
James O'Claire
committed

Commits on Feb 5, 2026

New schema
James O'Claire
committed

Commits on Feb 6, 2026

Prep Schema dump
James O'Claire
committed
Scrape apple HTML for ad supported and in apps
James O'Claire
committed
default to none
James O'Claire
committed
Remove unused columns
James O'Claire
committed

Commits on Feb 11, 2026

Fix apple global metrics by querying historical country data and combining for global metrics
James O'Claire
committed

Commits on Feb 12, 2026

Fixes for pulling apple data
James O'Claire
committed
Dump recent MV changes
James O'Claire
committed
Dump recent MV changes
James O'Claire
committed
Fix incorrect passing of args
James O'Claire
committed
Use search queries top priority for keyword searches
James O'Claire
committed
Use search queries top priority for keyword searches
James O'Claire
committed

Commits on Feb 13, 2026

Schema checkin
James O'Claire
committed

Commits on Feb 14, 2026

new tables
James O'Claire
committed
Rename table
James O'Claire
committed
Calculate WAU
James O'Claire
committed
include mau and logging
James O'Claire
committed
Add spot for it to run daily
James O'Claire
committed

Commits on Feb 15, 2026

speed up query
James O'Claire
committed

Commits on Feb 17, 2026

Add WIP estimate for installs per country based on ratings / reviews per country
James O'Claire
committed
Estimate tier percentages based on installs
James O'Claire
committed