Scrape Philippine government procurement opportunities from PhilGEPS (PhilGEPS 1.5).
Problem: 300K+ bid opportunities are posted annually on PhilGEPS. Finding relevant ones is hard β keyword-only search on a dated interface, 63% of bid failures due to poor documentation, and 60% of users experience platform issues.
Solution: This scraper monitors bids, filters by category/keyword, detects changes, and outputs structured JSON for integration with alerting systems, dashboards, or AI analysis.
pip install scrapling
# List all categories with bid counts
python philgeps-scraper.py --list
# Filter by keyword
python philgeps-scraper.py --keyword "construction"
python philgeps-scraper.py --keyword "IT"
# Watch mode β checks for new bids, outputs JSON
python philgeps-scraper.py --watch- Python 3.8+
- Scrapling (adaptive web scraping framework)
- Camoufox (for stealth browser rendering)
- Extracts all visible categories with active bid counts
- Filters by keyword (matches against category names)
- Watch mode: caches results and detects changes
- Handles ASP.NET WebForms postback-based navigation
- Cloudflare bypass via Camoufox/StealthyFetcher
- JSON output for pipeline integration
- Graceful error handling with retries
{
"source": "PhilGEPS 1.5",
"scraped_at": "2026-05-15T22:59:50+0800",
"categories_found": 20,
"total_active_bids": 911,
"categories": [
{"name": "Agricultural Products", "count": 214},
{"name": "Agricultural Machinery", "count": 153},
{"name": "Airconditioning Systems", "count": 132}
]
}The Philippine government spends PHP 6.3 trillion annually through PhilGEPS. 200K+ registered suppliers compete for 300K+ bid opportunities yearly. Most use manual search. This tool automates the discovery process.
PhilGEPS procurement data is public by law under RA 9184 (Government Procurement Reform Act), which mandates the system as the primary source of government procurement information to promote transparency. PhilGEPS also maintains an official Open Data Portal with machine-readable downloads.
Commercial products already operate in this space (Apify PhilGEPS Scraper, Hook/Sell to State), and academic projects openly scrape and publish PhilGEPS data. No anti-bot measures, rate limiting, or login requirements exist on the public notices page.
Please attribute data source as: PhilGEPS (philgeps.gov.ph) β Philippine Government Electronic Procurement System
Use responsibly with appropriate rate limiting. This tool runs on a daily schedule by default.
MIT