Menu
WebTruffle author
Daniel
Web developer and data scraping specialist
Daniel writes about the engineering, operations, and commercial decisions behind dependable web data feeds.
Articles by Daniel
Operations · 10 min read
Send Tender Deadline Changes to Slack with a Tested Python Workflow
Data Quality · 10 min read
USAspending Subaward Data in Python: Link Subcontractors to Prime Awards
Data Quality · 11 min read
BOAMP API vs TED: Measure French Tender Coverage for Your Application
Data Quality · 11 min read
RFP Requirements Extraction: Turn Public Tender PDFs into Traceable JSON
Data Quality · 10 min read
Tender Documents APIs: Check Attachment Coverage Before Building
Data Quality · 11 min read
Semantic Tender Search in Python: Compare Keywords and Embeddings
Data Quality · 10 min read
Government Contract Expiration Tracking: Current vs Potential End Dates
Strategy · 11 min read
Historical Procurement Data: Evaluate an Archive Before You Buy
Data Quality · 10 min read
CPV Code Search for Tender Pipelines: Expand Categories and Test Filters
Operations · 10 min read
Government Contract Data in Snowflake: Load a Dataset and Apply Updates
Data Quality · 9 min read
Supplier Entity Resolution: Match Public Contract Winners to Company Records
Data Quality · 9 min read
Test a Public Procurement Data Feed: A Runnable Evaluation Pack
Data Quality · 9 min read
Build a Government Contract Dashboard in Power BI with Public Data
Operations · 9 min read
SAM.gov to HubSpot: Import Opportunities and Keep Deals Updated
Data Quality · 10 min read
Convert OCDS JSON to CSV Without Losing Lots, Awards or Suppliers
Strategy · 11 min read
Tender Data APIs Compared: Coverage, Updates, History and Integration
Data Quality · 17 min read
IMLS FY 2027 Grants: 13 Programs and $80.72M in Planned Funding
Operations · 25 min read
Procurement Lifecycle Links with Python: Audit Notices, Awards, Suppliers and Contracts
Operations · 25 min read
Government Contract Awards with Python: Analyze EU and UK Suppliers Safely
Operations · 25 min read
How to Combine Daily Federal Contract Award Releases Without Double Counting
Operations · 25 min read
US Federal Procurement Forecasts with Python: Build a Verified Watchlist
Operations · 25 min read
US Federal Contract Awards with Python: Analyze Suppliers and Obligations Safely
Data Quality · 24 min read
How to Build a Product Price Monitoring Dataset: Matching, Offers and Change History
Data Quality · 24 min read
How to Build a Property Listing Dataset: Schema, Deduplication and Change Tracking
Data Quality · 23 min read
Business Location Data: Sources, Schema and Entity Matching
Operations · 22 min read
How to Build a Competitive Intelligence Database: Sources, Schema and Change Tracking
Operations · 24 min read
Retail Product Price Data with Python: Filtered Samples and Price Trends
Operations · 23 min read
How to Build a Custom Data Feed: A Production Design Guide
Operations · 24 min read
Federal Grants Data with Python: Applicant Types, Funding & Deadlines
Operations · 24 min read
Government Tender Data with Python: Query Opportunities and Changes
Operations · 25 min read
Find a Tender API Guide: Download UK Notices with OCDS
Operations · 24 min read
TED Search API v3 Guide: Download EU Procurement Notices
Strategy · 19 min read
Public Procurement Demand by Category: August 2026 Snapshot
Operations · 26 min read
USAspending API Guide: Download Federal Contract Data Reliably
Operations · 24 min read
Grants.gov API Migration: Search2 to Simpler.Grants.gov
Operations · 30 min read
FPDS API Replacement: Migrate to SAM.gov Contract Awards API
Operations · 22 min read
SAM.gov API Guide: Download Contract Opportunities Reliably
Strategy · 20 min read
Government Contract Analysis: Measure Demand and Supplier Competition
Operations · 20 min read
Government Contract Tracker Guide: Monitor Opportunities, Awards and Amendments
Strategy · 18 min read
How to Find Awarded U.S. Federal Contracts: SAM.gov vs USAspending
Strategy · 22 min read
SAM.gov vs TED vs UK Tender Sources: Coverage and API Comparison
Strategy · 20 min read
Government Contracts Database Guide: Model Opportunities, Awards and Suppliers
Operations · 20 min read
Web Scraper Maintenance: What Production Ownership Includes
Strategy · 19 min read
How to Run a Web Scraping Proof of Concept That Predicts Production
Strategy · 18 min read
What a Web Scraping SLA Should Measure
Strategy · 20 min read
How to Choose a Web Scraping Vendor: A 20-Point Scorecard
Strategy · 18 min read
Web Scraping TCO: The Costs Most Build-vs-Buy Models Miss
Strategy · 17 min read
What Does It Really Cost to Maintain a Web Scraper?
Operations · 17 min read
How to Migrate an In-House Web Scraper to a Managed Service
Strategy · 16 min read
When to Outsource Web Scraping: 9 Signs to Watch
Operations · 14 min read
Web Scraping Monitoring: A Runbook for Reliable Data Feeds
Strategy · 18 min read