Knowledge Base

Conventions, good docs and little code: why fullstack frameworks shrink the context an AI agent needs, and why Django is not my pick. more

Build your own website with AI and deploy it free on Cloudflare. We can help when code, DNS, deployment, or infrastructure blocks your progress. more

How the yii2-forms module builds forms by drag and drop, renders them as a widget, and keeps one database table per form. more

A bill of nearly 900 PLN for Gemini API despite billing alerts. Two causes: a changed Google account email and paid subscription overages. more

An hourly snapshot from our crawler dashboard: 66.3 million hosts, 27.4 million indexed, DNS, TLS and robots.txt audits, and the error codes that map the dead web. more

Durable Functions is a workflow engine. When your state is a cursor, a flag, or a counter, one Table Storage row with an ETag replaces it. more

BigQuery Graph reached GA. Turn your existing tables into nodes and edges, query them in GQL, and keep your data and permissions in BigQuery. more

A one-minute checklist for writing title tags, meta descriptions, H1 headings and H2 sections that support clear search results. more

A practical OpenTofu pattern for separate account-owned Cloudflare tokens for infrastructure, CI/CD and administration. more

BotBase for Operators lets you submit a crawler, watch the review status, edit the record, and pass automated identity checks. more

Fault Injection Testing is in preview. It can fail over a Cloud SQL instance or degrade traffic at a Layer 7 load balancer. more

Cloud Run instances add a singleton runtime with a stable HTTPS URL, stop and resume controls, and up to seven days of continuous execution. more

Cloudflare has moved Access policy from individual hostnames to the Worker itself, closing gaps across custom domains, routes, workers.dev, and previews. more

Turn ETL job history, warehouse queries, and BI report refreshes into Datadog APM traces with accurate timing, dependencies, and status. more

Astro, Markdown, Cloudflare Workers and OpenTofu as a stack for blogs and company sites: fast deploys, good SEO and easy AI-agent work. more

OpenTofu manages DNS and edge policy, Wrangler deploys Workers, and the firewall limits the exposure of homelab services. more

Plain HTML, Pico CSS and a zero-build architecture are enough for many company sites, cutting dependencies and simplifying deployment. more

Plain-English definitions of common crawler, Python, infrastructure, cloud, and design-pattern terms used across our engineering documentation. more

Guidelines for productive engineering work, escalation, learning, documentation, and team communication. more

Workstation setup and local development instructions for contributors to the crawler project. more

Use Scrapy signals as an Observer pattern, with working examples and a rule for when pipelines or durable messaging fit better. more

Get useful code out of AI agents faster by pinning versions, keeping a short README as the source of truth, and sending small prompts. more

Build a readable MikroTik firewall for a homelab: safe mode, interface lists, default deny with logging, and input and forward chains. more

Harden a homelab that exposes public services, using a locked-down management plane, VPN access, DMZ segmentation and origin protection. more

Keep OVH mail working after moving DNS to Cloudflare, using unproxied MX and client records plus SPF, DKIM, DMARC and DNSSEC. more

Manage Cloudflare zones, proxied DNS records and cache rules as IaC with OpenTofu, using one DRY block for every domain. more

Seven RAG anti-patterns that quietly ruin retrieval quality, and the simpler practices that fix them: own the context, structure over size. more

Pick the right Yii2 application template up front: what Basic and Advanced actually differ in, and when converting one into the other is cheaper. more

Build image search that answers in text: pick an embedding model, a vector database and a multimodal LLM, then cut the running cost. more

Decide whether Datadog is worth its price, and why building observability on logs first keeps the bill predictable as pipelines grow. more

What a persistent webshell on a Magento 2 VPS looked like, how it was removed in two days, and what to check on your own server. more

Weigh a private LLM/RAG for a law firm: hallucination risk, attorney-client privilege, running cost and what implementation demands. more

How a 2019 visual product search was built, from crawling shop catalogues to vectorising photos and serving nearest-neighbour results. more

Crawl 66 million pages at $2 per million on preemptible VMs, and learn the one limitation that decides whether the trade-off fits. more